[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:18:41.150090  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:41401
I20260709 12:18:41.151752  3102 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:18:41.152875  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:41.171523  3109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:41.171514  3108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:41.174042  3102 server_base.cc:1061] running on GCE node
W20260709 12:18:41.171864  3112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:42.375470  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:42.375713  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:42.375974  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599522375948 us; error 0 us; skew 500 ppm
I20260709 12:18:42.376843  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:42.383595  3102 webserver.cc:533] Webserver started at http://127.3.7.190:34537/ using document root <none> and password file <none>
I20260709 12:18:42.384513  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:42.384752  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:42.385229  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:42.391216  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "4fe6cab6e7a3494f9e7268a911b1687c"
format_stamp: "Formatted at 2026-07-09 12:18:42 on dist-test-slave-6qf7"
I20260709 12:18:42.399421  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:18:42.404806  3118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:42.406069  3102 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:18:42.406466  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "4fe6cab6e7a3494f9e7268a911b1687c"
format_stamp: "Formatted at 2026-07-09 12:18:42 on dist-test-slave-6qf7"
I20260709 12:18:42.406832  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:42.465611  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:42.467365  3102 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:18:42.467911  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:42.545080  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:41401
I20260709 12:18:42.545218  3169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:41401 every 8 connection(s)
I20260709 12:18:42.553217  3170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:42.575536  3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c: Bootstrap starting.
I20260709 12:18:42.582206  3170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:42.584223  3170 log.cc:826] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c: Log is configured to *not* fsync() on all Append() calls
I20260709 12:18:42.589058  3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c: No bootstrap required, opened a new log
I20260709 12:18:42.610076  3170 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" member_type: VOTER }
I20260709 12:18:42.610659  3170 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:42.610991  3170 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe6cab6e7a3494f9e7268a911b1687c, State: Initialized, Role: FOLLOWER
I20260709 12:18:42.612238  3170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" member_type: VOTER }
I20260709 12:18:42.612829  3170 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:42.613148  3170 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:42.613526  3170 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:42.617833  3170 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" member_type: VOTER }
I20260709 12:18:42.619012  3170 leader_election.cc:304] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe6cab6e7a3494f9e7268a911b1687c; no voters: 
I20260709 12:18:42.621058  3170 leader_election.cc:290] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:42.621500  3173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:42.623878  3173 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 1 LEADER]: Becoming Leader. State: Replica: 4fe6cab6e7a3494f9e7268a911b1687c, State: Running, Role: LEADER
I20260709 12:18:42.624924  3173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" member_type: VOTER }
I20260709 12:18:42.626454  3170 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:42.636716  3174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" member_type: VOTER } }
I20260709 12:18:42.637072  3175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe6cab6e7a3494f9e7268a911b1687c. Latest consensus state: current_term: 1 leader_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe6cab6e7a3494f9e7268a911b1687c" member_type: VOTER } }
I20260709 12:18:42.637605  3174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:42.637673  3175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:42.641491  3181 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:42.655112  3181 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:42.657470  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:42.671872  3181 catalog_manager.cc:1383] Generated new cluster ID: fb02b82cc1284345af5714601281a962
I20260709 12:18:42.672222  3181 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:42.692245  3181 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:42.693889  3181 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:42.709847  3181 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c: Generated new TSK 0
I20260709 12:18:42.710789  3181 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:42.724678  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:42.733538  3192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:42.735234  3193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:42.739028  3195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:42.739904  3102 server_base.cc:1061] running on GCE node
I20260709 12:18:42.740610  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:42.740844  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:42.741045  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599522741029 us; error 0 us; skew 500 ppm
I20260709 12:18:42.741641  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:42.746202  3102 webserver.cc:533] Webserver started at http://127.3.7.129:35765/ using document root <none> and password file <none>
I20260709 12:18:42.746804  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:42.747036  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:42.747382  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:42.748550  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "a333d53b2994457a8080c48175c82406"
format_stamp: "Formatted at 2026-07-09 12:18:42 on dist-test-slave-6qf7"
I20260709 12:18:42.754323  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 12:18:42.758949  3200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:42.759825  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:18:42.760118  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "a333d53b2994457a8080c48175c82406"
format_stamp: "Formatted at 2026-07-09 12:18:42 on dist-test-slave-6qf7"
I20260709 12:18:42.760425  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:42.787806  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:42.789206  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:42.792785  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:42.800053  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:42.800447  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:42.800937  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:42.801210  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:42.914518  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:35923
I20260709 12:18:42.914608  3262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:35923 every 8 connection(s)
I20260709 12:18:42.921972  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:42.932013  3267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:42.939661  3268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:42.944725  3102 server_base.cc:1061] running on GCE node
W20260709 12:18:42.946173  3270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:42.948216  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:42.948529  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:42.948531  3263 heartbeater.cc:344] Connected to a master server at 127.3.7.190:41401
I20260709 12:18:42.948879  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599522948853 us; error 0 us; skew 500 ppm
I20260709 12:18:42.949129  3263 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:42.949622  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:42.950351  3263 heartbeater.cc:507] Master 127.3.7.190:41401 requested a full tablet report, sending...
I20260709 12:18:42.952872  3102 webserver.cc:533] Webserver started at http://127.3.7.130:46447/ using document root <none> and password file <none>
I20260709 12:18:42.953405  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:42.953644  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:42.953953  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:42.954191  3135 ts_manager.cc:194] Registered new tserver with Master: a333d53b2994457a8080c48175c82406 (127.3.7.129:35923)
I20260709 12:18:42.955133  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "8eccd833e8024a668fe682354e7c90e7"
format_stamp: "Formatted at 2026-07-09 12:18:42 on dist-test-slave-6qf7"
I20260709 12:18:42.957154  3135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49400
I20260709 12:18:42.961272  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:18:42.966254  3275 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:42.967164  3102 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
I20260709 12:18:42.967474  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "8eccd833e8024a668fe682354e7c90e7"
format_stamp: "Formatted at 2026-07-09 12:18:42 on dist-test-slave-6qf7"
I20260709 12:18:42.967748  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:42.986965  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:42.988368  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:42.991016  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:42.994043  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:42.994231  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:42.994547  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:42.994692  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:43.099411  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:40111
I20260709 12:18:43.099637  3337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:40111 every 8 connection(s)
I20260709 12:18:43.107445  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:18:43.122439  3338 heartbeater.cc:344] Connected to a master server at 127.3.7.190:41401
I20260709 12:18:43.122987  3338 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:43.123706  3344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:43.124296  3338 heartbeater.cc:507] Master 127.3.7.190:41401 requested a full tablet report, sending...
W20260709 12:18:43.125882  3341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:43.127437  3135 ts_manager.cc:194] Registered new tserver with Master: 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
W20260709 12:18:43.127851  3342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:43.129484  3135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49404
I20260709 12:18:43.131349  3102 server_base.cc:1061] running on GCE node
I20260709 12:18:43.132248  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:43.132496  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:43.132683  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599523132657 us; error 0 us; skew 500 ppm
I20260709 12:18:43.133204  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:43.136078  3102 webserver.cc:533] Webserver started at http://127.3.7.131:45065/ using document root <none> and password file <none>
I20260709 12:18:43.136566  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:43.136776  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:43.137058  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:43.138252  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "904a6108211b4998874bb358b160feed"
format_stamp: "Formatted at 2026-07-09 12:18:43 on dist-test-slave-6qf7"
I20260709 12:18:43.143064  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:18:43.146611  3349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:43.147562  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:18:43.147861  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "904a6108211b4998874bb358b160feed"
format_stamp: "Formatted at 2026-07-09 12:18:43 on dist-test-slave-6qf7"
I20260709 12:18:43.148159  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:43.165081  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:43.166311  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:43.167692  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:43.171165  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:43.171411  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:18:43.171674  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:43.171868  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:43.268986  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:44583
I20260709 12:18:43.269153  3413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:44583 every 8 connection(s)
I20260709 12:18:43.284664  3414 heartbeater.cc:344] Connected to a master server at 127.3.7.190:41401
I20260709 12:18:43.285050  3414 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:43.285800  3414 heartbeater.cc:507] Master 127.3.7.190:41401 requested a full tablet report, sending...
I20260709 12:18:43.287952  3135 ts_manager.cc:194] Registered new tserver with Master: 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:43.288558  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014681568s
I20260709 12:18:43.289650  3135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49416
I20260709 12:18:43.348141  3135 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49422:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:43.353246  3135 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:43.460976  3303 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4756cab9d443efbef6a12c3b1f3d02 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:43.462723  3303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4756cab9d443efbef6a12c3b1f3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.462739  3378 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4756cab9d443efbef6a12c3b1f3d02 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:43.475775  3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4756cab9d443efbef6a12c3b1f3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.477416  3300 tablet_service.cc:1511] Processing CreateTablet for tablet cca3890205514617ac9e54933ab7f21b (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:43.479146  3377 tablet_service.cc:1511] Processing CreateTablet for tablet bcfa0b0fb0a848bbbbcc017cebc9c5b8 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:43.475167  3299 tablet_service.cc:1511] Processing CreateTablet for tablet ac7dcefb89644bd6ac69edb358e72a7d (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:43.474591  3376 tablet_service.cc:1511] Processing CreateTablet for tablet c0fc068cf696416297f4bd33c6ebfbc5 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:43.481613  3374 tablet_service.cc:1511] Processing CreateTablet for tablet ac7dcefb89644bd6ac69edb358e72a7d (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:43.476027  3301 tablet_service.cc:1511] Processing CreateTablet for tablet c0fc068cf696416297f4bd33c6ebfbc5 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:43.484917  3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fc068cf696416297f4bd33c6ebfbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.484772  3302 tablet_service.cc:1511] Processing CreateTablet for tablet bcfa0b0fb0a848bbbbcc017cebc9c5b8 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:43.487321  3299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7dcefb89644bd6ac69edb358e72a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.487394  3375 tablet_service.cc:1511] Processing CreateTablet for tablet cca3890205514617ac9e54933ab7f21b (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:43.490136  3298 tablet_service.cc:1511] Processing CreateTablet for tablet b5ae634196c9494982a1f2153924a95a (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:43.494621  3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfa0b0fb0a848bbbbcc017cebc9c5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.495584  3300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca3890205514617ac9e54933ab7f21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.499341  3373 tablet_service.cc:1511] Processing CreateTablet for tablet b5ae634196c9494982a1f2153924a95a (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:43.503933  3228 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4756cab9d443efbef6a12c3b1f3d02 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:43.503441  3227 tablet_service.cc:1511] Processing CreateTablet for tablet bcfa0b0fb0a848bbbbcc017cebc9c5b8 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:43.507639  3228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4756cab9d443efbef6a12c3b1f3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.497587  3226 tablet_service.cc:1511] Processing CreateTablet for tablet c0fc068cf696416297f4bd33c6ebfbc5 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:43.509503  3302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfa0b0fb0a848bbbbcc017cebc9c5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.508064  3225 tablet_service.cc:1511] Processing CreateTablet for tablet cca3890205514617ac9e54933ab7f21b (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:43.513819  3374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7dcefb89644bd6ac69edb358e72a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.513096  3224 tablet_service.cc:1511] Processing CreateTablet for tablet ac7dcefb89644bd6ac69edb358e72a7d (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:43.514508  3301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fc068cf696416297f4bd33c6ebfbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.510848  3297 tablet_service.cc:1511] Processing CreateTablet for tablet 928efb77da0247818cdf9d36761c672b (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:43.516007  3222 tablet_service.cc:1511] Processing CreateTablet for tablet 928efb77da0247818cdf9d36761c672b (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:43.518723  3227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfa0b0fb0a848bbbbcc017cebc9c5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.526021  3223 tablet_service.cc:1511] Processing CreateTablet for tablet b5ae634196c9494982a1f2153924a95a (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:43.528394  3225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca3890205514617ac9e54933ab7f21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.525563  3372 tablet_service.cc:1511] Processing CreateTablet for tablet 928efb77da0247818cdf9d36761c672b (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:43.532967  3375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca3890205514617ac9e54933ab7f21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.534046  3373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ae634196c9494982a1f2153924a95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.534235  3223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ae634196c9494982a1f2153924a95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.537038  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928efb77da0247818cdf9d36761c672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.536680  3226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fc068cf696416297f4bd33c6ebfbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.536463  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ae634196c9494982a1f2153924a95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.545228  3297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928efb77da0247818cdf9d36761c672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.557673  3222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 928efb77da0247818cdf9d36761c672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.555243  3221 tablet_service.cc:1511] Processing CreateTablet for tablet 81ebc38b0116445e88ecb5f0ac4cca98 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:43.560525  3296 tablet_service.cc:1511] Processing CreateTablet for tablet 81ebc38b0116445e88ecb5f0ac4cca98 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:43.567341  3296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ebc38b0116445e88ecb5f0ac4cca98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.575546  3371 tablet_service.cc:1511] Processing CreateTablet for tablet 81ebc38b0116445e88ecb5f0ac4cca98 (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:43.577518  3371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ebc38b0116445e88ecb5f0ac4cca98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.584273  3224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7dcefb89644bd6ac69edb358e72a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.588227  3220 tablet_service.cc:1511] Processing CreateTablet for tablet e309e510e9444396b3ccf4c79f58beac (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:43.603850  3220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e309e510e9444396b3ccf4c79f58beac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.608726  3221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ebc38b0116445e88ecb5f0ac4cca98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.626145  3295 tablet_service.cc:1511] Processing CreateTablet for tablet e309e510e9444396b3ccf4c79f58beac (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:43.627552  3295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e309e510e9444396b3ccf4c79f58beac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:43.671013  3183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:43.685848  3370 tablet_service.cc:1511] Processing CreateTablet for tablet e309e510e9444396b3ccf4c79f58beac (DEFAULT_TABLE table=test-workload [id=2a18ec632f604c638568e3b64b73b98c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:43.687218  3370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e309e510e9444396b3ccf4c79f58beac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:43.766141  3432 tablet_bootstrap.cc:492] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:43.797022  3433 tablet_bootstrap.cc:492] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:43.802436  3434 tablet_bootstrap.cc:492] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:43.815236  3432 tablet_bootstrap.cc:654] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.830730  3433 tablet_bootstrap.cc:654] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.837572  3433 tablet_bootstrap.cc:492] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:43.838020  3432 tablet_bootstrap.cc:492] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:43.838115  3433 ts_tablet_manager.cc:1403] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.007s
I20260709 12:18:43.838497  3432 ts_tablet_manager.cc:1403] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.011s
I20260709 12:18:43.838972  3434 tablet_bootstrap.cc:654] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.841578  3432 raft_consensus.cc:359] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.841452  3433 raft_consensus.cc:359] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.842279  3432 raft_consensus.cc:385] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.842406  3433 raft_consensus.cc:385] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.842656  3432 raft_consensus.cc:740] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.842824  3433 raft_consensus.cc:740] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.843619  3432 consensus_queue.cc:260] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.845208  3433 consensus_queue.cc:260] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.852784  3414 heartbeater.cc:499] Master 127.3.7.190:41401 was elected leader, sending a full tablet report...
I20260709 12:18:43.853119  3434 tablet_bootstrap.cc:492] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:43.853583  3434 ts_tablet_manager.cc:1403] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.006s
I20260709 12:18:43.853876  3432 ts_tablet_manager.cc:1434] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.012s
I20260709 12:18:43.854844  3432 tablet_bootstrap.cc:492] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:43.856309  3434 raft_consensus.cc:359] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.857007  3434 raft_consensus.cc:385] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.857287  3434 raft_consensus.cc:740] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.857990  3434 consensus_queue.cc:260] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.861707  3432 tablet_bootstrap.cc:654] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.866456  3263 heartbeater.cc:499] Master 127.3.7.190:41401 was elected leader, sending a full tablet report...
I20260709 12:18:43.867020  3434 ts_tablet_manager.cc:1434] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.008s
I20260709 12:18:43.868098  3434 tablet_bootstrap.cc:492] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:43.873926  3338 heartbeater.cc:499] Master 127.3.7.190:41401 was elected leader, sending a full tablet report...
I20260709 12:18:43.875105  3433 ts_tablet_manager.cc:1434] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:18:43.876133  3433 tablet_bootstrap.cc:492] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:43.877314  3434 tablet_bootstrap.cc:654] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.880630  3432 tablet_bootstrap.cc:492] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:43.881146  3432 ts_tablet_manager.cc:1403] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 12:18:43.884097  3432 raft_consensus.cc:359] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.884824  3432 raft_consensus.cc:385] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.885130  3432 raft_consensus.cc:740] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.886068  3432 consensus_queue.cc:260] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.888482  3432 ts_tablet_manager.cc:1434] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:43.889508  3432 tablet_bootstrap.cc:492] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:43.894462  3433 tablet_bootstrap.cc:654] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.896203  3434 tablet_bootstrap.cc:492] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:43.897435  3432 tablet_bootstrap.cc:654] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.907058  3434 ts_tablet_manager.cc:1403] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.007s
I20260709 12:18:43.910456  3434 raft_consensus.cc:359] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.911159  3434 raft_consensus.cc:385] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.915050  3434 raft_consensus.cc:740] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.916250  3434 consensus_queue.cc:260] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.920060  3434 ts_tablet_manager.cc:1434] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:18:43.922640  3434 tablet_bootstrap.cc:492] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:43.924434  3432 tablet_bootstrap.cc:492] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:43.924909  3432 ts_tablet_manager.cc:1403] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.002s
W20260709 12:18:43.925271  3264 tablet.cc:2406] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:43.928504  3432 raft_consensus.cc:359] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.929953  3432 raft_consensus.cc:385] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.930259  3432 raft_consensus.cc:740] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.931017  3432 consensus_queue.cc:260] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.936641  3432 ts_tablet_manager.cc:1434] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:18:43.937649  3432 tablet_bootstrap.cc:492] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:43.937604  3433 tablet_bootstrap.cc:492] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:43.938269  3433 ts_tablet_manager.cc:1403] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.021s
I20260709 12:18:43.943274  3433 raft_consensus.cc:359] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.944183  3433 raft_consensus.cc:385] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.944682  3432 tablet_bootstrap.cc:654] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.944545  3433 raft_consensus.cc:740] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.945585  3433 consensus_queue.cc:260] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.949683  3433 ts_tablet_manager.cc:1434] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:18:43.950356  3434 tablet_bootstrap.cc:654] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.950860  3433 tablet_bootstrap.cc:492] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:43.956000  3434 tablet_bootstrap.cc:492] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:43.956450  3434 ts_tablet_manager.cc:1403] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.034s	user 0.002s	sys 0.010s
I20260709 12:18:43.959313  3434 raft_consensus.cc:359] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.960031  3434 raft_consensus.cc:385] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.960330  3434 raft_consensus.cc:740] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.961016  3434 consensus_queue.cc:260] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.966447  3434 ts_tablet_manager.cc:1434] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:18:43.967448  3434 tablet_bootstrap.cc:492] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:43.973721  3434 tablet_bootstrap.cc:654] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.979513  3433 tablet_bootstrap.cc:654] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:43.979820  3432 tablet_bootstrap.cc:492] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:43.980420  3432 ts_tablet_manager.cc:1403] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.010s
I20260709 12:18:43.983493  3434 tablet_bootstrap.cc:492] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:43.984064  3434 ts_tablet_manager.cc:1403] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 12:18:43.983515  3432 raft_consensus.cc:359] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.984498  3432 raft_consensus.cc:385] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.984813  3432 raft_consensus.cc:740] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.985534  3432 consensus_queue.cc:260] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.987896  3434 raft_consensus.cc:359] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.988813  3434 raft_consensus.cc:385] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:43.989157  3434 raft_consensus.cc:740] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:43.990386  3432 ts_tablet_manager.cc:1434] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:43.991412  3432 tablet_bootstrap.cc:492] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:43.989924  3434 consensus_queue.cc:260] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:43.994920  3434 ts_tablet_manager.cc:1434] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:18:44.000516  3434 tablet_bootstrap.cc:492] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:44.000700  3432 tablet_bootstrap.cc:654] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.002033  3433 tablet_bootstrap.cc:492] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.002555  3433 ts_tablet_manager.cc:1403] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.009s
I20260709 12:18:44.006120  3433 raft_consensus.cc:359] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.007953  3434 tablet_bootstrap.cc:654] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.013928  3432 tablet_bootstrap.cc:492] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:44.014412  3432 ts_tablet_manager.cc:1403] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 12:18:44.007092  3433 raft_consensus.cc:385] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.017488  3433 raft_consensus.cc:740] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.017242  3432 raft_consensus.cc:359] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.018020  3432 raft_consensus.cc:385] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.018321  3432 raft_consensus.cc:740] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.018321  3433 consensus_queue.cc:260] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.019253  3432 consensus_queue.cc:260] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.021075  3433 ts_tablet_manager.cc:1434] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:18:44.021742  3432 ts_tablet_manager.cc:1434] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:44.022019  3433 tablet_bootstrap.cc:492] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:44.022763  3432 tablet_bootstrap.cc:492] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:44.029770  3432 tablet_bootstrap.cc:654] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.037621  3433 tablet_bootstrap.cc:654] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.019610  3434 tablet_bootstrap.cc:492] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:44.039278  3434 ts_tablet_manager.cc:1403] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.004s
I20260709 12:18:44.042973  3434 raft_consensus.cc:359] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.044080  3434 raft_consensus.cc:385] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.044576  3434 raft_consensus.cc:740] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.046375  3432 tablet_bootstrap.cc:492] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:44.045743  3434 consensus_queue.cc:260] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.046921  3432 ts_tablet_manager.cc:1403] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:18:44.047729  3438 raft_consensus.cc:493] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.048209  3438 raft_consensus.cc:515] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.052677  3440 raft_consensus.cc:493] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.053196  3440 raft_consensus.cc:515] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.053560  3438 leader_election.cc:290] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.056762  3434 ts_tablet_manager.cc:1434] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:18:44.057181  3440 leader_election.cc:290] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.057857  3438 raft_consensus.cc:493] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.057857  3432 raft_consensus.cc:359] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.058413  3438 raft_consensus.cc:515] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.062463  3432 raft_consensus.cc:385] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.062935  3432 raft_consensus.cc:740] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.063766  3433 tablet_bootstrap.cc:492] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.064303  3433 ts_tablet_manager.cc:1403] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.008s
I20260709 12:18:44.063696  3432 consensus_queue.cc:260] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.067978  3438 leader_election.cc:290] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.068934  3434 tablet_bootstrap.cc:492] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:44.075820  3433 raft_consensus.cc:359] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.076790  3433 raft_consensus.cc:385] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.077170  3433 raft_consensus.cc:740] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.078091  3433 consensus_queue.cc:260] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.080325  3434 tablet_bootstrap.cc:654] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.089356  3433 ts_tablet_manager.cc:1434] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 12:18:44.090603  3433 tablet_bootstrap.cc:492] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:44.090466  3438 raft_consensus.cc:493] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.091146  3438 raft_consensus.cc:515] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.110596  3432 ts_tablet_manager.cc:1434] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.024s
I20260709 12:18:44.113215  3432 tablet_bootstrap.cc:492] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:44.113930  3438 leader_election.cc:290] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.120517  3434 tablet_bootstrap.cc:492] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:44.121057  3434 ts_tablet_manager.cc:1403] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.000s
I20260709 12:18:44.130373  3433 tablet_bootstrap.cc:654] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.130733  3434 raft_consensus.cc:359] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.132444  3434 raft_consensus.cc:385] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.135082  3432 tablet_bootstrap.cc:654] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.134956  3434 raft_consensus.cc:740] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.141678  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.139642  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.138602  3434 consensus_queue.cc:260] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.141891  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.148171  3238 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.150878  3434 ts_tablet_manager.cc:1434] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:18:44.152201  3434 tablet_bootstrap.cc:492] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:44.143038  3237 raft_consensus.cc:2468] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.161332  3352 leader_election.cc:304] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.163308  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.165089  3313 raft_consensus.cc:2468] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 0.
I20260709 12:18:44.167812  3438 raft_consensus.cc:2804] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.168116  3201 leader_election.cc:304] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.168381  3438 raft_consensus.cc:493] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.168743  3438 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.169708  3440 raft_consensus.cc:2804] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.170609  3440 raft_consensus.cc:493] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.171173  3440 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:44.187960  3352 leader_election.cc:343] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.188107  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.189328  3311 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.190726  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.191457  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.192799  3350 leader_election.cc:304] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: a333d53b2994457a8080c48175c82406
I20260709 12:18:44.194918  3457 raft_consensus.cc:2804] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.195386  3457 raft_consensus.cc:493] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.195752  3457 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.196241  3433 tablet_bootstrap.cc:492] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.197302  3352 leader_election.cc:304] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.191447  3313 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
W20260709 12:18:44.198632  3350 leader_election.cc:343] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.200011  3433 ts_tablet_manager.cc:1403] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.014s
I20260709 12:18:44.196359  3440 raft_consensus.cc:515] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.195359  3438 raft_consensus.cc:515] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.209942  3440 leader_election.cc:290] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.210213  3433 raft_consensus.cc:359] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.210949  3433 raft_consensus.cc:385] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.210717  3457 raft_consensus.cc:515] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.211838  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.212229  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.211249  3433 raft_consensus.cc:740] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.213601  3237 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.215678  3438 leader_election.cc:290] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.214059  3433 consensus_queue.cc:260] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.215011  3313 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.229959  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.230535  3312 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.229070  3438 raft_consensus.cc:493] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.232633  3438 raft_consensus.cc:515] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.236115  3438 leader_election.cc:290] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.236346  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.236987  3236 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.237200  3466 raft_consensus.cc:2804] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.237675  3466 raft_consensus.cc:493] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.243553  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:44.244872  3432 tablet_bootstrap.cc:492] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:44.245352  3432 ts_tablet_manager.cc:1403] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.132s	user 0.025s	sys 0.022s
I20260709 12:18:44.241930  3440 raft_consensus.cc:493] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.241676  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.246649  3311 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.246404  3440 raft_consensus.cc:515] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.245257  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.244249  3433 ts_tablet_manager.cc:1434] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
W20260709 12:18:44.247804  3201 leader_election.cc:343] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 904a6108211b4998874bb358b160feed (127.3.7.131:44583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.248855  3440 leader_election.cc:290] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.249176  3433 tablet_bootstrap.cc:492] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:44.241586  3457 leader_election.cc:290] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.240550  3466 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.251827  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
W20260709 12:18:44.254783  3201 leader_election.cc:343] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 904a6108211b4998874bb358b160feed (127.3.7.131:44583): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:44.255686  3201 leader_election.cc:343] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.255836  3237 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.256485  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.257203  3312 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.257345  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.257894  3310 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.242587  3352 leader_election.cc:304] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.260840  3434 tablet_bootstrap.cc:654] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.263396  3457 raft_consensus.cc:2804] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.263779  3457 raft_consensus.cc:493] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.264093  3457 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.269191  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.269999  3352 leader_election.cc:304] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.270844  3438 raft_consensus.cc:2804] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.274873  3438 raft_consensus.cc:697] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:44.275192  3432 raft_consensus.cc:359] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.276186  3432 raft_consensus.cc:385] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.276523  3432 raft_consensus.cc:740] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.276307  3438 consensus_queue.cc:237] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.277316  3432 consensus_queue.cc:260] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.278347  3389 raft_consensus.cc:2468] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 0.
W20260709 12:18:44.279831  3352 leader_election.cc:343] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.284523  3310 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.285950  3201 leader_election.cc:304] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:44.290293  3440 raft_consensus.cc:2804] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.290824  3440 raft_consensus.cc:493] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.291709  3440 raft_consensus.cc:3060] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.292795  3350 leader_election.cc:304] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: a333d53b2994457a8080c48175c82406
I20260709 12:18:44.299216  3433 tablet_bootstrap.cc:654] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.291433  3457 raft_consensus.cc:515] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.304926  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.305724  3237 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.310449  3313 raft_consensus.cc:2468] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 1.
I20260709 12:18:44.312001  3457 leader_election.cc:290] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.324126  3201 leader_election.cc:304] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 904a6108211b4998874bb358b160feed
I20260709 12:18:44.324173  3457 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.328953  3467 raft_consensus.cc:493] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.330140  3440 raft_consensus.cc:515] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.328179  3457 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.331607  3469 raft_consensus.cc:2804] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.312736  3466 raft_consensus.cc:515] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.330438  3467 raft_consensus.cc:515] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.349681  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.349840  3469 raft_consensus.cc:697] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:44.350309  3313 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.353112  3467 leader_election.cc:290] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.356034  3434 tablet_bootstrap.cc:492] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:44.355093  3135 catalog_manager.cc:5697] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 0 to 1, leader changed from <none> to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 1 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.355958  3457 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.357187  3440 leader_election.cc:290] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.351364  3469 consensus_queue.cc:237] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.357873  3432 ts_tablet_manager.cc:1434] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.112s	user 0.018s	sys 0.030s
I20260709 12:18:44.363531  3440 raft_consensus.cc:2804] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.358075  3434 ts_tablet_manager.cc:1403] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.206s	user 0.006s	sys 0.013s
I20260709 12:18:44.353955  3237 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.364578  3440 raft_consensus.cc:697] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:44.368036  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.372670  3475 raft_consensus.cc:493] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.373207  3475 raft_consensus.cc:515] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.374089  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.358763  3466 leader_election.cc:290] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.367578  3434 raft_consensus.cc:359] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.373381  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.377964  3439 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.378124  3432 tablet_bootstrap.cc:492] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:44.378520  3439 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.377549  3434 raft_consensus.cc:385] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:18:44.379446  3201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:40111, user_credentials={real_user=slave}} blocked reactor thread for 55413.8us
I20260709 12:18:44.383992  3434 raft_consensus.cc:740] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.387851  3312 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.389389  3434 consensus_queue.cc:260] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
W20260709 12:18:44.384383  3350 leader_election.cc:343] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.388468  3440 consensus_queue.cc:237] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.398793  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.396185  3439 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.406863  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:44.407460  3389 raft_consensus.cc:3060] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:44.414060  3201 leader_election.cc:343] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.415088  3352 leader_election.cc:304] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.416128  3466 raft_consensus.cc:2804] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.416400  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.416611  3466 raft_consensus.cc:697] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:44.417573  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.417444  3466 consensus_queue.cc:237] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.418625  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.419148  3238 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:44.400931  3350 leader_election.cc:343] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.427433  3313 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.427520  3350 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:44.428566  3389 raft_consensus.cc:2468] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 1.
I20260709 12:18:44.429386  3433 tablet_bootstrap.cc:492] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.429652  3475 leader_election.cc:290] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.429873  3433 ts_tablet_manager.cc:1403] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.025s
I20260709 12:18:44.430601  3457 raft_consensus.cc:2804] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.430985  3457 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.431337  3457 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.431910  3201 leader_election.cc:304] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:44.432317  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
W20260709 12:18:44.432789  3352 leader_election.cc:343] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.433197  3352 leader_election.cc:304] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 904a6108211b4998874bb358b160feed; no voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406
W20260709 12:18:44.434259  3352 leader_election.cc:343] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.434353  3467 raft_consensus.cc:2749] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.435765  3475 raft_consensus.cc:2804] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.451534  3434 ts_tablet_manager.cc:1434] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.012s
I20260709 12:18:44.452657  3434 tablet_bootstrap.cc:492] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:44.444672  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
W20260709 12:18:44.453014  3201 leader_election.cc:343] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 904a6108211b4998874bb358b160feed (127.3.7.131:44583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.449551  3475 raft_consensus.cc:697] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:44.465143  3475 consensus_queue.cc:237] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.474303  3432 tablet_bootstrap.cc:654] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:44.469790  3201 leader_election.cc:343] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.475093  3238 raft_consensus.cc:2468] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.482185  3201 leader_election.cc:304] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a333d53b2994457a8080c48175c82406; no voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed
I20260709 12:18:44.479262  3433 raft_consensus.cc:359] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.487409  3433 raft_consensus.cc:385] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.487741  3433 raft_consensus.cc:740] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.477691  3457 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.489871  3352 leader_election.cc:304] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:44.490461  3457 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.491034  3457 raft_consensus.cc:2804] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.492161  3440 raft_consensus.cc:2749] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.493597  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.494172  3313 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.496716  3135 catalog_manager.cc:5697] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 0 to 1, leader changed from <none> to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.499873  3457 raft_consensus.cc:697] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:44.504704  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.500789  3433 consensus_queue.cc:260] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
W20260709 12:18:44.507985  3352 leader_election.cc:343] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.510905  3457 consensus_queue.cc:237] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.511695  3433 ts_tablet_manager.cc:1434] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.082s	user 0.002s	sys 0.007s
I20260709 12:18:44.513223  3475 raft_consensus.cc:493] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.512666  3433 tablet_bootstrap.cc:492] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:44.513479  3439 raft_consensus.cc:493] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.519652  3475 raft_consensus.cc:515] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.525734  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.522361  3439 raft_consensus.cc:515] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.526961  3312 raft_consensus.cc:2393] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a333d53b2994457a8080c48175c82406 in current term 1: Already voted for candidate 904a6108211b4998874bb358b160feed in this term.
I20260709 12:18:44.530200  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.531855  3439 leader_election.cc:290] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
W20260709 12:18:44.534132  3278 leader_election.cc:343] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:44.535633  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.542016  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.535897  3475 leader_election.cc:290] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.540465  3132 catalog_manager.cc:5697] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 0 to 1, leader changed from <none> to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 1 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.546201  3238 raft_consensus.cc:2393] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8eccd833e8024a668fe682354e7c90e7 in current term 1: Already voted for candidate 904a6108211b4998874bb358b160feed in this term.
I20260709 12:18:44.544848  3201 leader_election.cc:304] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a333d53b2994457a8080c48175c82406; no voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed
I20260709 12:18:44.547340  3432 tablet_bootstrap.cc:492] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:44.547225  3313 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.548403  3432 ts_tablet_manager.cc:1403] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.173s	user 0.018s	sys 0.006s
I20260709 12:18:44.548847  3475 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.548632  3350 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: a333d53b2994457a8080c48175c82406
I20260709 12:18:44.552688  3457 raft_consensus.cc:2804] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.550061  3132 catalog_manager.cc:5697] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 0 to 1, leader changed from <none> to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 1 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.553256  3434 tablet_bootstrap.cc:654] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.553679  3432 raft_consensus.cc:359] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.554418  3432 raft_consensus.cc:385] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.554723  3432 raft_consensus.cc:740] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.554520  3457 raft_consensus.cc:697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:44.556128  3432 consensus_queue.cc:260] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.558447  3432 ts_tablet_manager.cc:1434] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:18:44.559617  3432 tablet_bootstrap.cc:492] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: Bootstrap starting.
I20260709 12:18:44.558557  3457 consensus_queue.cc:237] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.564280  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.565374  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.569516  3276 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7; no voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406
I20260709 12:18:44.572466  3434 tablet_bootstrap.cc:492] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:44.572947  3434 ts_tablet_manager.cc:1403] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.005s
I20260709 12:18:44.573889  3439 raft_consensus.cc:2749] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.574203  3276 leader_election.cc:304] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7; no voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406
I20260709 12:18:44.578423  3475 raft_consensus.cc:2749] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.580268  3133 catalog_manager.cc:5697] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 0 to 1, leader changed from <none> to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.587213  3439 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.589340  3434 raft_consensus.cc:359] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.590005  3434 raft_consensus.cc:385] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.590181  3434 raft_consensus.cc:740] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.589375  3433 tablet_bootstrap.cc:654] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.590624  3434 consensus_queue.cc:260] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.594494  3434 ts_tablet_manager.cc:1434] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:18:44.595407  3434 tablet_bootstrap.cc:492] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406: Bootstrap starting.
I20260709 12:18:44.598275  3432 tablet_bootstrap.cc:654] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.601143  3434 tablet_bootstrap.cc:654] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.613829  3439 raft_consensus.cc:2749] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.620570  3132 catalog_manager.cc:5697] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 0 to 1, leader changed from <none> to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 1 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.623353  3132 catalog_manager.cc:5697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 0 to 1, leader changed from <none> to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 1 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.625433  3457 raft_consensus.cc:493] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.625916  3457 raft_consensus.cc:515] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.628012  3457 leader_election.cc:290] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.630470  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.632479  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.633643  3313 raft_consensus.cc:2393] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 904a6108211b4998874bb358b160feed in current term 1: Already voted for candidate a333d53b2994457a8080c48175c82406 in this term.
I20260709 12:18:44.636436  3350 leader_election.cc:304] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 904a6108211b4998874bb358b160feed; no voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406
I20260709 12:18:44.637642  3457 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.640472  3432 tablet_bootstrap.cc:492] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: No bootstrap required, opened a new log
I20260709 12:18:44.641120  3432 ts_tablet_manager.cc:1403] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.006s
I20260709 12:18:44.645179  3432 raft_consensus.cc:359] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.646180  3432 raft_consensus.cc:385] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.646522  3432 raft_consensus.cc:740] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.646584  3457 raft_consensus.cc:2749] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.650259  3434 tablet_bootstrap.cc:492] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406: No bootstrap required, opened a new log
I20260709 12:18:44.650717  3434 ts_tablet_manager.cc:1403] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.012s
I20260709 12:18:44.653213  3434 raft_consensus.cc:359] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.653837  3434 raft_consensus.cc:385] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.654086  3434 raft_consensus.cc:740] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.655146  3433 tablet_bootstrap.cc:492] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.650734  3432 consensus_queue.cc:260] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.655555  3434 consensus_queue.cc:260] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.657110  3432 ts_tablet_manager.cc:1434] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:18:44.658375  3433 ts_tablet_manager.cc:1403] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.146s	user 0.035s	sys 0.030s
I20260709 12:18:44.661406  3433 raft_consensus.cc:359] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.662060  3433 raft_consensus.cc:385] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.662345  3433 raft_consensus.cc:740] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.663040  3433 consensus_queue.cc:260] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.665001  3433 ts_tablet_manager.cc:1434] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:18:44.665798  3433 tablet_bootstrap.cc:492] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:44.668529  3434 ts_tablet_manager.cc:1434] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
W20260709 12:18:44.679010  3183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:44.680363  3433 tablet_bootstrap.cc:654] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.684834  3433 tablet_bootstrap.cc:492] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.685389  3433 ts_tablet_manager.cc:1403] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:18:44.687453  3433 raft_consensus.cc:359] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.687976  3433 raft_consensus.cc:385] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.688225  3433 raft_consensus.cc:740] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.688867  3433 consensus_queue.cc:260] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.690629  3433 ts_tablet_manager.cc:1434] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:44.691442  3433 tablet_bootstrap.cc:492] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: Bootstrap starting.
I20260709 12:18:44.695370  3457 consensus_queue.cc:1048] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.697753  3433 tablet_bootstrap.cc:654] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:44.705781  3433 tablet_bootstrap.cc:492] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: No bootstrap required, opened a new log
I20260709 12:18:44.706261  3433 ts_tablet_manager.cc:1403] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:18:44.709208  3433 raft_consensus.cc:359] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.709944  3433 raft_consensus.cc:385] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:44.710345  3433 raft_consensus.cc:740] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Initialized, Role: FOLLOWER
I20260709 12:18:44.711344  3433 consensus_queue.cc:260] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.714128  3433 ts_tablet_manager.cc:1434] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:18:44.728504  3439 raft_consensus.cc:493] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.729085  3439 raft_consensus.cc:515] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.731477  3439 leader_election.cc:290] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.733780  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.736558  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.737375  3388 raft_consensus.cc:2393] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8eccd833e8024a668fe682354e7c90e7 in current term 1: Already voted for candidate a333d53b2994457a8080c48175c82406 in this term.
I20260709 12:18:44.739032  3276 leader_election.cc:304] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7; no voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406
I20260709 12:18:44.759183  3475 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.759757  3475 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.763353  3475 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.764426  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.765239  3313 raft_consensus.cc:2393] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a333d53b2994457a8080c48175c82406 in current term 1: Already voted for candidate 904a6108211b4998874bb358b160feed in this term.
I20260709 12:18:44.767097  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.769572  3201 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a333d53b2994457a8080c48175c82406; no voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed
I20260709 12:18:44.770347  3466 consensus_queue.cc:1048] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.771822  3439 raft_consensus.cc:3060] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.772152  3475 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.779870  3475 raft_consensus.cc:2749] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.781306  3439 raft_consensus.cc:2749] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:44.824023  3466 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.836845  3468 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.877321  3468 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.878664  3475 consensus_queue.cc:1048] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.894012  3475 consensus_queue.cc:1048] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.895927  3469 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:44.940212  3468 raft_consensus.cc:493] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.940690  3468 raft_consensus.cc:515] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.942656  3468 leader_election.cc:290] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.943414  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.943971  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7" is_pre_election: true
I20260709 12:18:44.944060  3238 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.944566  3312 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 0.
I20260709 12:18:44.945290  3352 leader_election.cc:304] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.946058  3468 raft_consensus.cc:2804] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.946378  3468 raft_consensus.cc:493] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.946666  3468 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.951833  3468 raft_consensus.cc:515] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.953421  3468 leader_election.cc:290] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:44.954380  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.954531  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:44.954980  3238 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.959347  3238 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.954982  3312 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.960320  3352 leader_election.cc:304] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.961012  3468 raft_consensus.cc:2804] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.961503  3468 raft_consensus.cc:697] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:44.962478  3468 consensus_queue.cc:237] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.965886  3312 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 1.
I20260709 12:18:44.966904  3439 raft_consensus.cc:493] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.967988  3439 raft_consensus.cc:515] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.970006  3439 leader_election.cc:290] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.970723  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406" is_pre_election: true
I20260709 12:18:44.971439  3238 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 0.
I20260709 12:18:44.971616  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed" is_pre_election: true
I20260709 12:18:44.972254  3388 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 0.
I20260709 12:18:44.971393  3134 catalog_manager.cc:5697] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 0 to 1, leader changed from <none> to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 1 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.972831  3278 leader_election.cc:304] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.973666  3439 raft_consensus.cc:2804] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:44.974016  3439 raft_consensus.cc:493] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.974370  3439 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.980774  3439 raft_consensus.cc:515] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:44.983104  3439 leader_election.cc:290] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:44.983400  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:44.983728  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:44.984362  3238 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.984467  3388 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:44.989003  3238 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 1.
I20260709 12:18:44.990058  3278 leader_election.cc:304] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:44.990792  3439 raft_consensus.cc:2804] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:44.990904  3388 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 1.
I20260709 12:18:44.991264  3439 raft_consensus.cc:697] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:44.992060  3439 consensus_queue.cc:237] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.000641  3134 catalog_manager.cc:5697] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.026592  3468 consensus_queue.cc:1048] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.041693  3467 consensus_queue.cc:1048] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.042296  3440 consensus_queue.cc:1048] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.048462  3440 consensus_queue.cc:1048] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.077167  3467 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.101485  3467 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:45.273794  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:45.274591  3388 raft_consensus.cc:606] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:18:45.280356  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:45.281015  3388 raft_consensus.cc:606] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:18:45.286572  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:45.287287  3388 raft_consensus.cc:606] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:18:45.292738  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:45.293391  3388 raft_consensus.cc:606] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:18:45.315096  3238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d"
dest_uuid: "a333d53b2994457a8080c48175c82406"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:59506
I20260709 12:18:45.315682  3238 raft_consensus.cc:606] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:45.320932  3468 raft_consensus.cc:993] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.321452  3466 raft_consensus.cc:1081] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.323377  3238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59500
I20260709 12:18:45.323982  3238 raft_consensus.cc:493] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.324352  3238 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.324931  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "928efb77da0247818cdf9d36761c672b"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:45.325570  3388 raft_consensus.cc:606] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:45.331090  3238 raft_consensus.cc:515] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.333431  3238 leader_election.cc:290] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.334685  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:45.335078  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.335290  3313 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.335654  3388 raft_consensus.cc:3055] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.335973  3388 raft_consensus.cc:740] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.336771  3388 consensus_queue.cc:260] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.337181  3389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:45.337824  3389 raft_consensus.cc:606] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:45.338024  3388 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.342077  3313 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.343248  3201 leader_election.cc:304] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:45.344087  3475 raft_consensus.cc:2804] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.344584  3475 raft_consensus.cc:697] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:45.345192  3238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac"
dest_uuid: "a333d53b2994457a8080c48175c82406"
mode: GRACEFUL
new_leader_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:59506
I20260709 12:18:45.345799  3238 raft_consensus.cc:606] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Received request to transfer leadership to TS 904a6108211b4998874bb358b160feed
I20260709 12:18:45.345450  3475 consensus_queue.cc:237] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.349392  3388 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.354878  3133 catalog_manager.cc:5697] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 1 to 2, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.363957  3466 consensus_queue.cc:1048] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.381479  3467 consensus_queue.cc:1048] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.390132  3467 raft_consensus.cc:993] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:45.390614  3468 raft_consensus.cc:1081] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:45.392120  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "928efb77da0247818cdf9d36761c672b"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51680
I20260709 12:18:45.392652  3313 raft_consensus.cc:493] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.392983  3313 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.397696  3313 raft_consensus.cc:515] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.400020  3313 leader_election.cc:290] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 2 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.400964  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:45.401574  3238 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.401965  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.402530  3388 raft_consensus.cc:3055] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.402853  3388 raft_consensus.cc:740] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.403643  3388 consensus_queue.cc:260] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.404878  3388 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.408255  3238 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 2.
I20260709 12:18:45.409497  3278 leader_election.cc:304] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:45.410312  3439 raft_consensus.cc:2804] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.410846  3439 raft_consensus.cc:697] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:45.411384  3388 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 2.
I20260709 12:18:45.411763  3439 consensus_queue.cc:237] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.419538  3133 catalog_manager.cc:5697] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 1 to 2, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.422067  3457 raft_consensus.cc:993] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.422519  3468 raft_consensus.cc:1081] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.424017  3238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59500
I20260709 12:18:45.424481  3238 raft_consensus.cc:493] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.424800  3238 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.429683  3238 raft_consensus.cc:515] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.431509  3238 leader_election.cc:290] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.432319  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:45.432883  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.432978  3313 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.433410  3388 raft_consensus.cc:3055] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.433699  3388 raft_consensus.cc:740] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.434391  3388 consensus_queue.cc:260] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.435256  3388 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.439996  3388 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.440179  3313 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.441169  3201 leader_election.cc:304] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:45.441880  3475 raft_consensus.cc:2804] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.442350  3475 raft_consensus.cc:697] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:45.443142  3475 consensus_queue.cc:237] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.453054  3133 catalog_manager.cc:5697] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 1 to 2, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.471050  3440 raft_consensus.cc:993] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:45.472016  3477 raft_consensus.cc:1081] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:45.475729  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51688
I20260709 12:18:45.476491  3313 raft_consensus.cc:493] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.477118  3313 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.483808  3440 raft_consensus.cc:993] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: : Instructing follower 904a6108211b4998874bb358b160feed to start an election
I20260709 12:18:45.483673  3313 raft_consensus.cc:515] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.484295  3520 raft_consensus.cc:1081] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Signalling peer 904a6108211b4998874bb358b160feed to start an election
I20260709 12:18:45.486069  3388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac"
dest_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:36388
I20260709 12:18:45.486621  3388 raft_consensus.cc:493] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.486896  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:45.487071  3313 leader_election.cc:290] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 2 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.487252  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.487603  3238 raft_consensus.cc:3055] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.487920  3389 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.488018  3238 raft_consensus.cc:740] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:45.488974  3238 consensus_queue.cc:260] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.490005  3238 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.491591  3388 raft_consensus.cc:3060] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.494460  3389 raft_consensus.cc:2468] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 2.
I20260709 12:18:45.495630  3276 leader_election.cc:304] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:45.496464  3439 raft_consensus.cc:2804] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.496928  3439 raft_consensus.cc:697] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:45.497144  3238 raft_consensus.cc:2468] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 2.
I20260709 12:18:45.497728  3439 consensus_queue.cc:237] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.499325  3388 raft_consensus.cc:515] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.502947  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:45.503206  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e309e510e9444396b3ccf4c79f58beac" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:45.503788  3313 raft_consensus.cc:3060] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.503756  3238 raft_consensus.cc:3055] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.504402  3238 raft_consensus.cc:740] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:45.505465  3238 consensus_queue.cc:260] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.505780  3133 catalog_manager.cc:5697] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 1 to 2, leader changed from a333d53b2994457a8080c48175c82406 (127.3.7.129) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.506685  3238 raft_consensus.cc:3060] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.510346  3313 raft_consensus.cc:2468] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 2.
I20260709 12:18:45.512068  3350 leader_election.cc:304] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:45.513543  3468 raft_consensus.cc:2804] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.514093  3468 raft_consensus.cc:697] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.514514  3238 raft_consensus.cc:2468] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 2.
I20260709 12:18:45.515033  3468 consensus_queue.cc:237] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.520915  3388 leader_election.cc:290] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 2 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:45.521600  3439 consensus_queue.cc:1048] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.525625  3133 catalog_manager.cc:5697] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 1 to 2, leader changed from a333d53b2994457a8080c48175c82406 (127.3.7.129) to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 2 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:45.535989  3498 consensus_queue.cc:1048] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:45.609140  3467 raft_consensus.cc:993] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.609581  3467 raft_consensus.cc:1081] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.611188  3238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59500
I20260709 12:18:45.611835  3238 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.612216  3238 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.613504  3467 raft_consensus.cc:993] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.613937  3468 raft_consensus.cc:1081] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:18:45.615558  3236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59500
I20260709 12:18:45.616104  3236 raft_consensus.cc:493] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.616472  3236 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.618619  3238 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.620821  3238 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.621580  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:45.622169  3313 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.623219  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.623927  3388 raft_consensus.cc:3055] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.623689  3236 raft_consensus.cc:515] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.624305  3388 raft_consensus.cc:740] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.625298  3388 consensus_queue.cc:260] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.626650  3388 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.626796  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:45.627556  3312 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.627553  3236 leader_election.cc:290] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.631706  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.632540  3389 raft_consensus.cc:3055] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.632939  3389 raft_consensus.cc:740] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.634264  3388 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.633808  3389 consensus_queue.cc:260] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.635563  3389 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.635893  3201 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:45.636883  3520 raft_consensus.cc:2804] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.637373  3520 raft_consensus.cc:697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:45.638211  3520 consensus_queue.cc:237] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.638912  3312 raft_consensus.cc:2468] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.643443  3313 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.643395  3201 leader_election.cc:304] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:45.643839  3389 raft_consensus.cc:2468] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 2.
I20260709 12:18:45.644948  3520 raft_consensus.cc:2804] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.646021  3520 raft_consensus.cc:697] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:45.646945  3520 consensus_queue.cc:237] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.649248  3133 catalog_manager.cc:5697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 1 to 2, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.664186  3133 catalog_manager.cc:5697] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 1 to 2, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.710752  3467 raft_consensus.cc:993] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:45.711205  3468 raft_consensus.cc:1081] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:45.712811  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51680
I20260709 12:18:45.713289  3313 raft_consensus.cc:493] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.713603  3313 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.718385  3313 raft_consensus.cc:515] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.720278  3313 leader_election.cc:290] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 2 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:45.721091  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:45.721621  3389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:45.721689  3236 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.722086  3389 raft_consensus.cc:3055] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:45.722318  3389 raft_consensus.cc:740] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:45.723057  3389 consensus_queue.cc:260] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.724035  3389 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:45.728466  3389 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 2.
I20260709 12:18:45.728446  3236 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 2.
I20260709 12:18:45.729743  3276 leader_election.cc:304] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:45.730723  3522 raft_consensus.cc:2804] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:45.731173  3522 raft_consensus.cc:697] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:45.732060  3522 consensus_queue.cc:237] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:45.739019  3133 catalog_manager.cc:5697] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 1 to 2, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:45.829053  3313 raft_consensus.cc:1275] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.830327  3520 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.838487  3389 raft_consensus.cc:1275] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.841073  3440 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.871389  3389 raft_consensus.cc:1275] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.872092  3388 raft_consensus.cc:1275] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.872712  3440 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.873535  3522 consensus_queue.cc:1048] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.883853  3313 raft_consensus.cc:1275] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.885237  3440 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.890637  3236 raft_consensus.cc:1275] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.897074  3439 consensus_queue.cc:1048] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.942008  3236 raft_consensus.cc:1275] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.943509  3468 consensus_queue.cc:1048] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.952244  3313 raft_consensus.cc:1275] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.953759  3467 consensus_queue.cc:1048] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.975215  3236 raft_consensus.cc:1275] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.976855  3525 consensus_queue.cc:1048] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:45.986193  3389 raft_consensus.cc:1275] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:45.987993  3522 consensus_queue.cc:1048] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:46.133874  3313 raft_consensus.cc:1275] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.135215  3440 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:46.143953  3389 raft_consensus.cc:1275] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.145840  3475 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:46.167543  3389 raft_consensus.cc:1275] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.169257  3475 consensus_queue.cc:1048] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:46.178188  3313 raft_consensus.cc:1275] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.180353  3477 consensus_queue.cc:1048] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:46.217535  3236 raft_consensus.cc:1275] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.219065  3498 consensus_queue.cc:1048] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:46.228648  3389 raft_consensus.cc:1275] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:46.230244  3498 consensus_queue.cc:1048] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:48.380548  3102 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:18:48.381651  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:48.405696  3236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02"
dest_uuid: "a333d53b2994457a8080c48175c82406"
mode: GRACEFUL
new_leader_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:59522
I20260709 12:18:48.406354  3236 raft_consensus.cc:606] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Received request to transfer leadership to TS 904a6108211b4998874bb358b160feed
I20260709 12:18:48.419694  3313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
mode: GRACEFUL
new_leader_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:51692
I20260709 12:18:48.420399  3313 raft_consensus.cc:606] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 LEADER]: Received request to transfer leadership to TS 904a6108211b4998874bb358b160feed
I20260709 12:18:48.422188  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:48.422777  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:48.483752  3439 raft_consensus.cc:993] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: : Instructing follower 904a6108211b4998874bb358b160feed to start an election
I20260709 12:18:48.484289  3539 raft_consensus.cc:1081] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 LEADER]: Signalling peer 904a6108211b4998874bb358b160feed to start an election
I20260709 12:18:48.486061  3389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a"
dest_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:36398
I20260709 12:18:48.486727  3389 raft_consensus.cc:493] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:48.487340  3389 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:48.493362  3389 raft_consensus.cc:515] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:48.495352  3389 leader_election.cc:290] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 2 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:48.496416  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:48.496472  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:48.497200  3236 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:48.497458  3313 raft_consensus.cc:3055] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:48.497831  3313 raft_consensus.cc:740] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:48.498634  3313 consensus_queue.cc:260] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:48.499620  3313 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:48.502637  3236 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 2.
I20260709 12:18:48.503764  3352 leader_election.cc:304] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:48.503978  3313 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 2.
I20260709 12:18:48.504527  3534 raft_consensus.cc:2804] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:48.505921  3534 raft_consensus.cc:697] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:48.506616  3534 consensus_queue.cc:237] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:48.513725  3133 catalog_manager.cc:5697] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 1 to 2, leader changed from 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130) to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 2 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.624074  3520 raft_consensus.cc:993] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: : Instructing follower 904a6108211b4998874bb358b160feed to start an election
I20260709 12:18:48.624534  3520 raft_consensus.cc:1081] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Signalling peer 904a6108211b4998874bb358b160feed to start an election
I20260709 12:18:48.625988  3389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02"
dest_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:36388
I20260709 12:18:48.626411  3389 raft_consensus.cc:493] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:48.626663  3389 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:48.631422  3389 raft_consensus.cc:515] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:48.633157  3389 leader_election.cc:290] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:18:48.634225  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:48.634416  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:18:48.634899  3236 raft_consensus.cc:3055] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:48.634948  3313 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:48.635376  3236 raft_consensus.cc:740] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:48.636224  3236 consensus_queue.cc:260] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:48.637260  3236 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:48.639461  3313 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 3.
I20260709 12:18:48.640594  3350 leader_election.cc:304] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:48.641288  3534 raft_consensus.cc:2804] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:48.641696  3534 raft_consensus.cc:697] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:48.642467  3534 consensus_queue.cc:237] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:48.643354  3236 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 3.
I20260709 12:18:48.649338  3133 catalog_manager.cc:5697] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 2 to 3, leader changed from a333d53b2994457a8080c48175c82406 (127.3.7.129) to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 3 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.890738  3313 raft_consensus.cc:1275] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:48.892226  3534 consensus_queue.cc:1048] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:48.903573  3236 raft_consensus.cc:1275] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:48.905405  3540 consensus_queue.cc:1048] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:49.080570  3236 raft_consensus.cc:1275] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:49.082103  3550 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:49.091060  3313 raft_consensus.cc:1275] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:49.092939  3534 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:49.423983  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:49.429415  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:49.429804  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:50.430730  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:50.435794  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:50.436198  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:51.437809  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.444998  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:51.445724  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:52.447342  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:52.452826  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:52.453184  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:53.454144  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:53.459972  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:53.460382  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:54.461388  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.466174  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:54.466492  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:55.467433  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.472306  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:55.472645  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:56.473495  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.478209  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:56.478580  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:57.479622  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.485246  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:57.485736  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.511758  3102 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:18:58.516129  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:58.516754  3388 raft_consensus.cc:606] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:58.521569  3236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8"
dest_uuid: "a333d53b2994457a8080c48175c82406"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:59506
I20260709 12:18:58.522017  3236 raft_consensus.cc:606] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:58.526773  3236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5"
dest_uuid: "a333d53b2994457a8080c48175c82406"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:59506
I20260709 12:18:58.527204  3236 raft_consensus.cc:606] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:58.531672  3236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b"
dest_uuid: "a333d53b2994457a8080c48175c82406"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:59506
I20260709 12:18:58.532176  3236 raft_consensus.cc:606] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:58.538991  3388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a"
dest_uuid: "904a6108211b4998874bb358b160feed"
mode: GRACEFUL
new_leader_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:36414
I20260709 12:18:58.539583  3388 raft_consensus.cc:606] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Received request to transfer leadership to TS 8eccd833e8024a668fe682354e7c90e7
I20260709 12:18:58.588323  3558 raft_consensus.cc:993] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.588851  3563 raft_consensus.cc:1081] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.590270  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51680
I20260709 12:18:58.590756  3313 raft_consensus.cc:493] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.591115  3313 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.595942  3313 raft_consensus.cc:515] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.597608  3313 leader_election.cc:290] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:58.598630  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:58.598608  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ae634196c9494982a1f2153924a95a" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:58.599561  3236 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.599545  3388 raft_consensus.cc:3055] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:58.600055  3388 raft_consensus.cc:740] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:58.600983  3388 consensus_queue.cc:260] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.602298  3388 raft_consensus.cc:3060] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.606670  3236 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.608124  3278 leader_election.cc:304] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:58.609084  3539 raft_consensus.cc:2804] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:58.609455  3388 raft_consensus.cc:2468] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.610126  3539 raft_consensus.cc:697] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:58.611253  3539 consensus_queue.cc:237] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.617977  3133 catalog_manager.cc:5697] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 2 to 3, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.693573  3558 raft_consensus.cc:993] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.694084  3563 raft_consensus.cc:1081] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.695464  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51680
I20260709 12:18:58.695938  3313 raft_consensus.cc:493] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.696266  3313 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:58.700148  3313 raft_consensus.cc:515] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.701676  3313 leader_election.cc:290] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 4 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:58.702422  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:58.702641  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4756cab9d443efbef6a12c3b1f3d02" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:58.702898  3236 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:58.703204  3388 raft_consensus.cc:3055] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:58.703505  3388 raft_consensus.cc:740] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:18:58.704203  3388 consensus_queue.cc:260] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.705041  3388 raft_consensus.cc:3060] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:58.707007  3236 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 4.
I20260709 12:18:58.707952  3278 leader_election.cc:304] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:18:58.708846  3564 raft_consensus.cc:2804] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:58.709333  3564 raft_consensus.cc:697] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 4 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:58.709477  3388 raft_consensus.cc:2468] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 4.
I20260709 12:18:58.710273  3564 consensus_queue.cc:237] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.716898  3133 catalog_manager.cc:5697] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 3 to 4, leader changed from 904a6108211b4998874bb358b160feed (127.3.7.131) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.763628  3562 raft_consensus.cc:993] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.764077  3562 raft_consensus.cc:1081] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.765470  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51688
I20260709 12:18:58.765939  3313 raft_consensus.cc:493] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.766225  3313 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.770249  3313 raft_consensus.cc:515] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.771718  3313 leader_election.cc:290] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:58.772545  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:58.773032  3236 raft_consensus.cc:3055] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:58.772950  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fc068cf696416297f4bd33c6ebfbc5" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:58.773329  3236 raft_consensus.cc:740] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:58.773555  3388 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.774017  3236 consensus_queue.cc:260] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.774864  3236 raft_consensus.cc:3060] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.778038  3388 raft_consensus.cc:2468] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.778676  3236 raft_consensus.cc:2468] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.779117  3276 leader_election.cc:304] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:58.780006  3564 raft_consensus.cc:2804] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:58.780485  3564 raft_consensus.cc:697] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:58.781250  3564 consensus_queue.cc:237] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.788055  3133 catalog_manager.cc:5697] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 2 to 3, leader changed from a333d53b2994457a8080c48175c82406 (127.3.7.129) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.870404  3571 raft_consensus.cc:993] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.870820  3562 raft_consensus.cc:1081] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.872279  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51688
I20260709 12:18:58.872745  3313 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.873036  3313 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.876890  3313 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.878396  3313 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:58.879163  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:58.879427  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:58.879739  3236 raft_consensus.cc:3055] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:58.879894  3388 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.880056  3236 raft_consensus.cc:740] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:58.880764  3236 consensus_queue.cc:260] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.881611  3236 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.883900  3388 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.884735  3276 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:58.885416  3564 raft_consensus.cc:2804] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:58.885432  3236 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.885871  3564 raft_consensus.cc:697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:58.886659  3564 consensus_queue.cc:237] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.889868  3571 raft_consensus.cc:993] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: : Instructing follower 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.890340  3562 raft_consensus.cc:1081] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Signalling peer 8eccd833e8024a668fe682354e7c90e7 to start an election
I20260709 12:18:58.891973  3313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
 from {username='slave'} at 127.0.0.1:51688
I20260709 12:18:58.892342  3313 raft_consensus.cc:493] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.892680  3313 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.894078  3133 catalog_manager.cc:5697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 2 to 3, leader changed from a333d53b2994457a8080c48175c82406 (127.3.7.129) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.897864  3313 raft_consensus.cc:515] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.899367  3313 leader_election.cc:290] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:18:58.900321  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:18:58.901036  3388 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.902597  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "8eccd833e8024a668fe682354e7c90e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:18:58.903106  3236 raft_consensus.cc:3055] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:58.903432  3236 raft_consensus.cc:740] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:18:58.904059  3236 consensus_queue.cc:260] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.904932  3236 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:58.905682  3388 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.906494  3276 leader_election.cc:304] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8eccd833e8024a668fe682354e7c90e7, 904a6108211b4998874bb358b160feed; no voters: 
I20260709 12:18:58.907156  3564 raft_consensus.cc:2804] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:58.907568  3564 raft_consensus.cc:697] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Becoming Leader. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:18:58.908370  3564 consensus_queue.cc:237] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:18:58.909158  3236 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eccd833e8024a668fe682354e7c90e7 in term 3.
I20260709 12:18:58.914376  3133 catalog_manager.cc:5697] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 reported cstate change: term changed from 2 to 3, leader changed from a333d53b2994457a8080c48175c82406 (127.3.7.129) to 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "8eccd833e8024a668fe682354e7c90e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.050129  3236 raft_consensus.cc:1275] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.051268  3564 consensus_queue.cc:1048] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.061352  3388 raft_consensus.cc:1275] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.063850  3564 consensus_queue.cc:1048] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:59.157727  3388 raft_consensus.cc:1275] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:59.158859  3564 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:59.170755  3236 raft_consensus.cc:1275] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:59.172016  3539 consensus_queue.cc:1048] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:59.331472  3236 raft_consensus.cc:1275] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.332660  3539 consensus_queue.cc:1048] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.341112  3388 raft_consensus.cc:1275] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.342595  3581 consensus_queue.cc:1048] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.386493  3236 raft_consensus.cc:1275] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.387687  3581 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.395812  3388 raft_consensus.cc:1275] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.398844  3581 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.469326  3236 raft_consensus.cc:1275] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.470496  3581 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:59.478477  3388 raft_consensus.cc:1275] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Refusing update from remote peer 8eccd833e8024a668fe682354e7c90e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:59.479835  3581 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.580793  3102 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:19:01.581656  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:01.588644  3313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
mode: GRACEFUL
new_leader_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:51692
I20260709 12:19:01.589429  3313 raft_consensus.cc:606] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Received request to transfer leadership to TS 904a6108211b4998874bb358b160feed
I20260709 12:19:01.592389  3313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "928efb77da0247818cdf9d36761c672b"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:51692
I20260709 12:19:01.592891  3313 raft_consensus.cc:606] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:19:01.595467  3313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
mode: GRACEFUL
new_leader_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:51692
I20260709 12:19:01.595908  3313 raft_consensus.cc:606] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Received request to transfer leadership to TS 904a6108211b4998874bb358b160feed
I20260709 12:19:01.598263  3313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:51692
I20260709 12:19:01.598702  3313 raft_consensus.cc:606] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:19:01.600845  3313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b"
dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
mode: GRACEFUL
new_leader_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:51692
I20260709 12:19:01.601315  3313 raft_consensus.cc:606] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Received request to transfer leadership to TS a333d53b2994457a8080c48175c82406
I20260709 12:19:01.602566  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:01.603183  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:01.605818  3539 raft_consensus.cc:993] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: : Instructing follower 904a6108211b4998874bb358b160feed to start an election
I20260709 12:19:01.606374  3590 raft_consensus.cc:1081] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Signalling peer 904a6108211b4998874bb358b160feed to start an election
I20260709 12:19:01.608479  3388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d"
dest_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:36398
I20260709 12:19:01.609102  3388 raft_consensus.cc:493] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.609615  3388 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.610652  3590 raft_consensus.cc:993] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:19:01.611089  3590 raft_consensus.cc:1081] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:19:01.612609  3236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59502
I20260709 12:19:01.613026  3236 raft_consensus.cc:493] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.613284  3236 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.616119  3388 raft_consensus.cc:515] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.617825  3236 raft_consensus.cc:515] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.618661  3388 leader_election.cc:290] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:19:01.619989  3313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:19:01.620033  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7dcefb89644bd6ac69edb358e72a7d" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:19:01.621003  3236 leader_election.cc:290] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 4 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:19:01.621003  3313 raft_consensus.cc:3055] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:01.621444  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:19:01.621737  3313 raft_consensus.cc:740] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:19:01.622113  3312 raft_consensus.cc:3055] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:01.622480  3312 raft_consensus.cc:740] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:19:01.622946  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcfa0b0fb0a848bbbbcc017cebc9c5b8" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:19:01.621121  3238 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.622713  3313 consensus_queue.cc:260] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.623502  3388 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.623353  3312 consensus_queue.cc:260] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.624282  3313 raft_consensus.cc:3060] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.624763  3312 raft_consensus.cc:3060] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.630389  3388 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 4.
I20260709 12:19:01.630769  3238 raft_consensus.cc:2468] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 3.
I20260709 12:19:01.631376  3313 raft_consensus.cc:2468] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 3.
I20260709 12:19:01.631922  3312 raft_consensus.cc:2468] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 4.
I20260709 12:19:01.632494  3352 leader_election.cc:304] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:19:01.632511  3201 leader_election.cc:304] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:19:01.633594  3563 raft_consensus.cc:2804] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:01.634661  3591 raft_consensus.cc:2804] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:01.634752  3563 raft_consensus.cc:697] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:19:01.635987  3591 raft_consensus.cc:697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 4 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:19:01.635903  3563 consensus_queue.cc:237] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.636977  3591 consensus_queue.cc:237] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.645066  3132 catalog_manager.cc:5697] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 2 to 3, leader changed from 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130) to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 3 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.646857  3133 catalog_manager.cc:5697] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 3 to 4, leader changed from 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 4 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.841439  3539 raft_consensus.cc:993] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:19:01.841856  3539 raft_consensus.cc:1081] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:19:01.843429  3238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "928efb77da0247818cdf9d36761c672b"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59502
I20260709 12:19:01.843984  3238 raft_consensus.cc:493] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.844363  3238 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.850772  3238 raft_consensus.cc:515] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.852602  3238 leader_election.cc:290] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 3 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:19:01.853356  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:19:01.853519  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "928efb77da0247818cdf9d36761c672b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:19:01.853869  3312 raft_consensus.cc:3055] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:01.854038  3388 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.854192  3312 raft_consensus.cc:740] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:19:01.854947  3312 consensus_queue.cc:260] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.855912  3312 raft_consensus.cc:3060] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.858280  3388 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 3.
I20260709 12:19:01.859148  3201 leader_election.cc:304] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:19:01.859803  3591 raft_consensus.cc:2804] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:01.860174  3591 raft_consensus.cc:697] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 3 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:19:01.860723  3312 raft_consensus.cc:2468] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 3.
I20260709 12:19:01.860975  3591 consensus_queue.cc:237] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.868360  3133 catalog_manager.cc:5697] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 2 to 3, leader changed from 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 3 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:01.950627  3539 raft_consensus.cc:993] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: : Instructing follower a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:19:01.951069  3539 raft_consensus.cc:1081] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Signalling peer a333d53b2994457a8080c48175c82406 to start an election
I20260709 12:19:01.952378  3238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b"
dest_uuid: "a333d53b2994457a8080c48175c82406"
 from {username='slave'} at 127.0.0.1:59502
I20260709 12:19:01.952808  3238 raft_consensus.cc:493] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.953066  3238 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.957229  3238 raft_consensus.cc:515] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.958559  3238 leader_election.cc:290] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 4 election: Requested vote from peers 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111), 904a6108211b4998874bb358b160feed (127.3.7.131:44583)
I20260709 12:19:01.959501  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:19:01.959703  3388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca3890205514617ac9e54933ab7f21b" candidate_uuid: "a333d53b2994457a8080c48175c82406" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "904a6108211b4998874bb358b160feed"
I20260709 12:19:01.960103  3312 raft_consensus.cc:3055] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:01.960206  3388 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.960498  3312 raft_consensus.cc:740] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:19:01.961330  3312 consensus_queue.cc:260] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.962621  3312 raft_consensus.cc:3060] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:01.966784  3388 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 4.
I20260709 12:19:01.967978  3201 leader_election.cc:304] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:19:01.968904  3591 raft_consensus.cc:2804] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:01.969214  3312 raft_consensus.cc:2468] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a333d53b2994457a8080c48175c82406 in term 4.
I20260709 12:19:01.969488  3591 raft_consensus.cc:697] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 4 LEADER]: Becoming Leader. State: Replica: a333d53b2994457a8080c48175c82406, State: Running, Role: LEADER
I20260709 12:19:01.970799  3591 consensus_queue.cc:237] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:01.978477  3133 catalog_manager.cc:5697] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 reported cstate change: term changed from 3 to 4, leader changed from 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130) to a333d53b2994457a8080c48175c82406 (127.3.7.129). New cstate: current_term: 4 leader_uuid: "a333d53b2994457a8080c48175c82406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:02.046975  3590 raft_consensus.cc:993] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: : Instructing follower 904a6108211b4998874bb358b160feed to start an election
I20260709 12:19:02.047508  3590 raft_consensus.cc:1081] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Signalling peer 904a6108211b4998874bb358b160feed to start an election
I20260709 12:19:02.048921  3388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98"
dest_uuid: "904a6108211b4998874bb358b160feed"
 from {username='slave'} at 127.0.0.1:36398
I20260709 12:19:02.049342  3388 raft_consensus.cc:493] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.049608  3388 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.053685  3388 raft_consensus.cc:515] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:02.055244  3388 leader_election.cc:290] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 3 election: Requested vote from peers a333d53b2994457a8080c48175c82406 (127.3.7.129:35923), 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111)
I20260709 12:19:02.056001  3238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a333d53b2994457a8080c48175c82406"
I20260709 12:19:02.056347  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ebc38b0116445e88ecb5f0ac4cca98" candidate_uuid: "904a6108211b4998874bb358b160feed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8eccd833e8024a668fe682354e7c90e7"
I20260709 12:19:02.056556  3238 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.056886  3312 raft_consensus.cc:3055] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:02.057144  3312 raft_consensus.cc:740] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8eccd833e8024a668fe682354e7c90e7, State: Running, Role: LEADER
I20260709 12:19:02.057763  3312 consensus_queue.cc:260] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:02.058619  3312 raft_consensus.cc:3060] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:02.060943  3238 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 3.
I20260709 12:19:02.062024  3352 leader_election.cc:304] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 904a6108211b4998874bb358b160feed, a333d53b2994457a8080c48175c82406; no voters: 
I20260709 12:19:02.062813  3563 raft_consensus.cc:2804] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:02.063228  3563 raft_consensus.cc:697] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Becoming Leader. State: Replica: 904a6108211b4998874bb358b160feed, State: Running, Role: LEADER
I20260709 12:19:02.063596  3312 raft_consensus.cc:2468] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 904a6108211b4998874bb358b160feed in term 3.
I20260709 12:19:02.064061  3563 consensus_queue.cc:237] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } }
I20260709 12:19:02.071024  3133 catalog_manager.cc:5697] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed reported cstate change: term changed from 2 to 3, leader changed from 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130) to 904a6108211b4998874bb358b160feed (127.3.7.131). New cstate: current_term: 3 leader_uuid: "904a6108211b4998874bb358b160feed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:02.091578  3238 raft_consensus.cc:1275] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.092765  3563 consensus_queue.cc:1048] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:02.103775  3312 raft_consensus.cc:1275] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.105944  3592 consensus_queue.cc:1048] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:02.117518  3313 raft_consensus.cc:1275] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:02.118871  3591 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:02.128116  3388 raft_consensus.cc:1275] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:02.130133  3611 consensus_queue.cc:1048] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:02.393055  3388 raft_consensus.cc:1275] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.394232  3611 consensus_queue.cc:1048] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:02.402546  3313 raft_consensus.cc:1275] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.404335  3593 consensus_queue.cc:1048] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:02.463599  3313 raft_consensus.cc:1275] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.464761  3606 consensus_queue.cc:1048] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:02.473824  3238 raft_consensus.cc:1275] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Refusing update from remote peer 904a6108211b4998874bb358b160feed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:02.474908  3606 consensus_queue.cc:1048] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a333d53b2994457a8080c48175c82406" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:02.505479  3388 raft_consensus.cc:1275] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:02.506592  3593 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "904a6108211b4998874bb358b160feed" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 44583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:02.515220  3313 raft_consensus.cc:1275] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Refusing update from remote peer a333d53b2994457a8080c48175c82406: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:02.516599  3611 consensus_queue.cc:1048] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eccd833e8024a668fe682354e7c90e7" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:02.604607  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.610025  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:02.610495  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:03.611776  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.617405  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:03.617877  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.618856  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.623621  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:04.624027  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.625065  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.629962  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:05.630388  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:06.631474  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.636929  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:06.637430  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.638497  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.643770  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:07.644217  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:08.645483  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.651041  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:08.651484  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.652525  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.657497  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:09.657929  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.659214  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.665275  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:10.665722  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:11.695055  3102 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:19:11.695739  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
I20260709 12:19:11.720513  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.721361  3102 tablet_replica.cc:333] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.722582  3102 raft_consensus.cc:2243] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.723841  3102 raft_consensus.cc:2272] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.726095  3102 tablet_replica.cc:333] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.726614  3102 raft_consensus.cc:2243] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.727020  3102 raft_consensus.cc:2272] T 1a4756cab9d443efbef6a12c3b1f3d02 P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.728729  3102 tablet_replica.cc:333] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.729216  3102 raft_consensus.cc:2243] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.729586  3102 raft_consensus.cc:2272] T b5ae634196c9494982a1f2153924a95a P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.731093  3102 tablet_replica.cc:333] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.731619  3102 raft_consensus.cc:2243] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.731992  3102 raft_consensus.cc:2272] T 81ebc38b0116445e88ecb5f0ac4cca98 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.733474  3102 tablet_replica.cc:333] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.733875  3102 raft_consensus.cc:2243] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.734607  3102 raft_consensus.cc:2272] T 928efb77da0247818cdf9d36761c672b P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.736228  3102 tablet_replica.cc:333] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.736665  3102 raft_consensus.cc:2243] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.737311  3102 raft_consensus.cc:2272] T cca3890205514617ac9e54933ab7f21b P a333d53b2994457a8080c48175c82406 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.738873  3102 tablet_replica.cc:333] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.739351  3102 raft_consensus.cc:2243] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.739729  3102 raft_consensus.cc:2272] T c0fc068cf696416297f4bd33c6ebfbc5 P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.741256  3102 tablet_replica.cc:333] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.741657  3102 raft_consensus.cc:2243] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.742025  3102 raft_consensus.cc:2272] T ac7dcefb89644bd6ac69edb358e72a7d P a333d53b2994457a8080c48175c82406 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.743692  3102 tablet_replica.cc:333] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406: stopping tablet replica
I20260709 12:19:11.744138  3102 raft_consensus.cc:2243] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.744586  3102 raft_consensus.cc:2272] T e309e510e9444396b3ccf4c79f58beac P a333d53b2994457a8080c48175c82406 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.831029  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
I20260709 12:19:11.849462  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
I20260709 12:19:11.874496  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.875275  3102 tablet_replica.cc:333] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.875993  3102 raft_consensus.cc:2243] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.876506  3102 raft_consensus.cc:2272] T 928efb77da0247818cdf9d36761c672b P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.878350  3102 tablet_replica.cc:333] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.878872  3102 raft_consensus.cc:2243] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.879709  3102 raft_consensus.cc:2272] T c0fc068cf696416297f4bd33c6ebfbc5 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.881321  3102 tablet_replica.cc:333] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.882045  3102 raft_consensus.cc:2243] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.882587  3102 raft_consensus.cc:2272] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.884590  3102 tablet_replica.cc:333] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.885140  3102 raft_consensus.cc:2243] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:19:11.885313  3352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:35923: connect: Connection refused (error 111)
I20260709 12:19:11.886287  3102 raft_consensus.cc:2272] T b5ae634196c9494982a1f2153924a95a P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.889333  3102 tablet_replica.cc:333] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
W20260709 12:19:11.889561  3352 consensus_peers.cc:597] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed -> Peer a333d53b2994457a8080c48175c82406 (127.3.7.129:35923): Couldn't send request to peer a333d53b2994457a8080c48175c82406. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:35923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.890301  3102 raft_consensus.cc:2243] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.890874  3102 raft_consensus.cc:2272] T 81ebc38b0116445e88ecb5f0ac4cca98 P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.893062  3102 tablet_replica.cc:333] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.893558  3102 raft_consensus.cc:2243] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.894330  3102 raft_consensus.cc:2272] T 1a4756cab9d443efbef6a12c3b1f3d02 P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.895972  3102 tablet_replica.cc:333] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.896390  3102 raft_consensus.cc:2243] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.896723  3102 raft_consensus.cc:2272] T e309e510e9444396b3ccf4c79f58beac P 8eccd833e8024a668fe682354e7c90e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.898188  3102 tablet_replica.cc:333] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.898591  3102 raft_consensus.cc:2243] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.898941  3102 raft_consensus.cc:2272] T ac7dcefb89644bd6ac69edb358e72a7d P 8eccd833e8024a668fe682354e7c90e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.900568  3102 tablet_replica.cc:333] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7: stopping tablet replica
I20260709 12:19:11.900956  3102 raft_consensus.cc:2243] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.901285  3102 raft_consensus.cc:2272] T cca3890205514617ac9e54933ab7f21b P 8eccd833e8024a668fe682354e7c90e7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.905642  3350 consensus_peers.cc:597] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed -> Peer 8eccd833e8024a668fe682354e7c90e7 (127.3.7.130:40111): Couldn't send request to peer 8eccd833e8024a668fe682354e7c90e7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.929847  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
I20260709 12:19:11.950413  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
I20260709 12:19:11.979069  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.979846  3102 tablet_replica.cc:333] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.980449  3102 raft_consensus.cc:2243] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.980962  3102 raft_consensus.cc:2272] T 928efb77da0247818cdf9d36761c672b P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.982816  3102 tablet_replica.cc:333] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.983392  3102 raft_consensus.cc:2243] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.984160  3102 raft_consensus.cc:2272] T ac7dcefb89644bd6ac69edb358e72a7d P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.985739  3102 tablet_replica.cc:333] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.986294  3102 raft_consensus.cc:2243] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.986966  3102 raft_consensus.cc:2272] T e309e510e9444396b3ccf4c79f58beac P 904a6108211b4998874bb358b160feed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.988606  3102 tablet_replica.cc:333] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.989068  3102 raft_consensus.cc:2243] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.989467  3102 raft_consensus.cc:2272] T cca3890205514617ac9e54933ab7f21b P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.990933  3102 tablet_replica.cc:333] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.991423  3102 raft_consensus.cc:2243] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.991809  3102 raft_consensus.cc:2272] T bcfa0b0fb0a848bbbbcc017cebc9c5b8 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.993363  3102 tablet_replica.cc:333] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.993795  3102 raft_consensus.cc:2243] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.994148  3102 raft_consensus.cc:2272] T b5ae634196c9494982a1f2153924a95a P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.995707  3102 tablet_replica.cc:333] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.996137  3102 raft_consensus.cc:2243] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.996846  3102 raft_consensus.cc:2272] T 81ebc38b0116445e88ecb5f0ac4cca98 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.998386  3102 tablet_replica.cc:333] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:11.998792  3102 raft_consensus.cc:2243] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.999132  3102 raft_consensus.cc:2272] T 1a4756cab9d443efbef6a12c3b1f3d02 P 904a6108211b4998874bb358b160feed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.000696  3102 tablet_replica.cc:333] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed: stopping tablet replica
I20260709 12:19:12.001070  3102 raft_consensus.cc:2243] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:12.001444  3102 raft_consensus.cc:2272] T c0fc068cf696416297f4bd33c6ebfbc5 P 904a6108211b4998874bb358b160feed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.029707  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
I20260709 12:19:12.048065  3102 master.cc:562] Master@127.3.7.190:41401 shutting down...
I20260709 12:19:12.189298  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:12.189985  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.190330  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4fe6cab6e7a3494f9e7268a911b1687c: stopping tablet replica
I20260709 12:19:12.210101  3102 master.cc:584] Master@127.3.7.190:41401 shutdown complete.
8eccd833e8024a668fe682354e7c90e7  4
904a6108211b4998874bb358b160feed  1
a333d53b2994457a8080c48175c82406  4
8eccd833e8024a668fe682354e7c90e7  3
904a6108211b4998874bb358b160feed  3
a333d53b2994457a8080c48175c82406  3
8eccd833e8024a668fe682354e7c90e7  8
904a6108211b4998874bb358b160feed  1
a333d53b2994457a8080c48175c82406  0
8eccd833e8024a668fe682354e7c90e7  3
904a6108211b4998874bb358b160feed  3
a333d53b2994457a8080c48175c82406  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31104 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:19:12.251432  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:32981
I20260709 12:19:12.252549  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:12.258253  3631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:12.258862  3632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.259382  3102 server_base.cc:1061] running on GCE node
W20260709 12:19:12.259440  3634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.260565  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:12.260747  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:12.260861  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599552260851 us; error 0 us; skew 500 ppm
I20260709 12:19:12.261379  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:12.263698  3102 webserver.cc:533] Webserver started at http://127.3.7.190:43075/ using document root <none> and password file <none>
I20260709 12:19:12.264140  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:12.264289  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:12.264496  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:12.265549  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "5ce67fd0ee2e42389644ea2b3a527be7"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.269722  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:19:12.273200  3639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.273993  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:19:12.274296  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "5ce67fd0ee2e42389644ea2b3a527be7"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.274585  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:12.291225  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:12.292553  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:12.330605  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:32981
I20260709 12:19:12.330703  3691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:32981 every 8 connection(s)
I20260709 12:19:12.334683  3692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.343968  3692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7: Bootstrap starting.
I20260709 12:19:12.348785  3692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:12.353302  3692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7: No bootstrap required, opened a new log
I20260709 12:19:12.355544  3692 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" member_type: VOTER }
I20260709 12:19:12.355973  3692 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:12.356261  3692 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ce67fd0ee2e42389644ea2b3a527be7, State: Initialized, Role: FOLLOWER
I20260709 12:19:12.356820  3692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" member_type: VOTER }
I20260709 12:19:12.357293  3692 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:12.357510  3692 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:12.357772  3692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:12.362112  3692 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" member_type: VOTER }
I20260709 12:19:12.362653  3692 leader_election.cc:304] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ce67fd0ee2e42389644ea2b3a527be7; no voters: 
I20260709 12:19:12.363852  3692 leader_election.cc:290] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:12.364283  3695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:12.365499  3695 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 1 LEADER]: Becoming Leader. State: Replica: 5ce67fd0ee2e42389644ea2b3a527be7, State: Running, Role: LEADER
I20260709 12:19:12.366164  3695 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" member_type: VOTER }
I20260709 12:19:12.366832  3692 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:12.370810  3696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" member_type: VOTER } }
I20260709 12:19:12.370929  3697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ce67fd0ee2e42389644ea2b3a527be7. Latest consensus state: current_term: 1 leader_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ce67fd0ee2e42389644ea2b3a527be7" member_type: VOTER } }
I20260709 12:19:12.371667  3696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:12.371747  3697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:12.375480  3702 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:12.380801  3702 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:12.384053  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:12.389705  3702 catalog_manager.cc:1383] Generated new cluster ID: fc78b4d711ec4e7489dd9e0b80cc3365
I20260709 12:19:12.390005  3702 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:12.407168  3702 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:12.408396  3702 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:12.421774  3702 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7: Generated new TSK 0
I20260709 12:19:12.422478  3702 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:12.450726  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:12.456877  3713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:12.457283  3714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.460522  3102 server_base.cc:1061] running on GCE node
W20260709 12:19:12.460654  3716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.461678  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:12.461863  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:12.461985  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599552461975 us; error 0 us; skew 500 ppm
I20260709 12:19:12.462491  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:12.464785  3102 webserver.cc:533] Webserver started at http://127.3.7.129:38745/ using document root <none> and password file <none>
I20260709 12:19:12.465222  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:12.465387  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:12.465605  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:12.466638  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.471258  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:19:12.474407  3721 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.475147  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:12.475469  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.475759  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:12.487254  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:12.488531  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:12.489931  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:12.492465  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:12.492642  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.492945  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:12.493114  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.533761  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:40631
I20260709 12:19:12.533958  3783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:40631 every 8 connection(s)
I20260709 12:19:12.538661  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:12.545181  3788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:12.547921  3789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.552312  3102 server_base.cc:1061] running on GCE node
W20260709 12:19:12.552855  3791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.553673  3784 heartbeater.cc:344] Connected to a master server at 127.3.7.190:32981
I20260709 12:19:12.554256  3784 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:12.554571  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:12.554804  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:12.555017  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599552554994 us; error 0 us; skew 500 ppm
I20260709 12:19:12.555086  3784 heartbeater.cc:507] Master 127.3.7.190:32981 requested a full tablet report, sending...
I20260709 12:19:12.555656  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:12.557514  3656 ts_manager.cc:194] Registered new tserver with Master: ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631)
I20260709 12:19:12.558640  3102 webserver.cc:533] Webserver started at http://127.3.7.130:37691/ using document root <none> and password file <none>
I20260709 12:19:12.559317  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:12.559556  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:12.559847  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:12.560006  3656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35068
I20260709 12:19:12.561429  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.566004  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:19:12.569293  3796 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.570078  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:19:12.570359  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.570619  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:12.595820  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:12.597102  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:12.598608  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:12.600926  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:12.601152  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.601425  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:12.601616  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.641630  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:33239
I20260709 12:19:12.641772  3859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:33239 every 8 connection(s)
I20260709 12:19:12.646265  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:12.653488  3863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:12.655369  3864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:12.659211  3866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:12.659469  3102 server_base.cc:1061] running on GCE node
I20260709 12:19:12.659574  3860 heartbeater.cc:344] Connected to a master server at 127.3.7.190:32981
I20260709 12:19:12.660151  3860 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:12.660938  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:12.661250  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:12.661240  3860 heartbeater.cc:507] Master 127.3.7.190:32981 requested a full tablet report, sending...
I20260709 12:19:12.661646  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599552661622 us; error 0 us; skew 500 ppm
I20260709 12:19:12.662503  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:12.663942  3656 ts_manager.cc:194] Registered new tserver with Master: 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:12.665419  3102 webserver.cc:533] Webserver started at http://127.3.7.131:35631/ using document root <none> and password file <none>
I20260709 12:19:12.665524  3656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35076
I20260709 12:19:12.666019  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:12.666270  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:12.666644  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:12.667948  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "33cbf294014c4ca68c6c734bfa199528"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.672911  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:12.676327  3871 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.677243  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:12.677583  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "33cbf294014c4ca68c6c734bfa199528"
format_stamp: "Formatted at 2026-07-09 12:19:12 on dist-test-slave-6qf7"
I20260709 12:19:12.678035  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:12.698630  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:12.700071  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:12.701694  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:12.704128  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:12.704389  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.704659  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:12.704862  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:12.747979  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:34675
I20260709 12:19:12.748050  3933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:34675 every 8 connection(s)
I20260709 12:19:12.762192  3934 heartbeater.cc:344] Connected to a master server at 127.3.7.190:32981
I20260709 12:19:12.762598  3934 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:12.763454  3934 heartbeater.cc:507] Master 127.3.7.190:32981 requested a full tablet report, sending...
I20260709 12:19:12.765432  3656 ts_manager.cc:194] Registered new tserver with Master: 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:12.766273  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014626243s
I20260709 12:19:12.767470  3656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35086
I20260709 12:19:12.796716  3656 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35096:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:12.799646  3656 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:12.869616  3749 tablet_service.cc:1511] Processing CreateTablet for tablet f069ca0004f14127a2fdc22c83309afb (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:12.871762  3749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f069ca0004f14127a2fdc22c83309afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.874157  3748 tablet_service.cc:1511] Processing CreateTablet for tablet d0b430ac3b724958a4bab6ec93f1e072 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:12.876377  3748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b430ac3b724958a4bab6ec93f1e072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.880954  3747 tablet_service.cc:1511] Processing CreateTablet for tablet fb2d81fe0bca44cfb6061b5406113e74 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:12.882328  3747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2d81fe0bca44cfb6061b5406113e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.886122  3746 tablet_service.cc:1511] Processing CreateTablet for tablet 9480d6d5004349f493257180b9dca416 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:12.887383  3746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9480d6d5004349f493257180b9dca416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.893216  3824 tablet_service.cc:1511] Processing CreateTablet for tablet f069ca0004f14127a2fdc22c83309afb (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:12.894580  3824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f069ca0004f14127a2fdc22c83309afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.895820  3745 tablet_service.cc:1511] Processing CreateTablet for tablet 2101615869fc4b94b4a1422a57277ae9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:12.897202  3745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2101615869fc4b94b4a1422a57277ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.898238  3823 tablet_service.cc:1511] Processing CreateTablet for tablet d0b430ac3b724958a4bab6ec93f1e072 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:12.899554  3823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b430ac3b724958a4bab6ec93f1e072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.905179  3744 tablet_service.cc:1511] Processing CreateTablet for tablet b0bbaa925fbc460fa76bae4616b9a951 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:12.905257  3822 tablet_service.cc:1511] Processing CreateTablet for tablet fb2d81fe0bca44cfb6061b5406113e74 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:12.906668  3744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bbaa925fbc460fa76bae4616b9a951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.906692  3822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2d81fe0bca44cfb6061b5406113e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.916884  3743 tablet_service.cc:1511] Processing CreateTablet for tablet 9a32525d311d4dda9aac5066bd68d0d9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:12.918282  3743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a32525d311d4dda9aac5066bd68d0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.919145  3821 tablet_service.cc:1511] Processing CreateTablet for tablet 9480d6d5004349f493257180b9dca416 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:12.920538  3821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9480d6d5004349f493257180b9dca416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.924546  3820 tablet_service.cc:1511] Processing CreateTablet for tablet 2101615869fc4b94b4a1422a57277ae9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:12.926182  3820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2101615869fc4b94b4a1422a57277ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.928287  3746 tablet_service.cc:1511] Processing CreateTablet for tablet 156a9f83969749be9bc1f71dbd9e6fc9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:12.928381  3818 tablet_service.cc:1511] Processing CreateTablet for tablet 9a32525d311d4dda9aac5066bd68d0d9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:12.931028  3818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a32525d311d4dda9aac5066bd68d0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.930928  3819 tablet_service.cc:1511] Processing CreateTablet for tablet b0bbaa925fbc460fa76bae4616b9a951 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:12.932178  3819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bbaa925fbc460fa76bae4616b9a951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.958015  3949 tablet_bootstrap.cc:492] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:12.961501  3817 tablet_service.cc:1511] Processing CreateTablet for tablet 156a9f83969749be9bc1f71dbd9e6fc9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:12.964022  3817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156a9f83969749be9bc1f71dbd9e6fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.964389  3950 tablet_bootstrap.cc:492] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:12.968724  3747 tablet_service.cc:1511] Processing CreateTablet for tablet 79b7a8c074924c329c762aa48c096780 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:12.970711  3898 tablet_service.cc:1511] Processing CreateTablet for tablet d0b430ac3b724958a4bab6ec93f1e072 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:12.969444  3896 tablet_service.cc:1511] Processing CreateTablet for tablet 9480d6d5004349f493257180b9dca416 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:12.972303  3898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b430ac3b724958a4bab6ec93f1e072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.973366  3897 tablet_service.cc:1511] Processing CreateTablet for tablet fb2d81fe0bca44cfb6061b5406113e74 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:12.974001  3816 tablet_service.cc:1511] Processing CreateTablet for tablet 79b7a8c074924c329c762aa48c096780 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:12.974895  3897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2d81fe0bca44cfb6061b5406113e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.975937  3816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b7a8c074924c329c762aa48c096780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.977351  3896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9480d6d5004349f493257180b9dca416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.979110  3744 tablet_service.cc:1511] Processing CreateTablet for tablet 952845377b324f77a8f9f02fdbb998bc (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:12.981053  3899 tablet_service.cc:1511] Processing CreateTablet for tablet f069ca0004f14127a2fdc22c83309afb (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:12.983952  3899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f069ca0004f14127a2fdc22c83309afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:12.963383  3746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156a9f83969749be9bc1f71dbd9e6fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.002884  3744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952845377b324f77a8f9f02fdbb998bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.003616  3747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b7a8c074924c329c762aa48c096780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.009057  3895 tablet_service.cc:1511] Processing CreateTablet for tablet 2101615869fc4b94b4a1422a57277ae9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:13.010438  3895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2101615869fc4b94b4a1422a57277ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.012483  3894 tablet_service.cc:1511] Processing CreateTablet for tablet b0bbaa925fbc460fa76bae4616b9a951 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:13.013487  3949 tablet_bootstrap.cc:654] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.013806  3894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0bbaa925fbc460fa76bae4616b9a951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.016546  3893 tablet_service.cc:1511] Processing CreateTablet for tablet 9a32525d311d4dda9aac5066bd68d0d9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:13.017892  3893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a32525d311d4dda9aac5066bd68d0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.022914  3818 tablet_service.cc:1511] Processing CreateTablet for tablet 952845377b324f77a8f9f02fdbb998bc (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:13.024149  3818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952845377b324f77a8f9f02fdbb998bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.024501  3892 tablet_service.cc:1511] Processing CreateTablet for tablet 156a9f83969749be9bc1f71dbd9e6fc9 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:13.025791  3892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156a9f83969749be9bc1f71dbd9e6fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.033329  3891 tablet_service.cc:1511] Processing CreateTablet for tablet 79b7a8c074924c329c762aa48c096780 (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:13.035651  3891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b7a8c074924c329c762aa48c096780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.077852  3890 tablet_service.cc:1511] Processing CreateTablet for tablet 952845377b324f77a8f9f02fdbb998bc (DEFAULT_TABLE table=test-workload [id=071c941e9c194a88889022a42bed5d2b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:13.079525  3890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952845377b324f77a8f9f02fdbb998bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:13.079931  3950 tablet_bootstrap.cc:654] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.095459  3951 tablet_bootstrap.cc:492] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.096927  3949 tablet_bootstrap.cc:492] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.097409  3949 ts_tablet_manager.cc:1403] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.024s
I20260709 12:19:13.100381  3949 raft_consensus.cc:359] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.101078  3949 raft_consensus.cc:385] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.101362  3949 raft_consensus.cc:740] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.102056  3949 consensus_queue.cc:260] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.107646  3951 tablet_bootstrap.cc:654] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.145390  3950 tablet_bootstrap.cc:492] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.145869  3950 ts_tablet_manager.cc:1403] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.182s	user 0.022s	sys 0.023s
I20260709 12:19:13.148255  3950 raft_consensus.cc:359] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.148842  3950 raft_consensus.cc:385] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.149119  3950 raft_consensus.cc:740] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.149820  3950 consensus_queue.cc:260] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.151332  3784 heartbeater.cc:499] Master 127.3.7.190:32981 was elected leader, sending a full tablet report...
I20260709 12:19:13.153301  3949 ts_tablet_manager.cc:1434] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.016s
I20260709 12:19:13.154641  3949 tablet_bootstrap.cc:492] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.155361  3860 heartbeater.cc:499] Master 127.3.7.190:32981 was elected leader, sending a full tablet report...
I20260709 12:19:13.155855  3950 ts_tablet_manager.cc:1434] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.001s
I20260709 12:19:13.156805  3950 tablet_bootstrap.cc:492] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.157328  3951 tablet_bootstrap.cc:492] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.157785  3951 ts_tablet_manager.cc:1403] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.021s
I20260709 12:19:13.161114  3951 raft_consensus.cc:359] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.161573  3949 tablet_bootstrap.cc:654] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.161881  3951 raft_consensus.cc:385] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.162220  3951 raft_consensus.cc:740] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.163448  3950 tablet_bootstrap.cc:654] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.162987  3951 consensus_queue.cc:260] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.166476  3951 ts_tablet_manager.cc:1434] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:19:13.167339  3934 heartbeater.cc:499] Master 127.3.7.190:32981 was elected leader, sending a full tablet report...
I20260709 12:19:13.168761  3951 tablet_bootstrap.cc:492] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.184211  3951 tablet_bootstrap.cc:654] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.189632  3949 tablet_bootstrap.cc:492] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.190245  3949 ts_tablet_manager.cc:1403] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.001s
I20260709 12:19:13.190658  3950 tablet_bootstrap.cc:492] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.191344  3950 ts_tablet_manager.cc:1403] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.011s
I20260709 12:19:13.193320  3949 raft_consensus.cc:359] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.194128  3949 raft_consensus.cc:385] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.194525  3949 raft_consensus.cc:740] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.194885  3950 raft_consensus.cc:359] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.195736  3950 raft_consensus.cc:385] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.196110  3950 raft_consensus.cc:740] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.195554  3949 consensus_queue.cc:260] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.196851  3950 consensus_queue.cc:260] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.197409  3951 tablet_bootstrap.cc:492] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.198129  3951 ts_tablet_manager.cc:1403] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.008s
I20260709 12:19:13.198210  3949 ts_tablet_manager.cc:1434] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:13.199012  3950 ts_tablet_manager.cc:1434] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:19:13.199402  3949 tablet_bootstrap.cc:492] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.199975  3950 tablet_bootstrap.cc:492] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.201114  3951 raft_consensus.cc:359] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.201817  3951 raft_consensus.cc:385] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.202112  3951 raft_consensus.cc:740] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.203068  3951 consensus_queue.cc:260] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.205472  3951 ts_tablet_manager.cc:1434] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:19:13.206375  3951 tablet_bootstrap.cc:492] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.206848  3950 tablet_bootstrap.cc:654] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.206887  3949 tablet_bootstrap.cc:654] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.207160  3957 raft_consensus.cc:493] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.207649  3957 raft_consensus.cc:515] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.223467  3957 leader_election.cc:290] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.230029  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
W20260709 12:19:13.232256  3872 leader_election.cc:343] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.233831  3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:13.234540  3759 raft_consensus.cc:2468] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 0.
I20260709 12:19:13.236089  3874 leader_election.cc:304] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.237020  3957 raft_consensus.cc:2804] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.237500  3957 raft_consensus.cc:493] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.237948  3957 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.252058  3951 tablet_bootstrap.cc:654] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.255792  3957 raft_consensus.cc:515] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.256587  3949 tablet_bootstrap.cc:492] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.257213  3949 ts_tablet_manager.cc:1403] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.058s	user 0.028s	sys 0.012s
I20260709 12:19:13.259135  3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:13.259752  3759 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.260547  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
W20260709 12:19:13.262360  3872 leader_election.cc:343] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.264256  3957 leader_election.cc:290] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.265228  3759 raft_consensus.cc:2468] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 1.
I20260709 12:19:13.265996  3950 tablet_bootstrap.cc:492] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.265575  3949 raft_consensus.cc:359] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.266469  3949 raft_consensus.cc:385] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.266615  3950 ts_tablet_manager.cc:1403] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.067s	user 0.030s	sys 0.033s
I20260709 12:19:13.266474  3874 leader_election.cc:304] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.266954  3949 raft_consensus.cc:740] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.267968  3957 raft_consensus.cc:2804] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.267808  3949 consensus_queue.cc:260] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.270596  3950 raft_consensus.cc:359] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.271535  3950 raft_consensus.cc:385] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.271878  3950 raft_consensus.cc:740] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.272785  3950 consensus_queue.cc:260] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.274268  3951 tablet_bootstrap.cc:492] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.274727  3951 ts_tablet_manager.cc:1403] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.010s
I20260709 12:19:13.277612  3951 raft_consensus.cc:359] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.278301  3951 raft_consensus.cc:385] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.278601  3951 raft_consensus.cc:740] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.279695  3951 consensus_queue.cc:260] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.280573  3949 ts_tablet_manager.cc:1434] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:19:13.281759  3950 ts_tablet_manager.cc:1434] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:19:13.282791  3957 raft_consensus.cc:697] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:13.283756  3957 consensus_queue.cc:237] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.284687  3949 tablet_bootstrap.cc:492] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.288793  3951 ts_tablet_manager.cc:1434] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 12:19:13.292024  3950 tablet_bootstrap.cc:492] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.294835  3949 tablet_bootstrap.cc:654] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.296748  3951 tablet_bootstrap.cc:492] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.297358  3950 tablet_bootstrap.cc:654] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.305285  3951 tablet_bootstrap.cc:654] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.306600  3654 catalog_manager.cc:5697] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.317416  3954 raft_consensus.cc:493] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.318218  3951 tablet_bootstrap.cc:492] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.317950  3954 raft_consensus.cc:515] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.318686  3951 ts_tablet_manager.cc:1403] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:19:13.321310  3949 tablet_bootstrap.cc:492] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.321877  3949 ts_tablet_manager.cc:1403] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.008s
I20260709 12:19:13.322165  3951 raft_consensus.cc:359] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.323007  3951 raft_consensus.cc:385] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.323351  3951 raft_consensus.cc:740] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.323490  3954 leader_election.cc:290] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.324229  3951 consensus_queue.cc:260] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.325043  3949 raft_consensus.cc:359] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.325881  3949 raft_consensus.cc:385] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.326233  3949 raft_consensus.cc:740] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.326975  3949 consensus_queue.cc:260] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.327968  3951 ts_tablet_manager.cc:1434] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:19:13.329025  3951 tablet_bootstrap.cc:492] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.329288  3949 ts_tablet_manager.cc:1434] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:13.330415  3949 tablet_bootstrap.cc:492] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.332667  3950 tablet_bootstrap.cc:492] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.333199  3950 ts_tablet_manager.cc:1403] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.041s	user 0.001s	sys 0.025s
I20260709 12:19:13.336596  3951 tablet_bootstrap.cc:654] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.336717  3949 tablet_bootstrap.cc:654] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.343092  3950 raft_consensus.cc:359] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.344254  3950 raft_consensus.cc:385] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.344681  3950 raft_consensus.cc:740] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.345778  3950 consensus_queue.cc:260] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.366287  3949 tablet_bootstrap.cc:492] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.366930  3949 ts_tablet_manager.cc:1403] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.021s
I20260709 12:19:13.367116  3950 ts_tablet_manager.cc:1434] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.003s
I20260709 12:19:13.367324  3951 tablet_bootstrap.cc:492] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.367858  3951 ts_tablet_manager.cc:1403] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.017s
I20260709 12:19:13.368131  3950 tablet_bootstrap.cc:492] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.370290  3949 raft_consensus.cc:359] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.371071  3949 raft_consensus.cc:385] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.370918  3951 raft_consensus.cc:359] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.371500  3949 raft_consensus.cc:740] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.371821  3951 raft_consensus.cc:385] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.372206  3951 raft_consensus.cc:740] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.372651  3949 consensus_queue.cc:260] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.373061  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.373168  3951 consensus_queue.cc:260] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.373886  3909 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 0.
I20260709 12:19:13.375191  3949 ts_tablet_manager.cc:1434] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:13.376230  3949 tablet_bootstrap.cc:492] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.376788  3950 tablet_bootstrap.cc:654] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.377864  3951 ts_tablet_manager.cc:1434] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:13.378901  3951 tablet_bootstrap.cc:492] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
W20260709 12:19:13.378978  3705 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:13.379760  3956 raft_consensus.cc:493] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.380285  3956 raft_consensus.cc:515] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.386482  3951 tablet_bootstrap.cc:654] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.386958  3949 tablet_bootstrap.cc:654] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.389213  3723 leader_election.cc:304] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.395519  3954 raft_consensus.cc:2804] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.396059  3954 raft_consensus.cc:493] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.396438  3954 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.398921  3951 tablet_bootstrap.cc:492] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.399461  3951 ts_tablet_manager.cc:1403] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:19:13.402704  3951 raft_consensus.cc:359] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.403761  3951 raft_consensus.cc:385] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.404098  3951 raft_consensus.cc:740] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.404946  3951 consensus_queue.cc:260] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.409144  3951 ts_tablet_manager.cc:1434] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:19:13.410444  3951 tablet_bootstrap.cc:492] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.425698  3951 tablet_bootstrap.cc:654] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.402904  3956 leader_election.cc:290] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.437301  3956 raft_consensus.cc:493] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.438140  3950 tablet_bootstrap.cc:492] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.437824  3956 raft_consensus.cc:515] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.438616  3950 ts_tablet_manager.cc:1403] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.071s	user 0.039s	sys 0.025s
I20260709 12:19:13.440197  3956 leader_election.cc:290] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.441464  3950 raft_consensus.cc:359] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.442027  3950 raft_consensus.cc:385] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.442271  3950 raft_consensus.cc:740] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.442916  3950 consensus_queue.cc:260] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.443569  3949 tablet_bootstrap.cc:492] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.443719  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:13.444221  3949 ts_tablet_manager.cc:1403] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.068s	user 0.024s	sys 0.032s
I20260709 12:19:13.444434  3834 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 0.
I20260709 12:19:13.445408  3950 ts_tablet_manager.cc:1434] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.007s
I20260709 12:19:13.446861  3950 tablet_bootstrap.cc:492] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.447474  3949 raft_consensus.cc:359] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.448266  3949 raft_consensus.cc:385] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.448599  3949 raft_consensus.cc:740] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.449389  3949 consensus_queue.cc:260] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.463439  3954 raft_consensus.cc:515] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.471071  3950 tablet_bootstrap.cc:654] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.474785  3981 raft_consensus.cc:493] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.475769  3984 raft_consensus.cc:493] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.476805  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:13.477515  3909 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.477129  3984 raft_consensus.cc:515] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.479761  3951 tablet_bootstrap.cc:492] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.480293  3951 ts_tablet_manager.cc:1403] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.022s
I20260709 12:19:13.482388  3984 leader_election.cc:290] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.477622  3954 leader_election.cc:290] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Requested vote from peers 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.476804  3981 raft_consensus.cc:515] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.484043  3951 raft_consensus.cc:359] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.485184  3951 raft_consensus.cc:385] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.485646  3951 raft_consensus.cc:740] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.485870  3957 raft_consensus.cc:493] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.486347  3981 leader_election.cc:290] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.486433  3957 raft_consensus.cc:515] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.487839  3951 consensus_queue.cc:260] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.493096  3907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9480d6d5004349f493257180b9dca416" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.488979  3957 leader_election.cc:290] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.493836  3907 raft_consensus.cc:2468] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 0.
I20260709 12:19:13.495280  3723 leader_election.cc:304] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.489738  3909 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 1.
I20260709 12:19:13.490589  3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:13.496924  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:13.497156  3759 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 0.
I20260709 12:19:13.496744  3984 raft_consensus.cc:2804] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.497560  3907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b7a8c074924c329c762aa48c096780" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.498031  3984 raft_consensus.cc:493] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.498236  3907 raft_consensus.cc:2468] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 0.
I20260709 12:19:13.492136  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2101615869fc4b94b4a1422a57277ae9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.473765  3949 ts_tablet_manager.cc:1434] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:19:13.498389  3984 raft_consensus.cc:3060] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.498487  3874 leader_election.cc:304] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.498329  3906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.499464  3951 ts_tablet_manager.cc:1434] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:19:13.500260  3798 leader_election.cc:304] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:13.505923  3956 raft_consensus.cc:2804] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.506306  3956 raft_consensus.cc:493] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.506698  3956 raft_consensus.cc:3060] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.501199  3949 tablet_bootstrap.cc:492] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.507500  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2101615869fc4b94b4a1422a57277ae9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:13.508751  3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b7a8c074924c329c762aa48c096780" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:13.509151  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9480d6d5004349f493257180b9dca416" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:13.510154  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:13.502745  3981 raft_consensus.cc:493] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.511426  3981 raft_consensus.cc:515] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.514991  3949 tablet_bootstrap.cc:654] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:13.515415  3722 leader_election.cc:343] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.516050  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:13.516651  3834 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.517268  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:13.517930  3833 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 0.
I20260709 12:19:13.521602  3949 tablet_bootstrap.cc:492] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.522071  3949 ts_tablet_manager.cc:1403] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.002s
I20260709 12:19:13.523036  3834 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 1.
W20260709 12:19:13.516091  3722 leader_election.cc:343] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.511054  3758 raft_consensus.cc:2393] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50379fa2025d4df3b13dccaec8cfb9a8 in current term 1: Already voted for candidate 33cbf294014c4ca68c6c734bfa199528 in this term.
W20260709 12:19:13.524065  3799 leader_election.cc:343] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:13.503525  3872 leader_election.cc:343] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.525012  3949 raft_consensus.cc:359] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.525394  3799 leader_election.cc:304] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:13.500520  3908 raft_consensus.cc:2468] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 0.
I20260709 12:19:13.525796  3949 raft_consensus.cc:385] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.526157  3949 raft_consensus.cc:740] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.503865  3957 raft_consensus.cc:2804] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.527690  3723 leader_election.cc:304] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.505033  3951 tablet_bootstrap.cc:492] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.527109  3949 consensus_queue.cc:260] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.528146  3957 raft_consensus.cc:493] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.533694  3987 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.528805  3983 raft_consensus.cc:2804] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.529603  3723 leader_election.cc:304] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.525416  3722 leader_election.cc:304] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.535187  3954 raft_consensus.cc:2804] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.535601  3954 raft_consensus.cc:493] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.535975  3954 raft_consensus.cc:3060] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.536461  3951 tablet_bootstrap.cc:654] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.536945  3950 tablet_bootstrap.cc:492] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.537428  3950 ts_tablet_manager.cc:1403] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.000s
I20260709 12:19:13.540400  3950 raft_consensus.cc:359] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.541162  3950 raft_consensus.cc:385] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.541458  3950 raft_consensus.cc:740] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.529237  3956 raft_consensus.cc:515] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.531029  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.535297  3981 leader_election.cc:290] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.532796  3949 ts_tablet_manager.cc:1434] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:19:13.533780  3957 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.543265  3949 tablet_bootstrap.cc:492] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.543603  3983 raft_consensus.cc:697] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:13.544890  3983 consensus_queue.cc:237] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:13.549897  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b7a8c074924c329c762aa48c096780" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:13.550470  3908 raft_consensus.cc:3060] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.550848  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b7a8c074924c329c762aa48c096780" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
W20260709 12:19:13.553453  3799 leader_election.cc:343] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.554049  3981 raft_consensus.cc:2804] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:13.554422  3723 leader_election.cc:343] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.554554  3957 raft_consensus.cc:515] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.554421  3981 raft_consensus.cc:493] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.557273  3981 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.557513  3908 raft_consensus.cc:2468] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 1.
I20260709 12:19:13.557440  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:13.558193  3758 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.558730  3798 leader_election.cc:304] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:13.510171  3984 raft_consensus.cc:515] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.560454  3956 leader_election.cc:290] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.560956  3990 raft_consensus.cc:2804] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.562434  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9480d6d5004349f493257180b9dca416" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:13.563030  3908 raft_consensus.cc:3060] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.563024  3990 raft_consensus.cc:697] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Becoming Leader. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:13.564122  3949 tablet_bootstrap.cc:654] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.565119  3990 consensus_queue.cc:237] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.565217  3758 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 1.
I20260709 12:19:13.566069  3954 raft_consensus.cc:515] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.568056  3984 leader_election.cc:290] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.568475  3874 leader_election.cc:304] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.566807  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:13.569365  3965 raft_consensus.cc:2804] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.569841  3965 raft_consensus.cc:697] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
W20260709 12:19:13.569964  3722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:33239, user_credentials={real_user=slave}} blocked reactor thread for 44688.8us
I20260709 12:19:13.570758  3965 consensus_queue.cc:237] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.569907  3954 leader_election.cc:290] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.572618  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9480d6d5004349f493257180b9dca416" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:13.574863  3833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2101615869fc4b94b4a1422a57277ae9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:13.575956  3987 raft_consensus.cc:2749] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:13.576290  3722 leader_election.cc:343] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.577432  3957 leader_election.cc:290] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
W20260709 12:19:13.578302  3722 leader_election.cc:343] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.580514  3950 consensus_queue.cc:260] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.581651  3834 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.583124  3949 tablet_bootstrap.cc:492] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.583597  3949 ts_tablet_manager.cc:1403] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 12:19:13.586167  3949 raft_consensus.cc:359] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.586834  3949 raft_consensus.cc:385] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.586763  3906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2101615869fc4b94b4a1422a57277ae9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:13.587797  3906 raft_consensus.cc:3060] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.588894  3834 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 1.
I20260709 12:19:13.590536  3956 raft_consensus.cc:493] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.591089  3956 raft_consensus.cc:515] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.593402  3956 leader_election.cc:290] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.593681  3949 raft_consensus.cc:740] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.594460  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:13.595116  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.594409  3949 consensus_queue.cc:260] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.595261  3758 raft_consensus.cc:2468] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 0.
I20260709 12:19:13.596776  3799 leader_election.cc:304] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.597473  3906 raft_consensus.cc:2468] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 1.
I20260709 12:19:13.597597  3990 raft_consensus.cc:2804] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:13.597679  3798 leader_election.cc:343] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.598038  3990 raft_consensus.cc:493] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.598368  3950 ts_tablet_manager.cc:1434] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:19:13.598415  3990 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.598769  3723 leader_election.cc:304] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.599463  3950 tablet_bootstrap.cc:492] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.599915  3954 raft_consensus.cc:2804] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.600538  3954 raft_consensus.cc:697] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:13.601634  3954 consensus_queue.cc:237] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.597389  3949 ts_tablet_manager.cc:1434] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:19:13.607681  3949 tablet_bootstrap.cc:492] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.612072  3965 raft_consensus.cc:493] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.611328  3656 catalog_manager.cc:5697] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.612562  3965 raft_consensus.cc:515] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.613595  3950 tablet_bootstrap.cc:654] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.614750  3965 leader_election.cc:290] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.615533  3654 catalog_manager.cc:5697] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.616521  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
W20260709 12:19:13.617978  3874 leader_election.cc:343] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.619632  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
W20260709 12:19:13.620882  3872 leader_election.cc:343] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.621536  3872 leader_election.cc:304] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528; no voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:13.631390  3965 raft_consensus.cc:2749] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:13.614104  3990 raft_consensus.cc:515] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.646428  3656 catalog_manager.cc:5697] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.647768  3981 raft_consensus.cc:515] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.649499  3990 leader_election.cc:290] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.650688  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:13.651275  3758 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.652086  3981 leader_election.cc:290] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.652763  3906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:13.652971  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
W20260709 12:19:13.654116  3723 leader_election.cc:343] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:13.654516  3798 leader_election.cc:343] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.652895  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:13.655033  3949 tablet_bootstrap.cc:654] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.655268  3834 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.655860  3951 tablet_bootstrap.cc:492] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.656344  3951 ts_tablet_manager.cc:1403] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.152s	user 0.042s	sys 0.048s
I20260709 12:19:13.661300  3758 raft_consensus.cc:2468] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 1.
I20260709 12:19:13.663625  3834 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 1.
I20260709 12:19:13.663825  3908 raft_consensus.cc:2468] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 1.
I20260709 12:19:13.667665  3951 raft_consensus.cc:359] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.668125  3799 leader_election.cc:304] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:13.665287  3722 leader_election.cc:304] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:13.669234  3990 raft_consensus.cc:2804] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.668568  3951 raft_consensus.cc:385] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.669723  3990 raft_consensus.cc:697] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Becoming Leader. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:13.671356  3723 leader_election.cc:304] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.671453  3990 consensus_queue.cc:237] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.673177  3983 raft_consensus.cc:2804] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.673794  3983 raft_consensus.cc:697] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:13.674873  3983 consensus_queue.cc:237] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.675856  3951 raft_consensus.cc:740] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.669852  3981 raft_consensus.cc:2804] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.678701  3981 raft_consensus.cc:697] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:13.680225  3981 consensus_queue.cc:237] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.677350  3951 consensus_queue.cc:260] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.687676  3951 ts_tablet_manager.cc:1434] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:19:13.689018  3951 tablet_bootstrap.cc:492] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.692354  3653 catalog_manager.cc:5697] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.696893  3951 tablet_bootstrap.cc:654] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.718640  3950 tablet_bootstrap.cc:492] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.719163  3950 ts_tablet_manager.cc:1403] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.120s	user 0.055s	sys 0.035s
I20260709 12:19:13.720907  3949 tablet_bootstrap.cc:492] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.721367  3949 ts_tablet_manager.cc:1403] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.114s	user 0.023s	sys 0.018s
I20260709 12:19:13.722950  3950 raft_consensus.cc:359] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.723944  3950 raft_consensus.cc:385] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.723866  3949 raft_consensus.cc:359] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.724452  3950 raft_consensus.cc:740] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.724655  3949 raft_consensus.cc:385] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.725003  3949 raft_consensus.cc:740] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.725838  3949 consensus_queue.cc:260] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.725600  3950 consensus_queue.cc:260] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.728659  3950 ts_tablet_manager.cc:1434] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:19:13.728242  3949 ts_tablet_manager.cc:1434] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:13.726783  3656 catalog_manager.cc:5697] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.730065  3950 tablet_bootstrap.cc:492] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.730218  3949 tablet_bootstrap.cc:492] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Bootstrap starting.
I20260709 12:19:13.730845  3656 catalog_manager.cc:5697] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.732740  3951 tablet_bootstrap.cc:492] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.733245  3951 ts_tablet_manager.cc:1403] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.011s
I20260709 12:19:13.732558  3656 catalog_manager.cc:5697] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.736227  3949 tablet_bootstrap.cc:654] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.736023  3951 raft_consensus.cc:359] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.736631  3950 tablet_bootstrap.cc:654] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.736871  3951 raft_consensus.cc:385] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.737208  3951 raft_consensus.cc:740] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.738178  3951 consensus_queue.cc:260] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.746845  3951 ts_tablet_manager.cc:1434] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:19:13.748236  3951 tablet_bootstrap.cc:492] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: Bootstrap starting.
I20260709 12:19:13.756062  3951 tablet_bootstrap.cc:654] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.766968  3965 raft_consensus.cc:493] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.767558  3965 raft_consensus.cc:515] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.768007  3950 tablet_bootstrap.cc:492] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.768497  3950 ts_tablet_manager.cc:1403] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.020s
I20260709 12:19:13.768741  3949 tablet_bootstrap.cc:492] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: No bootstrap required, opened a new log
I20260709 12:19:13.769168  3949 ts_tablet_manager.cc:1403] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.028s
I20260709 12:19:13.769749  3965 leader_election.cc:290] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.771127  3950 raft_consensus.cc:359] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.771557  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952845377b324f77a8f9f02fdbb998bc" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:13.771804  3950 raft_consensus.cc:385] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.771761  3949 raft_consensus.cc:359] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.772181  3758 raft_consensus.cc:2468] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 0.
I20260709 12:19:13.772330  3950 raft_consensus.cc:740] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.772567  3949 raft_consensus.cc:385] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.772960  3949 raft_consensus.cc:740] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.773159  3950 consensus_queue.cc:260] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.773701  3949 consensus_queue.cc:260] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.774394  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952845377b324f77a8f9f02fdbb998bc" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:13.775668  3949 ts_tablet_manager.cc:1434] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:13.777691  3950 ts_tablet_manager.cc:1434] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:13.778745  3950 tablet_bootstrap.cc:492] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.781270  3874 leader_election.cc:304] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:13.781939  3965 raft_consensus.cc:2804] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.782292  3965 raft_consensus.cc:493] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:13.782333  3872 leader_election.cc:343] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.782730  3965 raft_consensus.cc:3060] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.784386  3983 raft_consensus.cc:493] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.784837  3983 raft_consensus.cc:515] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.786895  3983 leader_election.cc:290] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.787163  3950 tablet_bootstrap.cc:654] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.788797  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
W20260709 12:19:13.790405  3722 leader_election.cc:343] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.790118  3965 raft_consensus.cc:515] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.791687  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:13.792291  3965 leader_election.cc:290] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:13.792337  3908 raft_consensus.cc:2468] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 0.
I20260709 12:19:13.795673  3951 tablet_bootstrap.cc:492] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: No bootstrap required, opened a new log
I20260709 12:19:13.796294  3951 ts_tablet_manager.cc:1403] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.000s
I20260709 12:19:13.796767  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952845377b324f77a8f9f02fdbb998bc" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:13.797344  3758 raft_consensus.cc:3060] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.797348  3723 leader_election.cc:304] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.799111  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952845377b324f77a8f9f02fdbb998bc" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:13.799974  3951 raft_consensus.cc:359] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
W20260709 12:19:13.800508  3872 leader_election.cc:343] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.800880  3951 raft_consensus.cc:385] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.801201  3983 raft_consensus.cc:2804] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:13.801256  3951 raft_consensus.cc:740] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.801690  3983 raft_consensus.cc:493] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.802109  3983 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.802469  3951 consensus_queue.cc:260] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.805214  3951 ts_tablet_manager.cc:1434] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:19:13.805600  3758 raft_consensus.cc:2468] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 1.
I20260709 12:19:13.806887  3874 leader_election.cc:304] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.807781  3965 raft_consensus.cc:2804] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.808403  3965 raft_consensus.cc:697] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:13.809486  3965 consensus_queue.cc:237] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.812003  3983 raft_consensus.cc:515] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.814489  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
W20260709 12:19:13.815725  3722 leader_election.cc:343] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:13.815832  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:13.816349  3908 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.819512  3983 leader_election.cc:290] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:13.822926  3908 raft_consensus.cc:2468] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 1.
I20260709 12:19:13.824311  3723 leader_election.cc:304] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:13.824582  3950 tablet_bootstrap.cc:492] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.825052  3950 ts_tablet_manager.cc:1403] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.047s	user 0.031s	sys 0.011s
I20260709 12:19:13.825073  3983 raft_consensus.cc:2804] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:13.825735  3983 raft_consensus.cc:697] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:13.826622  3983 consensus_queue.cc:237] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.827478  3655 catalog_manager.cc:5697] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.828205  3950 raft_consensus.cc:359] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.828823  3950 raft_consensus.cc:385] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.829088  3950 raft_consensus.cc:740] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.829715  3950 consensus_queue.cc:260] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.832221  3950 ts_tablet_manager.cc:1434] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:13.833159  3950 tablet_bootstrap.cc:492] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8: Bootstrap starting.
I20260709 12:19:13.837920  3656 catalog_manager.cc:5697] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.838665  3950 tablet_bootstrap.cc:654] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:13.842547  3950 tablet_bootstrap.cc:492] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8: No bootstrap required, opened a new log
I20260709 12:19:13.842950  3950 ts_tablet_manager.cc:1403] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:13.845003  3950 raft_consensus.cc:359] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.845424  3950 raft_consensus.cc:385] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:13.845686  3950 raft_consensus.cc:740] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Initialized, Role: FOLLOWER
I20260709 12:19:13.846258  3950 consensus_queue.cc:260] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:13.848176  3950 ts_tablet_manager.cc:1434] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:19:13.853799  3965 consensus_queue.cc:1048] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:13.865267  3966 consensus_queue.cc:1048] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:13.992734  3834 raft_consensus.cc:3060] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:13.998644  3983 consensus_queue.cc:1048] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.001169  3758 raft_consensus.cc:3060] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.006665  3990 consensus_queue.cc:1048] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:14.010887  3935 tablet.cc:2406] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:14.016321  3990 consensus_queue.cc:1048] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.016597  3981 raft_consensus.cc:493] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.017114  3981 raft_consensus.cc:515] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.019456  3981 leader_election.cc:290] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.019666  3983 consensus_queue.cc:1048] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:14.021384  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b7a8c074924c329c762aa48c096780" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:14.027572  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b7a8c074924c329c762aa48c096780" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:14.033111  3722 leader_election.cc:304] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:14.042193  3983 raft_consensus.cc:2749] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:14.044593  3981 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.060020  3909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53862
I20260709 12:19:14.060742  3909 raft_consensus.cc:606] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:14.064772  3909 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.066967  3981 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.073619  3990 raft_consensus.cc:493] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.074162  3990 raft_consensus.cc:515] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.074635  3906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53862
I20260709 12:19:14.075235  3906 raft_consensus.cc:606] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:14.076397  3990 leader_election.cc:290] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.079113  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:14.079360  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:14.080299  3908 raft_consensus.cc:2393] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50379fa2025d4df3b13dccaec8cfb9a8 in current term 1: Already voted for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in this term.
I20260709 12:19:14.081468  3798 leader_election.cc:304] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:14.083614  3956 consensus_queue.cc:1048] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.083352  3990 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.092227  3990 raft_consensus.cc:2749] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:14.096748  3966 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.104755  3756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:38512
I20260709 12:19:14.105401  3756 raft_consensus.cc:606] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Received request to transfer leadership to TS 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:14.106915  3956 consensus_queue.cc:1048] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.119195  3965 raft_consensus.cc:993] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:14.119694  3965 raft_consensus.cc:1081] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:14.123723  3757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38494
I20260709 12:19:14.124365  3757 raft_consensus.cc:493] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:14.124291  3965 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.124835  3757 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.125967  3759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:38512
I20260709 12:19:14.126565  3759 raft_consensus.cc:606] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Received request to transfer leadership to TS 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:14.130930  3981 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.139163  3984 raft_consensus.cc:993] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:14.139640  3984 raft_consensus.cc:1081] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Signalling peer 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:14.142486  3832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:56720
I20260709 12:19:14.143062  3909 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.143422  3757 raft_consensus.cc:515] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.144474  3832 raft_consensus.cc:493] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:14.144883  3832 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.147315  3757 leader_election.cc:290] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.147563  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:14.147747  3830 raft_consensus.cc:3060] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.148166  3908 raft_consensus.cc:3055] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:14.148510  3908 raft_consensus.cc:740] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:14.148877  3831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:14.149299  3908 consensus_queue.cc:260] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.150242  3908 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.156028  3832 raft_consensus.cc:515] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.158006  3984 consensus_queue.cc:1048] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.161732  3965 raft_consensus.cc:493] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.162228  3965 raft_consensus.cc:515] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.164556  3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:14.165809  3757 raft_consensus.cc:3055] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:14.166141  3757 raft_consensus.cc:740] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:14.167290  3956 raft_consensus.cc:493] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.167045  3757 consensus_queue.cc:260] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.167558  3834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" is_pre_election: true
I20260709 12:19:14.167883  3956 raft_consensus.cc:515] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.168772  3832 leader_election.cc:290] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 2 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.169906  3965 leader_election.cc:290] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:14.169842  3906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:14.171833  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952845377b324f77a8f9f02fdbb998bc" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:14.172688  3758 raft_consensus.cc:2393] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50379fa2025d4df3b13dccaec8cfb9a8 in current term 1: Already voted for candidate 33cbf294014c4ca68c6c734bfa199528 in this term.
I20260709 12:19:14.171890  3956 leader_election.cc:290] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.173576  3759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" is_pre_election: true
I20260709 12:19:14.174165  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952845377b324f77a8f9f02fdbb998bc" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33cbf294014c4ca68c6c734bfa199528" is_pre_election: true
I20260709 12:19:14.174937  3908 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 2.
I20260709 12:19:14.176162  3723 leader_election.cc:304] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:14.176939  3874 leader_election.cc:304] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528; no voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:14.177120  3799 leader_election.cc:304] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:14.177513  3984 raft_consensus.cc:2804] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:14.177994  3984 raft_consensus.cc:697] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:14.178150  3956 raft_consensus.cc:3060] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:14.178853  3984 consensus_queue.cc:237] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.182099  3965 raft_consensus.cc:2749] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:14.168011  3757 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.187067  3956 raft_consensus.cc:2749] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:14.187662  3652 catalog_manager.cc:5697] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 1 to 2, leader changed from 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.194105  3954 consensus_queue.cc:1048] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.194134  3757 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 2.
I20260709 12:19:14.195562  3799 leader_election.cc:304] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:14.196688  3956 raft_consensus.cc:2804] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:14.197147  3956 raft_consensus.cc:697] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Becoming Leader. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:14.197846  3956 consensus_queue.cc:237] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.211400  3655 catalog_manager.cc:5697] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 reported cstate change: term changed from 1 to 2, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.360257  3981 consensus_queue.cc:1048] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.360560  3965 consensus_queue.cc:1048] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.361119  3954 consensus_queue.cc:1048] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.372186  3957 consensus_queue.cc:1048] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.373528  3981 raft_consensus.cc:993] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:14.373965  3981 raft_consensus.cc:1081] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Signalling peer 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:14.387157  3832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:56720
I20260709 12:19:14.387915  3832 raft_consensus.cc:493] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:14.388377  3832 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.388792  3966 raft_consensus.cc:993] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:14.389253  3966 raft_consensus.cc:1081] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:14.391469  3759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38494
I20260709 12:19:14.392045  3759 raft_consensus.cc:493] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:14.392482  3759 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.396209  3832 raft_consensus.cc:515] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.399204  3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:14.399721  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:14.400377  3908 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.400673  3759 raft_consensus.cc:515] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.404940  3831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:14.405753  3831 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.399845  3757 raft_consensus.cc:3055] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:14.411646  3757 raft_consensus.cc:740] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:14.412473  3832 leader_election.cc:290] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 2 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.412837  3757 consensus_queue.cc:260] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.413964  3908 raft_consensus.cc:2468] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 2.
I20260709 12:19:14.415410  3798 leader_election.cc:304] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:14.415933  3831 raft_consensus.cc:2468] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 2.
I20260709 12:19:14.416432  3956 raft_consensus.cc:2804] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:14.417374  3956 raft_consensus.cc:697] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Becoming Leader. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:14.414561  3757 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.418022  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:14.418347  3956 consensus_queue.cc:237] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.418741  3908 raft_consensus.cc:3055] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:14.419220  3722 leader_election.cc:304] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:14.419651  3908 raft_consensus.cc:740] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:14.420285  3988 raft_consensus.cc:2804] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:14.418290  3759 leader_election.cc:290] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:14.420855  3988 raft_consensus.cc:697] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:14.420723  3908 consensus_queue.cc:260] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.422005  3908 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.421917  3988 consensus_queue.cc:237] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:14.427084  3757 raft_consensus.cc:2468] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 2.
I20260709 12:19:14.430102  3908 raft_consensus.cc:2468] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 2.
I20260709 12:19:14.430552  3655 catalog_manager.cc:5697] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 reported cstate change: term changed from 1 to 2, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.443804  3656 catalog_manager.cc:5697] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 1 to 2, leader changed from 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.726106  3831 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.731601  3831 raft_consensus.cc:1275] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.733023  3988 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:14.734195  3908 raft_consensus.cc:1275] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.735440  3988 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:14.756922  3908 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:14.761744  3908 raft_consensus.cc:1275] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.762912  3956 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:14.771670  3757 raft_consensus.cc:1275] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.773808  3956 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:14.838133  3908 raft_consensus.cc:1275] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.839408  3984 consensus_queue.cc:1048] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:14.847767  3831 raft_consensus.cc:1275] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.850355  3983 consensus_queue.cc:1048] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:14.858685  3757 raft_consensus.cc:1275] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.859961  3956 consensus_queue.cc:1048] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:14.867183  3908 raft_consensus.cc:1275] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:14.868832  3990 consensus_queue.cc:1048] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:17.171929  3102 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:19:17.172642  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.196671  3757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:38516
I20260709 12:19:17.197211  3757 raft_consensus.cc:606] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Received request to transfer leadership to TS 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:17.199604  3757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:38516
I20260709 12:19:17.200067  3757 raft_consensus.cc:606] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Received request to transfer leadership to TS 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:17.201097  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:17.201581  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:17.485442  4038 raft_consensus.cc:993] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:17.485899  3983 raft_consensus.cc:1081] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Signalling peer 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:17.487483  3908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:53844
I20260709 12:19:17.488029  3908 raft_consensus.cc:493] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:17.488338  3908 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.493849  3908 raft_consensus.cc:515] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:17.495420  3908 leader_election.cc:290] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 2 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:17.496264  3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:17.496531  3831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:17.496897  3757 raft_consensus.cc:3055] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:17.497108  3831 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.497237  3757 raft_consensus.cc:740] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:17.498081  3757 consensus_queue.cc:260] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:17.499279  3757 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:17.504133  3831 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 2.
I20260709 12:19:17.505549  3872 leader_election.cc:304] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:17.505832  3757 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 2.
I20260709 12:19:17.506367  4036 raft_consensus.cc:2804] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:17.507490  4036 raft_consensus.cc:697] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:17.508364  4036 consensus_queue.cc:237] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:17.515928  3652 catalog_manager.cc:5697] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 1 to 2, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:17.589344  4038 raft_consensus.cc:993] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:17.589811  3983 raft_consensus.cc:1081] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Signalling peer 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:17.591449  3908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:53844
I20260709 12:19:17.592044  3908 raft_consensus.cc:493] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:17.592432  3908 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.598183  3908 raft_consensus.cc:515] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:17.599747  3908 leader_election.cc:290] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 3 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:17.600503  3757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:17.600713  3831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:17.601100  3757 raft_consensus.cc:3055] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:17.601297  3831 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.601447  3757 raft_consensus.cc:740] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:17.602257  3757 consensus_queue.cc:260] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:17.603421  3757 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:17.606456  3831 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 3.
I20260709 12:19:17.607645  3872 leader_election.cc:304] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:17.608387  4036 raft_consensus.cc:2804] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:17.608342  3757 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 3.
I20260709 12:19:17.609002  4036 raft_consensus.cc:697] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:17.609890  4036 consensus_queue.cc:237] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:17.617938  3652 catalog_manager.cc:5697] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 2 to 3, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:17.893649  3831 raft_consensus.cc:1275] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:17.895026  4036 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:17.911554  3757 raft_consensus.cc:1275] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:17.914345  4051 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:17.996132  3831 raft_consensus.cc:1275] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:17.997548  4051 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:18.006940  3757 raft_consensus.cc:1275] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:18.008550  4051 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:18.202726  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.208539  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:18.208917  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:19.210057  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:19.217551  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:19.218137  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:20.219329  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.225235  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:20.225613  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:21.226557  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:21.232611  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:21.233060  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:22.234380  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.240934  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:22.241436  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:23.242671  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:23.248071  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:23.248523  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:24.249513  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:24.255652  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:24.256094  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.257040  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.263439  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:25.264014  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.265300  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.272567  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:26.273129  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.308342  3102 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:19:27.313632  3909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53862
I20260709 12:19:27.314678  3909 raft_consensus.cc:606] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:27.320899  3909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53862
I20260709 12:19:27.321398  3909 raft_consensus.cc:606] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:27.349526  3832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:19:27.350104  3832 raft_consensus.cc:606] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:27.356487  3832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:19:27.357216  3832 raft_consensus.cc:606] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:27.363070  3832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
mode: GRACEFUL
new_leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:19:27.363816  3832 raft_consensus.cc:606] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Received request to transfer leadership to TS ff6ce19804ba4b7eaae7fa0f3c81bfe2
I20260709 12:19:27.587489  4037 raft_consensus.cc:993] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.588097  4069 raft_consensus.cc:1081] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.590354  3757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38502
I20260709 12:19:27.591120  3757 raft_consensus.cc:493] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.591655  3757 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.599650  3757 raft_consensus.cc:515] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.601821  3757 leader_election.cc:290] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 3 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:27.602903  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:27.603188  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156a9f83969749be9bc1f71dbd9e6fc9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:27.603886  3909 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.603886  3832 raft_consensus.cc:3055] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:27.604542  3832 raft_consensus.cc:740] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:27.605630  3832 consensus_queue.cc:260] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.607015  3832 raft_consensus.cc:3060] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.611743  3909 raft_consensus.cc:2468] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 3.
I20260709 12:19:27.613534  3723 leader_election.cc:304] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:27.613998  3832 raft_consensus.cc:2468] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 3.
I20260709 12:19:27.614630  4065 raft_consensus.cc:2804] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:27.615813  4065 raft_consensus.cc:697] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:27.616791  4065 consensus_queue.cc:237] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.624435  3652 catalog_manager.cc:5697] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 2 to 3, leader changed from 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 3 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:27.673957  4037 raft_consensus.cc:993] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.674496  4069 raft_consensus.cc:1081] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.676345  3757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38502
I20260709 12:19:27.677089  3757 raft_consensus.cc:493] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.677562  3757 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.684331  3757 raft_consensus.cc:515] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.684681  4076 raft_consensus.cc:993] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.685294  4036 raft_consensus.cc:1081] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.686735  3757 leader_election.cc:290] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 3 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:27.686901  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:27.687481  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:27.687687  3832 raft_consensus.cc:3055] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:27.688107  3832 raft_consensus.cc:740] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:27.688156  3909 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.686873  3759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38494
I20260709 12:19:27.688957  3759 raft_consensus.cc:493] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.689376  3759 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.689169  3832 consensus_queue.cc:260] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.690472  3832 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.692600  4069 raft_consensus.cc:993] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.693086  4069 raft_consensus.cc:1081] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.695089  3757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38502
I20260709 12:19:27.695749  3757 raft_consensus.cc:493] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.696157  3757 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:27.697638  3832 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 3.
I20260709 12:19:27.698561  4036 raft_consensus.cc:993] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: : Instructing follower ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.699028  4076 raft_consensus.cc:1081] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 LEADER]: Signalling peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 to start an election
I20260709 12:19:27.699796  3722 leader_election.cc:304] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:27.700664  4065 raft_consensus.cc:2804] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:27.701145  4065 raft_consensus.cc:697] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:27.701938  4065 consensus_queue.cc:237] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.702409  3909 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 3.
I20260709 12:19:27.703704  3758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
 from {username='slave'} at 127.0.0.1:38494
I20260709 12:19:27.704283  3758 raft_consensus.cc:493] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.704702  3758 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.704555  3757 raft_consensus.cc:515] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.707757  3757 leader_election.cc:290] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:27.708799  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:27.709466  3832 raft_consensus.cc:3055] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:27.708784  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:27.709996  3832 raft_consensus.cc:740] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:27.710427  3909 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:27.710238  3759 raft_consensus.cc:515] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.711189  3832 consensus_queue.cc:260] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.712805  3759 leader_election.cc:290] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 4 election: Requested vote from peers 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:27.713714  3831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:27.714324  3831 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.715867  3832 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:27.710852  3652 catalog_manager.cc:5697] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 2 to 3, leader changed from 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 3 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:27.717988  3909 raft_consensus.cc:2468] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 2.
I20260709 12:19:27.719116  3723 leader_election.cc:304] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:27.719661  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b430ac3b724958a4bab6ec93f1e072" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:27.720160  4065 raft_consensus.cc:2804] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:27.720242  3908 raft_consensus.cc:3055] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:27.720779  3908 raft_consensus.cc:740] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:27.720842  4065 raft_consensus.cc:697] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:27.721752  3908 consensus_queue.cc:260] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.721994  4065 consensus_queue.cc:237] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.723114  3908 raft_consensus.cc:3060] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:27.723009  3832 raft_consensus.cc:2468] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 2.
I20260709 12:19:27.728441  3758 raft_consensus.cc:515] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:27.732228  3758 leader_election.cc:290] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 3 election: Requested vote from peers 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:27.733237  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:27.733922  3832 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.735929  3831 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 4.
I20260709 12:19:27.737018  3909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:27.737634  3722 leader_election.cc:304] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:27.737627  3909 raft_consensus.cc:3055] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:27.739207  3909 raft_consensus.cc:740] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:27.740291  3909 consensus_queue.cc:260] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:27.740181  3652 catalog_manager.cc:5697] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 1 to 2, leader changed from 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:27.741918  3909 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:27.741873  3832 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 3.
I20260709 12:19:27.742830  3908 raft_consensus.cc:2468] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 4.
I20260709 12:19:27.738863  4065 raft_consensus.cc:2804] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:27.744285  4065 raft_consensus.cc:697] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:27.743419  3722 leader_election.cc:304] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50379fa2025d4df3b13dccaec8cfb9a8, ff6ce19804ba4b7eaae7fa0f3c81bfe2; no voters: 
I20260709 12:19:27.745465  4070 raft_consensus.cc:2804] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:27.745316  4065 consensus_queue.cc:237] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:27.749632  3909 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff6ce19804ba4b7eaae7fa0f3c81bfe2 in term 3.
I20260709 12:19:27.754472  4070 raft_consensus.cc:697] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Becoming Leader. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:27.755693  4070 consensus_queue.cc:237] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:27.758509  3652 catalog_manager.cc:5697] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 3 to 4, leader changed from 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 4 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:27.771107  3652 catalog_manager.cc:5697] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 reported cstate change: term changed from 2 to 3, leader changed from 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131) to ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129). New cstate: current_term: 3 leader_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:28.013414  3832 raft_consensus.cc:1275] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.014859  4070 consensus_queue.cc:1048] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:28.025177  3909 raft_consensus.cc:1275] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.027212  4065 consensus_queue.cc:1048] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:28.142230  3909 raft_consensus.cc:1275] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.143787  4065 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:28.153761  3832 raft_consensus.cc:1275] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.155643  4070 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:28.167338  3832 raft_consensus.cc:1275] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:28.168769  4070 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:28.179457  3909 raft_consensus.cc:1275] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:28.182536  4065 consensus_queue.cc:1048] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:28.183956  3909 raft_consensus.cc:1275] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.184489  3908 raft_consensus.cc:1275] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:28.186620  4065 consensus_queue.cc:1048] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:28.187111  4079 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:28.205090  3832 raft_consensus.cc:1275] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:28.206914  4093 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:28.221387  3832 raft_consensus.cc:1275] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Refusing update from remote peer ff6ce19804ba4b7eaae7fa0f3c81bfe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:28.223538  4065 consensus_queue.cc:1048] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:30.401436  3102 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:19:30.402130  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.409447  3759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:38516
I20260709 12:19:30.410081  3759 raft_consensus.cc:606] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Received request to transfer leadership to TS 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:30.412928  3758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:38516
I20260709 12:19:30.413487  3758 raft_consensus.cc:606] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Received request to transfer leadership to TS 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:30.416261  3758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:38516
I20260709 12:19:30.416975  3758 raft_consensus.cc:606] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Received request to transfer leadership to TS 50379fa2025d4df3b13dccaec8cfb9a8
I20260709 12:19:30.419422  3758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74"
dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
mode: GRACEFUL
new_leader_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:38516
I20260709 12:19:30.419986  3758 raft_consensus.cc:606] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Received request to transfer leadership to TS 33cbf294014c4ca68c6c734bfa199528
I20260709 12:19:30.421250  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:30.421820  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:30.493088  4096 raft_consensus.cc:993] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:30.493592  4096 raft_consensus.cc:1081] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Signalling peer 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:30.495078  3906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:53844
I20260709 12:19:30.495510  3906 raft_consensus.cc:493] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.495791  3906 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.501616  3906 raft_consensus.cc:515] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.503968  3906 leader_election.cc:290] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 3 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:30.504935  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:30.504817  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb2d81fe0bca44cfb6061b5406113e74" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:30.505518  3832 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.505558  3758 raft_consensus.cc:3055] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:30.505999  3758 raft_consensus.cc:740] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:30.506748  3758 consensus_queue.cc:260] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.507792  3758 raft_consensus.cc:3060] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.510253  3832 raft_consensus.cc:2468] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 3.
I20260709 12:19:30.511528  3872 leader_election.cc:304] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:30.512215  4036 raft_consensus.cc:2804] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:30.513199  4036 raft_consensus.cc:697] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:30.513408  3758 raft_consensus.cc:2468] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 3.
I20260709 12:19:30.514171  4036 consensus_queue.cc:237] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.521072  3652 catalog_manager.cc:5697] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 2 to 3, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.563373  4093 raft_consensus.cc:993] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:30.563918  4096 raft_consensus.cc:1081] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Signalling peer 33cbf294014c4ca68c6c734bfa199528 to start an election
I20260709 12:19:30.565353  3906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951"
dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
 from {username='slave'} at 127.0.0.1:53844
I20260709 12:19:30.565876  3906 raft_consensus.cc:493] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.566164  3906 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.571374  3906 raft_consensus.cc:515] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.573107  3906 leader_election.cc:290] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 4 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130:33239)
I20260709 12:19:30.573945  3832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
I20260709 12:19:30.573949  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0bbaa925fbc460fa76bae4616b9a951" candidate_uuid: "33cbf294014c4ca68c6c734bfa199528" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:30.574745  3832 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.574754  3758 raft_consensus.cc:3055] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:30.575259  3758 raft_consensus.cc:740] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:30.576072  3758 consensus_queue.cc:260] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.577306  3758 raft_consensus.cc:3060] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.581549  3832 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 4.
I20260709 12:19:30.582564  3872 leader_election.cc:304] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:30.583449  4036 raft_consensus.cc:2804] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:30.583606  3758 raft_consensus.cc:2468] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33cbf294014c4ca68c6c734bfa199528 in term 4.
I20260709 12:19:30.583892  4036 raft_consensus.cc:697] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 4 LEADER]: Becoming Leader. State: Replica: 33cbf294014c4ca68c6c734bfa199528, State: Running, Role: LEADER
I20260709 12:19:30.584846  4036 consensus_queue.cc:237] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.591930  3652 catalog_manager.cc:5697] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 reported cstate change: term changed from 3 to 4, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131). New cstate: current_term: 4 leader_uuid: "33cbf294014c4ca68c6c734bfa199528" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.924381  4093 raft_consensus.cc:993] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:30.924829  4093 raft_consensus.cc:1081] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Signalling peer 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:30.926237  3832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:56720
I20260709 12:19:30.926712  3832 raft_consensus.cc:493] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.927008  3832 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.931825  3832 raft_consensus.cc:515] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:30.934116  3832 leader_election.cc:290] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 4 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:30.935083  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:30.935751  3758 raft_consensus.cc:3055] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:30.935938  3906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f069ca0004f14127a2fdc22c83309afb" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:30.936149  3758 raft_consensus.cc:740] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:30.936600  3906 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.937017  3758 consensus_queue.cc:260] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:30.937867  3758 raft_consensus.cc:3060] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:30.941991  3906 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 4.
I20260709 12:19:30.942719  3908 raft_consensus.cc:1240] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Rejecting Update request from peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 for earlier term 3. Current term is 4. Ops: []
I20260709 12:19:30.942679  3758 raft_consensus.cc:2468] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 4.
I20260709 12:19:30.943542  3798 leader_election.cc:304] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:30.944386  4037 raft_consensus.cc:2804] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:30.946635  4037 raft_consensus.cc:697] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 LEADER]: Becoming Leader. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:30.948395  4037 consensus_queue.cc:237] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } }
I20260709 12:19:30.950593  4093 raft_consensus.cc:993] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: : Instructing follower 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:30.951068  4096 raft_consensus.cc:1081] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Signalling peer 50379fa2025d4df3b13dccaec8cfb9a8 to start an election
I20260709 12:19:30.953092  3832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9"
dest_uuid: "50379fa2025d4df3b13dccaec8cfb9a8"
 from {username='slave'} at 127.0.0.1:56720
I20260709 12:19:30.953627  3832 raft_consensus.cc:493] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.954018  3832 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.957430  3652 catalog_manager.cc:5697] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 reported cstate change: term changed from 3 to 4, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.960868  3832 raft_consensus.cc:515] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.962433  3832 leader_election.cc:290] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 3 election: Requested vote from peers ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631), 33cbf294014c4ca68c6c734bfa199528 (127.3.7.131:34675)
I20260709 12:19:30.963634  3908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33cbf294014c4ca68c6c734bfa199528"
I20260709 12:19:30.964267  3908 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.968116  3758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a32525d311d4dda9aac5066bd68d0d9" candidate_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2"
I20260709 12:19:30.968747  3758 raft_consensus.cc:3055] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:30.969081  3758 raft_consensus.cc:740] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff6ce19804ba4b7eaae7fa0f3c81bfe2, State: Running, Role: LEADER
I20260709 12:19:30.969817  3758 consensus_queue.cc:260] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.970603  3908 raft_consensus.cc:2468] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 3.
I20260709 12:19:30.971220  3758 raft_consensus.cc:3060] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:30.971668  3798 leader_election.cc:304] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33cbf294014c4ca68c6c734bfa199528, 50379fa2025d4df3b13dccaec8cfb9a8; no voters: 
I20260709 12:19:30.972432  4037 raft_consensus.cc:2804] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:30.972837  4037 raft_consensus.cc:697] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 LEADER]: Becoming Leader. State: Replica: 50379fa2025d4df3b13dccaec8cfb9a8, State: Running, Role: LEADER
I20260709 12:19:30.973690  4037 consensus_queue.cc:237] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } }
I20260709 12:19:30.978520  3758 raft_consensus.cc:2468] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50379fa2025d4df3b13dccaec8cfb9a8 in term 3.
I20260709 12:19:30.981309  3652 catalog_manager.cc:5697] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 reported cstate change: term changed from 2 to 3, leader changed from ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129) to 50379fa2025d4df3b13dccaec8cfb9a8 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.999037  3832 raft_consensus.cc:1275] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:31.000350  4036 consensus_queue.cc:1048] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:31.011526  3758 raft_consensus.cc:1275] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:31.013381  4036 consensus_queue.cc:1048] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:31.058470  3832 raft_consensus.cc:1275] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:31.059837  4036 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50379fa2025d4df3b13dccaec8cfb9a8" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:31.070756  3758 raft_consensus.cc:1275] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Refusing update from remote peer 33cbf294014c4ca68c6c734bfa199528: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:31.073168  4113 consensus_queue.cc:1048] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:31.378134  3908 raft_consensus.cc:1275] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:31.380024  4037 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:31.393249  3758 raft_consensus.cc:1275] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:31.395987  4037 consensus_queue.cc:1048] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:31.423084  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.429045  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:31.429525  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.543767  3758 raft_consensus.cc:1275] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:31.545411  4037 consensus_queue.cc:1048] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff6ce19804ba4b7eaae7fa0f3c81bfe2" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 40631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:31.554703  3908 raft_consensus.cc:1275] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Refusing update from remote peer 50379fa2025d4df3b13dccaec8cfb9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:31.558353  4037 consensus_queue.cc:1048] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33cbf294014c4ca68c6c734bfa199528" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:32.430913  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:32.436861  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:32.437304  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:33.438340  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:33.443624  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:33.444106  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:34.445266  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:34.451195  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:34.451809  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:35.452863  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:35.458379  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:35.458866  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:36.459904  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.465216  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:36.465706  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:37.466718  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:37.474520  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:37.475020  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:38.476145  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:38.482609  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:38.483039  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:39.483935  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.489200  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:39.489635  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:40.525274  3102 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:19:40.525880  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
I20260709 12:19:40.564903  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:40.565861  3102 tablet_replica.cc:333] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.566661  3102 raft_consensus.cc:2243] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.567271  3102 raft_consensus.cc:2272] T 952845377b324f77a8f9f02fdbb998bc P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.569942  3102 tablet_replica.cc:333] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.570648  3102 raft_consensus.cc:2243] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.571946  3102 raft_consensus.cc:2272] T d0b430ac3b724958a4bab6ec93f1e072 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.574183  3102 tablet_replica.cc:333] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.574796  3102 raft_consensus.cc:2243] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.575383  3102 raft_consensus.cc:2272] T b0bbaa925fbc460fa76bae4616b9a951 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.577638  3102 tablet_replica.cc:333] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.578369  3102 raft_consensus.cc:2243] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.579277  3102 raft_consensus.cc:2272] T 156a9f83969749be9bc1f71dbd9e6fc9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.582149  3102 tablet_replica.cc:333] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
W20260709 12:19:40.582360  3799 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:19:40.582998  3102 raft_consensus.cc:2243] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.584378  3102 raft_consensus.cc:2272] T 2101615869fc4b94b4a1422a57277ae9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:40.586097  3799 consensus_peers.cc:597] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 -> Peer ff6ce19804ba4b7eaae7fa0f3c81bfe2 (127.3.7.129:40631): Couldn't send request to peer ff6ce19804ba4b7eaae7fa0f3c81bfe2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:40.586969  3102 tablet_replica.cc:333] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.587637  3102 raft_consensus.cc:2243] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.588066  3102 raft_consensus.cc:2272] T 79b7a8c074924c329c762aa48c096780 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.590060  3102 tablet_replica.cc:333] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.590592  3102 raft_consensus.cc:2243] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.590991  3102 raft_consensus.cc:2272] T f069ca0004f14127a2fdc22c83309afb P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.593072  3102 tablet_replica.cc:333] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.593554  3102 raft_consensus.cc:2243] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.594388  3102 raft_consensus.cc:2272] T 9480d6d5004349f493257180b9dca416 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.596537  3102 tablet_replica.cc:333] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.597138  3102 raft_consensus.cc:2243] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.597585  3102 raft_consensus.cc:2272] T 9a32525d311d4dda9aac5066bd68d0d9 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.599493  3102 tablet_replica.cc:333] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2: stopping tablet replica
I20260709 12:19:40.599925  3102 raft_consensus.cc:2243] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.600332  3102 raft_consensus.cc:2272] T fb2d81fe0bca44cfb6061b5406113e74 P ff6ce19804ba4b7eaae7fa0f3c81bfe2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.637516  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
I20260709 12:19:40.658733  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
I20260709 12:19:40.693011  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:40.693946  3102 tablet_replica.cc:333] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.694662  3102 raft_consensus.cc:2243] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.695174  3102 raft_consensus.cc:2272] T 952845377b324f77a8f9f02fdbb998bc P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.697710  3102 tablet_replica.cc:333] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.698331  3102 raft_consensus.cc:2243] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.698796  3102 raft_consensus.cc:2272] T 156a9f83969749be9bc1f71dbd9e6fc9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.700819  3102 tablet_replica.cc:333] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.701377  3102 raft_consensus.cc:2243] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.701822  3102 raft_consensus.cc:2272] T 2101615869fc4b94b4a1422a57277ae9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.703783  3102 tablet_replica.cc:333] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.704319  3102 raft_consensus.cc:2243] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.704806  3102 raft_consensus.cc:2272] T d0b430ac3b724958a4bab6ec93f1e072 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.706465  3102 tablet_replica.cc:333] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.706940  3102 raft_consensus.cc:2243] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.707413  3102 raft_consensus.cc:2272] T 9480d6d5004349f493257180b9dca416 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.709002  3102 tablet_replica.cc:333] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.709487  3102 raft_consensus.cc:2243] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.710244  3102 raft_consensus.cc:2272] T f069ca0004f14127a2fdc22c83309afb P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.711838  3102 tablet_replica.cc:333] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.712334  3102 raft_consensus.cc:2243] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.713109  3102 raft_consensus.cc:2272] T 79b7a8c074924c329c762aa48c096780 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.714810  3102 tablet_replica.cc:333] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.715286  3102 raft_consensus.cc:2243] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.715804  3102 raft_consensus.cc:2272] T b0bbaa925fbc460fa76bae4616b9a951 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.717399  3102 tablet_replica.cc:333] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.717859  3102 raft_consensus.cc:2243] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.718284  3102 raft_consensus.cc:2272] T fb2d81fe0bca44cfb6061b5406113e74 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.719851  3102 tablet_replica.cc:333] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8: stopping tablet replica
I20260709 12:19:40.720288  3102 raft_consensus.cc:2243] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.720986  3102 raft_consensus.cc:2272] T 9a32525d311d4dda9aac5066bd68d0d9 P 50379fa2025d4df3b13dccaec8cfb9a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.750229  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
I20260709 12:19:40.773083  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
I20260709 12:19:40.813696  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:40.814422  3102 tablet_replica.cc:333] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.815050  3102 raft_consensus.cc:2243] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.815956  3102 raft_consensus.cc:2272] T b0bbaa925fbc460fa76bae4616b9a951 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.817932  3102 tablet_replica.cc:333] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.818463  3102 raft_consensus.cc:2243] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.819530  3102 raft_consensus.cc:2272] T 952845377b324f77a8f9f02fdbb998bc P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.821419  3102 tablet_replica.cc:333] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.821943  3102 raft_consensus.cc:2243] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.822310  3102 raft_consensus.cc:2272] T 156a9f83969749be9bc1f71dbd9e6fc9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.824115  3102 tablet_replica.cc:333] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.824594  3102 raft_consensus.cc:2243] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.824980  3102 raft_consensus.cc:2272] T 2101615869fc4b94b4a1422a57277ae9 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.826697  3102 tablet_replica.cc:333] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.827165  3102 raft_consensus.cc:2243] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.827641  3102 raft_consensus.cc:2272] T 79b7a8c074924c329c762aa48c096780 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.829242  3102 tablet_replica.cc:333] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.829939  3102 raft_consensus.cc:2243] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.830428  3102 raft_consensus.cc:2272] T f069ca0004f14127a2fdc22c83309afb P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.832229  3102 tablet_replica.cc:333] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.832724  3102 raft_consensus.cc:2243] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.833097  3102 raft_consensus.cc:2272] T 9480d6d5004349f493257180b9dca416 P 33cbf294014c4ca68c6c734bfa199528 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.834707  3102 tablet_replica.cc:333] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.835167  3102 raft_consensus.cc:2243] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.835683  3102 raft_consensus.cc:2272] T 9a32525d311d4dda9aac5066bd68d0d9 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.837234  3102 tablet_replica.cc:333] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.837675  3102 raft_consensus.cc:2243] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.838353  3102 raft_consensus.cc:2272] T fb2d81fe0bca44cfb6061b5406113e74 P 33cbf294014c4ca68c6c734bfa199528 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.840494  3102 tablet_replica.cc:333] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528: stopping tablet replica
I20260709 12:19:40.840984  3102 raft_consensus.cc:2243] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:40.841374  3102 raft_consensus.cc:2272] T d0b430ac3b724958a4bab6ec93f1e072 P 33cbf294014c4ca68c6c734bfa199528 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.872946  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
I20260709 12:19:40.894330  3102 master.cc:562] Master@127.3.7.190:32981 shutting down...
I20260709 12:19:40.927889  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:40.928665  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:40.929039  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5ce67fd0ee2e42389644ea2b3a527be7: stopping tablet replica
I20260709 12:19:40.949687  3102 master.cc:584] Master@127.3.7.190:32981 shutdown complete.
33cbf294014c4ca68c6c734bfa199528  1
50379fa2025d4df3b13dccaec8cfb9a8  4
ff6ce19804ba4b7eaae7fa0f3c81bfe2  5
33cbf294014c4ca68c6c734bfa199528  3
50379fa2025d4df3b13dccaec8cfb9a8  4
ff6ce19804ba4b7eaae7fa0f3c81bfe2  3
33cbf294014c4ca68c6c734bfa199528  1
50379fa2025d4df3b13dccaec8cfb9a8  1
ff6ce19804ba4b7eaae7fa0f3c81bfe2  8
33cbf294014c4ca68c6c734bfa199528  3
50379fa2025d4df3b13dccaec8cfb9a8  3
ff6ce19804ba4b7eaae7fa0f3c81bfe2  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28746 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:19:40.998008  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:34185
I20260709 12:19:40.999214  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:41.006081  4128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.006088  4129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.007385  4131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:41.008826  3102 server_base.cc:1061] running on GCE node
I20260709 12:19:41.009898  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:41.010083  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:41.010281  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599581010263 us; error 0 us; skew 500 ppm
I20260709 12:19:41.010895  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:41.013790  3102 webserver.cc:533] Webserver started at http://127.3.7.190:40685/ using document root <none> and password file <none>
I20260709 12:19:41.014312  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:41.014474  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:41.014828  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:41.016072  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "a6ff35c4ac1544009dec2b8d57867ced"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.020848  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:19:41.024560  4136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.025470  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:41.025808  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "a6ff35c4ac1544009dec2b8d57867ced"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.026111  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:41.043910  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:41.045176  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:41.095782  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:34185
I20260709 12:19:41.095927  4187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:34185 every 8 connection(s)
I20260709 12:19:41.100296  4188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.112650  4188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Bootstrap starting.
I20260709 12:19:41.118396  4188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.124047  4188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: No bootstrap required, opened a new log
I20260709 12:19:41.126724  4188 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ff35c4ac1544009dec2b8d57867ced" member_type: VOTER }
I20260709 12:19:41.127225  4188 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:41.127676  4188 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6ff35c4ac1544009dec2b8d57867ced, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.128518  4188 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ff35c4ac1544009dec2b8d57867ced" member_type: VOTER }
I20260709 12:19:41.129083  4188 raft_consensus.cc:399] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:41.129360  4188 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:41.129698  4188 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:41.135141  4188 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ff35c4ac1544009dec2b8d57867ced" member_type: VOTER }
I20260709 12:19:41.135865  4188 leader_election.cc:304] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6ff35c4ac1544009dec2b8d57867ced; no voters: 
I20260709 12:19:41.137212  4188 leader_election.cc:290] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:41.137697  4191 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:41.139249  4191 raft_consensus.cc:697] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 1 LEADER]: Becoming Leader. State: Replica: a6ff35c4ac1544009dec2b8d57867ced, State: Running, Role: LEADER
I20260709 12:19:41.139994  4191 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ff35c4ac1544009dec2b8d57867ced" member_type: VOTER }
I20260709 12:19:41.140599  4188 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:41.144995  4192 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6ff35c4ac1544009dec2b8d57867ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ff35c4ac1544009dec2b8d57867ced" member_type: VOTER } }
I20260709 12:19:41.145031  4193 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6ff35c4ac1544009dec2b8d57867ced. Latest consensus state: current_term: 1 leader_uuid: "a6ff35c4ac1544009dec2b8d57867ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6ff35c4ac1544009dec2b8d57867ced" member_type: VOTER } }
I20260709 12:19:41.145684  4192 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:41.145802  4193 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:41.148422  4197 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:41.153435  4197 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:41.160799  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:41.165019  4197 catalog_manager.cc:1383] Generated new cluster ID: b0b181f07765460a9b2c5c28a85d02f8
I20260709 12:19:41.165429  4197 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:41.192865  4197 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:41.194376  4197 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:41.210039  4197 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Generated new TSK 0
I20260709 12:19:41.210767  4197 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:41.232676  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:41.239727  4209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.241142  4210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.243938  4212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:41.244087  3102 server_base.cc:1061] running on GCE node
I20260709 12:19:41.245325  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:41.245822  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:41.246025  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599581246004 us; error 0 us; skew 500 ppm
I20260709 12:19:41.246760  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:41.249945  3102 webserver.cc:533] Webserver started at http://127.3.7.129:45361/ using document root <none> and password file <none>
I20260709 12:19:41.250558  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:41.250774  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:41.251108  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:41.252501  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "0aa405b398df42edbf74ee643aeb18dc"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.258497  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:19:41.262631  4217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.263628  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:41.264061  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "0aa405b398df42edbf74ee643aeb18dc"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.264427  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:41.283556  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:41.284794  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:41.286302  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:41.289335  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:41.289546  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.289933  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:41.290144  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.341341  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:34061
I20260709 12:19:41.341490  4281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:34061 every 8 connection(s)
I20260709 12:19:41.347371  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:41.355937  4286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.356907  4287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:41.382975  3102 server_base.cc:1061] running on GCE node
W20260709 12:19:41.383034  4290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:41.386080  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:41.386423  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:41.386698  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599581386670 us; error 0 us; skew 500 ppm
I20260709 12:19:41.387770  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:41.388015  4282 heartbeater.cc:344] Connected to a master server at 127.3.7.190:34185
I20260709 12:19:41.388665  4282 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:41.389818  4282 heartbeater.cc:507] Master 127.3.7.190:34185 requested a full tablet report, sending...
I20260709 12:19:41.393170  3102 webserver.cc:533] Webserver started at http://127.3.7.130:35613/ using document root <none> and password file <none>
I20260709 12:19:41.393325  4153 ts_manager.cc:194] Registered new tserver with Master: 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:19:41.394068  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:41.394419  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:41.394855  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:41.395931  4153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49190
I20260709 12:19:41.396899  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.403194  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:19:41.407626  4295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.408603  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:19:41.408919  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.409216  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:41.421739  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:41.423285  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:41.425118  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:41.428303  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:41.428567  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.428880  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:41.429078  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.484478  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:42725
I20260709 12:19:41.484598  4358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:42725 every 8 connection(s)
I20260709 12:19:41.491243  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:41.501088  4362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.503260  4363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:41.504668  4365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:41.506768  3102 server_base.cc:1061] running on GCE node
I20260709 12:19:41.506909  4359 heartbeater.cc:344] Connected to a master server at 127.3.7.190:34185
I20260709 12:19:41.507599  4359 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:41.508085  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:41.508344  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:41.508551  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599581508516 us; error 0 us; skew 500 ppm
I20260709 12:19:41.508595  4359 heartbeater.cc:507] Master 127.3.7.190:34185 requested a full tablet report, sending...
I20260709 12:19:41.509330  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:41.511412  4153 ts_manager.cc:194] Registered new tserver with Master: b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:41.512466  3102 webserver.cc:533] Webserver started at http://127.3.7.131:39931/ using document root <none> and password file <none>
I20260709 12:19:41.513121  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:41.513371  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:41.513367  4153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49194
I20260709 12:19:41.513901  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:41.515257  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "899897e6794541b5ab538af361fc9e6c"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.520136  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:41.524349  4370 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.525436  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:19:41.525811  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "899897e6794541b5ab538af361fc9e6c"
format_stamp: "Formatted at 2026-07-09 12:19:41 on dist-test-slave-6qf7"
I20260709 12:19:41.526080  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:41.541189  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:41.542729  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:41.544525  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:41.546813  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:41.546993  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:41.547291  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:41.547463  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:19:41.590118  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:36481
I20260709 12:19:41.590235  4433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:36481 every 8 connection(s)
I20260709 12:19:41.605177  4434 heartbeater.cc:344] Connected to a master server at 127.3.7.190:34185
I20260709 12:19:41.605525  4434 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:41.606307  4434 heartbeater.cc:507] Master 127.3.7.190:34185 requested a full tablet report, sending...
I20260709 12:19:41.608220  4153 ts_manager.cc:194] Registered new tserver with Master: 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:41.608330  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015031024s
I20260709 12:19:41.609736  4153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60310
I20260709 12:19:41.638903  4153 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60318:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:41.645546  4153 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:41.855892  4245 tablet_service.cc:1511] Processing CreateTablet for tablet dd8463b2beaf488989ffd8e005249050 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:41.856489  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 1c970994e11f4080b5624db5219101b4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:41.857714  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8463b2beaf488989ffd8e005249050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.858523  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c970994e11f4080b5624db5219101b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.859388  4244 tablet_service.cc:1511] Processing CreateTablet for tablet bf5e08eda6fd4363b1af431c73621515 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:41.860828  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e08eda6fd4363b1af431c73621515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.866106  4397 tablet_service.cc:1511] Processing CreateTablet for tablet dd8463b2beaf488989ffd8e005249050 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:41.867677  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8463b2beaf488989ffd8e005249050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.872643  4398 tablet_service.cc:1511] Processing CreateTablet for tablet 1c970994e11f4080b5624db5219101b4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:41.874130  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c970994e11f4080b5624db5219101b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.880770  4396 tablet_service.cc:1511] Processing CreateTablet for tablet bf5e08eda6fd4363b1af431c73621515 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:41.882206  4396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e08eda6fd4363b1af431c73621515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.882115  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 68963fca87f1465babfafe629c276422 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:41.883534  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68963fca87f1465babfafe629c276422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.918516  4243 tablet_service.cc:1511] Processing CreateTablet for tablet 2f35b6d3672d440581ae00175c31e5b7 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:41.920101  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f35b6d3672d440581ae00175c31e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.922595  4449 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:41.925323  4395 tablet_service.cc:1511] Processing CreateTablet for tablet 68963fca87f1465babfafe629c276422 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:41.935632  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68963fca87f1465babfafe629c276422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.929261  4323 tablet_service.cc:1511] Processing CreateTablet for tablet 1c970994e11f4080b5624db5219101b4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:41.939086  4319 tablet_service.cc:1511] Processing CreateTablet for tablet 2f35b6d3672d440581ae00175c31e5b7 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:41.940735  4323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c970994e11f4080b5624db5219101b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.929486  4322 tablet_service.cc:1511] Processing CreateTablet for tablet dd8463b2beaf488989ffd8e005249050 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:41.942273  4319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f35b6d3672d440581ae00175c31e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.943964  4322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8463b2beaf488989ffd8e005249050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.948570  4244 tablet_service.cc:1511] Processing CreateTablet for tablet 520cf0102a3945aebdd2da293d919a52 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:41.949955  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520cf0102a3945aebdd2da293d919a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.950408  4318 tablet_service.cc:1511] Processing CreateTablet for tablet 520cf0102a3945aebdd2da293d919a52 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:41.951828  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520cf0102a3945aebdd2da293d919a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.953282  4394 tablet_service.cc:1511] Processing CreateTablet for tablet 2f35b6d3672d440581ae00175c31e5b7 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:41.931347  4321 tablet_service.cc:1511] Processing CreateTablet for tablet bf5e08eda6fd4363b1af431c73621515 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:41.956653  4321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e08eda6fd4363b1af431c73621515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.933329  4320 tablet_service.cc:1511] Processing CreateTablet for tablet 68963fca87f1465babfafe629c276422 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:41.960671  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68963fca87f1465babfafe629c276422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.963021  4393 tablet_service.cc:1511] Processing CreateTablet for tablet 520cf0102a3945aebdd2da293d919a52 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:41.967540  4394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f35b6d3672d440581ae00175c31e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.968641  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520cf0102a3945aebdd2da293d919a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.970391  4449 tablet_bootstrap.cc:654] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:41.986980  4245 tablet_service.cc:1511] Processing CreateTablet for tablet b3c4a4b844fc4fd39fac73554dc3d8d8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:41.988430  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c4a4b844fc4fd39fac73554dc3d8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.011967  4319 tablet_service.cc:1511] Processing CreateTablet for tablet b3c4a4b844fc4fd39fac73554dc3d8d8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:42.012633  4451 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:42.013397  4319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c4a4b844fc4fd39fac73554dc3d8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.020402  4243 tablet_service.cc:1511] Processing CreateTablet for tablet 57d10956b3f84b66bce8c7e86299d1fa (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:42.021901  4317 tablet_service.cc:1511] Processing CreateTablet for tablet 57d10956b3f84b66bce8c7e86299d1fa (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:42.023877  4317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d10956b3f84b66bce8c7e86299d1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.024233  4398 tablet_service.cc:1511] Processing CreateTablet for tablet 57d10956b3f84b66bce8c7e86299d1fa (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:42.025492  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d10956b3f84b66bce8c7e86299d1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.025360  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 7092b1e5ebf04097a82982b4008c4d7e (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:42.022883  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d10956b3f84b66bce8c7e86299d1fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.028820  4450 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:42.035704  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092b1e5ebf04097a82982b4008c4d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.036279  4393 tablet_service.cc:1511] Processing CreateTablet for tablet b3c4a4b844fc4fd39fac73554dc3d8d8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:42.039772  4451 tablet_bootstrap.cc:654] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.043475  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c4a4b844fc4fd39fac73554dc3d8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.049402  4397 tablet_service.cc:1511] Processing CreateTablet for tablet 7092b1e5ebf04097a82982b4008c4d7e (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:42.050420  4245 tablet_service.cc:1511] Processing CreateTablet for tablet 0d57b9080cd745529aba05aa6b7a640e (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:42.051074  4450 tablet_bootstrap.cc:654] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.051853  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d57b9080cd745529aba05aa6b7a640e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.050853  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092b1e5ebf04097a82982b4008c4d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.044783  4318 tablet_service.cc:1511] Processing CreateTablet for tablet 7092b1e5ebf04097a82982b4008c4d7e (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:42.056043  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092b1e5ebf04097a82982b4008c4d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.069742  4449 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:42.070248  4449 ts_tablet_manager.cc:1403] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.148s	user 0.008s	sys 0.008s
I20260709 12:19:42.073591  4449 raft_consensus.cc:359] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.074664  4449 raft_consensus.cc:385] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.075007  4449 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.075934  4449 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.076846  4450 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:42.077294  4450 ts_tablet_manager.cc:1403] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 12:19:42.078472  4282 heartbeater.cc:499] Master 127.3.7.190:34185 was elected leader, sending a full tablet report...
I20260709 12:19:42.080307  4450 raft_consensus.cc:359] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.081306  4450 raft_consensus.cc:385] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.081634  4450 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.082441  4450 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.091858  4393 tablet_service.cc:1511] Processing CreateTablet for tablet 0d57b9080cd745529aba05aa6b7a640e (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:42.093232  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d57b9080cd745529aba05aa6b7a640e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.104773  4449 ts_tablet_manager.cc:1434] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:19:42.105877  4449 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:42.106145  4451 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:42.106627  4451 ts_tablet_manager.cc:1403] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.000s
I20260709 12:19:42.115965  4246 tablet_service.cc:1511] Processing CreateTablet for tablet b22e067af7004ed88fb3125c7ac731ad (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:42.117758  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22e067af7004ed88fb3125c7ac731ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.109473  4451 raft_consensus.cc:359] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.127931  4451 raft_consensus.cc:385] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.131826  4449 tablet_bootstrap.cc:654] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.129469  4318 tablet_service.cc:1511] Processing CreateTablet for tablet b22e067af7004ed88fb3125c7ac731ad (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:42.132679  4323 tablet_service.cc:1511] Processing CreateTablet for tablet 0d57b9080cd745529aba05aa6b7a640e (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:42.129060  4451 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.138724  4451 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.139377  4244 tablet_service.cc:1511] Processing CreateTablet for tablet c18183fd904d43f68b0e600ddb8ae249 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:42.141018  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18183fd904d43f68b0e600ddb8ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.149085  4450 ts_tablet_manager.cc:1434] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.071s	user 0.023s	sys 0.035s
I20260709 12:19:42.150004  4434 heartbeater.cc:499] Master 127.3.7.190:34185 was elected leader, sending a full tablet report...
I20260709 12:19:42.150291  4450 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:42.155424  4359 heartbeater.cc:499] Master 127.3.7.190:34185 was elected leader, sending a full tablet report...
W20260709 12:19:42.158208  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:42.158493  4319 tablet_service.cc:1511] Processing CreateTablet for tablet c18183fd904d43f68b0e600ddb8ae249 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:42.151656  4397 tablet_service.cc:1511] Processing CreateTablet for tablet b22e067af7004ed88fb3125c7ac731ad (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:42.162835  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22e067af7004ed88fb3125c7ac731ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.163003  4451 ts_tablet_manager.cc:1434] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.004s
I20260709 12:19:42.164099  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22e067af7004ed88fb3125c7ac731ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.164920  4451 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:42.167649  4323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d57b9080cd745529aba05aa6b7a640e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.173593  4394 tablet_service.cc:1511] Processing CreateTablet for tablet c18183fd904d43f68b0e600ddb8ae249 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:42.175879  4317 tablet_service.cc:1511] Processing CreateTablet for tablet 631cc1317abe4f99b307dee5289f9258 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:42.177147  4317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631cc1317abe4f99b307dee5289f9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.179461  4457 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.180068  4457 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.179701  4394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18183fd904d43f68b0e600ddb8ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.183512  4393 tablet_service.cc:1511] Processing CreateTablet for tablet 631cc1317abe4f99b307dee5289f9258 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:42.184058  4242 tablet_service.cc:1511] Processing CreateTablet for tablet bac26358ed7f4644aa3f5b040afcdca4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:42.193849  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631cc1317abe4f99b307dee5289f9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.198361  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 631cc1317abe4f99b307dee5289f9258 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:42.200873  4242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac26358ed7f4644aa3f5b040afcdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.204248  4322 tablet_service.cc:1511] Processing CreateTablet for tablet bac26358ed7f4644aa3f5b040afcdca4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:42.204448  4320 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8081e75d074f30b97f8a1542e86cec (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:42.208871  4398 tablet_service.cc:1511] Processing CreateTablet for tablet bac26358ed7f4644aa3f5b040afcdca4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:42.210246  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac26358ed7f4644aa3f5b040afcdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.210094  4395 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8081e75d074f30b97f8a1542e86cec (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:42.211313  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8081e75d074f30b97f8a1542e86cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.195353  4319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18183fd904d43f68b0e600ddb8ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.212375  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8081e75d074f30b97f8a1542e86cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.225980  4455 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.222313  4244 tablet_service.cc:1511] Processing CreateTablet for tablet 987201f60eb64f869c89f0703e622738 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:42.227725  4396 tablet_service.cc:1511] Processing CreateTablet for tablet 987201f60eb64f869c89f0703e622738 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:42.232434  4322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac26358ed7f4644aa3f5b040afcdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.229112  4245 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8081e75d074f30b97f8a1542e86cec (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:42.247857  4457 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:42.231181  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631cc1317abe4f99b307dee5289f9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.225521  4321 tablet_service.cc:1511] Processing CreateTablet for tablet 987201f60eb64f869c89f0703e622738 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:42.219288  4451 tablet_bootstrap.cc:654] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.251561  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987201f60eb64f869c89f0703e622738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.252295  4321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987201f60eb64f869c89f0703e622738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.254040  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8081e75d074f30b97f8a1542e86cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.254246  4396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987201f60eb64f869c89f0703e622738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.227813  4456 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.255805  4456 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.242892  4455 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.280712  4241 tablet_service.cc:1511] Processing CreateTablet for tablet 393ed0f79d194bc1a6199031055676bf (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:42.283938  4241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393ed0f79d194bc1a6199031055676bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.288157  4456 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:42.241287  4449 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:42.295940  4449 ts_tablet_manager.cc:1403] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.013s
I20260709 12:19:42.312911  4395 tablet_service.cc:1511] Processing CreateTablet for tablet 393ed0f79d194bc1a6199031055676bf (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:42.314327  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393ed0f79d194bc1a6199031055676bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.324733  4397 tablet_service.cc:1511] Processing CreateTablet for tablet a7d14a1bca614fe1af748ef119552803 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:42.328461  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d14a1bca614fe1af748ef119552803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.330163  4315 tablet_service.cc:1511] Processing CreateTablet for tablet b18524a049aa4e8687009c73a015e710 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:42.325460  4316 tablet_service.cc:1511] Processing CreateTablet for tablet a7d14a1bca614fe1af748ef119552803 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:42.331689  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18524a049aa4e8687009c73a015e710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.327088  4240 tablet_service.cc:1511] Processing CreateTablet for tablet b18524a049aa4e8687009c73a015e710 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:42.332711  4240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18524a049aa4e8687009c73a015e710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.340631  4455 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:42.313040  4323 tablet_service.cc:1511] Processing CreateTablet for tablet 393ed0f79d194bc1a6199031055676bf (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:42.379978  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d14a1bca614fe1af748ef119552803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.403466  4450 tablet_bootstrap.cc:654] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.408591  4392 tablet_service.cc:1511] Processing CreateTablet for tablet b18524a049aa4e8687009c73a015e710 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:42.410565  4392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18524a049aa4e8687009c73a015e710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.418159  4239 tablet_service.cc:1511] Processing CreateTablet for tablet a08fb4e151924fb6944c6a5f82c4f9d2 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:42.418526  4391 tablet_service.cc:1511] Processing CreateTablet for tablet a08fb4e151924fb6944c6a5f82c4f9d2 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:42.419757  4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb4e151924fb6944c6a5f82c4f9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.420571  4238 tablet_service.cc:1511] Processing CreateTablet for tablet e2742c399a2d4e5dae60161a45cce316 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:42.421957  4238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2742c399a2d4e5dae60161a45cce316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.424434  4390 tablet_service.cc:1511] Processing CreateTablet for tablet e2742c399a2d4e5dae60161a45cce316 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:42.424855  4239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb4e151924fb6944c6a5f82c4f9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.439617  4323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393ed0f79d194bc1a6199031055676bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.448438  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:42.457720  4296 leader_election.cc:343] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.451853  4389 tablet_service.cc:1511] Processing CreateTablet for tablet 446eb926cc6444ab93580e61ad7fc581 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:42.459062  4389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446eb926cc6444ab93580e61ad7fc581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.477588  4398 tablet_service.cc:1511] Processing CreateTablet for tablet 89ea196b53354b90b1803ebad82f35ff (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:42.486356  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:42.487341  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 89ea196b53354b90b1803ebad82f35ff (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 12:19:42.488169  4219 leader_election.cc:343] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.488857  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ea196b53354b90b1803ebad82f35ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.424427  4237 tablet_service.cc:1511] Processing CreateTablet for tablet 446eb926cc6444ab93580e61ad7fc581 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:42.491981  4392 tablet_service.cc:1511] Processing CreateTablet for tablet 53b63478950f49c4a21f85e72a0a2218 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:42.493430  4237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446eb926cc6444ab93580e61ad7fc581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.498107  4449 raft_consensus.cc:359] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.523697  4390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2742c399a2d4e5dae60161a45cce316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.499148  4449 raft_consensus.cc:385] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.558166  4450 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:42.558722  4450 ts_tablet_manager.cc:1403] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.409s	user 0.037s	sys 0.029s
I20260709 12:19:42.546394  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ea196b53354b90b1803ebad82f35ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.564064  4450 raft_consensus.cc:359] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.542263  4449 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.591981  4449 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.594523  4449 ts_tablet_manager.cc:1434] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.288s	user 0.004s	sys 0.004s
I20260709 12:19:42.595566  4449 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:42.609619  4450 raft_consensus.cc:385] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.610091  4450 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.613494  4244 tablet_service.cc:1511] Processing CreateTablet for tablet 53b63478950f49c4a21f85e72a0a2218 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:42.610989  4450 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.615016  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b63478950f49c4a21f85e72a0a2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.616618  4450 ts_tablet_manager.cc:1434] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.058s	user 0.013s	sys 0.004s
I20260709 12:19:42.617944  4450 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:42.633282  4244 tablet_service.cc:1511] Processing CreateTablet for tablet 752b8a9170934f31b770429d237cdb43 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:42.634825  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b8a9170934f31b770429d237cdb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.472534  4243 tablet_service.cc:1511] Processing CreateTablet for tablet a7d14a1bca614fe1af748ef119552803 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:42.639197  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:42.641059  4372 leader_election.cc:343] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.639216  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d14a1bca614fe1af748ef119552803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.658473  4450 tablet_bootstrap.cc:654] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.664216  4451 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:42.664865  4451 ts_tablet_manager.cc:1403] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.500s	user 0.008s	sys 0.025s
I20260709 12:19:42.677861  4451 raft_consensus.cc:359] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.678614  4451 raft_consensus.cc:385] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.678918  4451 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.679035  4392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b63478950f49c4a21f85e72a0a2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.683037  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:42.683382  4138 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 257676us
I20260709 12:19:42.689605  4314 tablet_service.cc:1511] Processing CreateTablet for tablet 89ea196b53354b90b1803ebad82f35ff (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:42.689957  4315 tablet_service.cc:1511] Processing CreateTablet for tablet a08fb4e151924fb6944c6a5f82c4f9d2 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:42.691112  4314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ea196b53354b90b1803ebad82f35ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.695703  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb4e151924fb6944c6a5f82c4f9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.695870  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:42.696552  4409 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:42.698082  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:42.698678  4257 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:42.701175  4321 tablet_service.cc:1511] Processing CreateTablet for tablet e070006215b747e39d88b78e59a78364 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:42.702420  4321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e070006215b747e39d88b78e59a78364. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:42.703760  4296 leader_election.cc:343] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.704072  4218 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:42.704262  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:42.705256  4455 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.705412  4457 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.705641  4455 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.706055  4455 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.713269  4455 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.714632  4449 tablet_bootstrap.cc:654] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.715863  4319 tablet_service.cc:1511] Processing CreateTablet for tablet 53b63478950f49c4a21f85e72a0a2218 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:42.716193  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:42.724782  4318 tablet_service.cc:1511] Processing CreateTablet for tablet e2742c399a2d4e5dae60161a45cce316 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 12:19:42.725215  4219 leader_election.cc:343] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.717170  4371 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:42.718649  4450 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:42.726171  4450 ts_tablet_manager.cc:1403] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.000s
I20260709 12:19:42.726367  4459 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.726740  4459 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.727051  4459 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.727195  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:42.729068  4450 raft_consensus.cc:359] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.729722  4450 raft_consensus.cc:385] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.730005  4450 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.718551  4455 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:42.731709  4455 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.732137  4455 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.732511  4451 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.730746  4450 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.734292  4455 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:42.739167  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:42.736152  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2742c399a2d4e5dae60161a45cce316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.758847  4314 tablet_service.cc:1511] Processing CreateTablet for tablet 752b8a9170934f31b770429d237cdb43 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:42.772430  4321 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8c0670d52b4df8ad46e1549814b7a8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 12:19:42.860764  4219 leader_election.cc:343] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.779706  4315 tablet_service.cc:1511] Processing CreateTablet for tablet 01f50fa8d8c34c06a67470615046629f (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:42.782541  4322 tablet_service.cc:1511] Processing CreateTablet for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:42.844446  4317 tablet_service.cc:1511] Processing CreateTablet for tablet 446eb926cc6444ab93580e61ad7fc581 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:42.860898  4321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c0670d52b4df8ad46e1549814b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.772888  4316 tablet_service.cc:1511] Processing CreateTablet for tablet a2c18c2d1c094cb9a849a72508c8962f (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:42.862699  4322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.863757  4317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446eb926cc6444ab93580e61ad7fc581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.864425  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c18c2d1c094cb9a849a72508c8962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.871337  4240 tablet_service.cc:1511] Processing CreateTablet for tablet a2c18c2d1c094cb9a849a72508c8962f (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:42.872881  4240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c18c2d1c094cb9a849a72508c8962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.877352  4243 tablet_service.cc:1511] Processing CreateTablet for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:42.877843  4244 tablet_service.cc:1511] Processing CreateTablet for tablet 01f50fa8d8c34c06a67470615046629f (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:42.878688  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.880159  4246 tablet_service.cc:1511] Processing CreateTablet for tablet e070006215b747e39d88b78e59a78364 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:42.880417  4241 tablet_service.cc:1511] Processing CreateTablet for tablet 374e8fa3690a41af9874f32b270bf3e1 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:42.881502  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e070006215b747e39d88b78e59a78364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.882550  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f50fa8d8c34c06a67470615046629f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.883430  4450 ts_tablet_manager.cc:1434] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.157s	user 0.009s	sys 0.001s
I20260709 12:19:42.884501  4450 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:42.888445  4318 tablet_service.cc:1511] Processing CreateTablet for tablet 374e8fa3690a41af9874f32b270bf3e1 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:42.891628  4241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374e8fa3690a41af9874f32b270bf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.892124  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374e8fa3690a41af9874f32b270bf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.893213  4450 tablet_bootstrap.cc:654] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:42.897959  4451 ts_tablet_manager.cc:1434] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.233s	user 0.009s	sys 0.002s
I20260709 12:19:42.898988  4451 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:42.901245  4320 tablet_service.cc:1511] Processing CreateTablet for tablet a0fa0b9753bf4f05871dfa6b329de33a (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:42.902654  4456 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.903128  4456 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.905236  4456 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:42.905763  4391 tablet_service.cc:1511] Processing CreateTablet for tablet 752b8a9170934f31b770429d237cdb43 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:42.906587  4390 tablet_service.cc:1511] Processing CreateTablet for tablet 01f50fa8d8c34c06a67470615046629f (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:42.908385  4392 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8c0670d52b4df8ad46e1549814b7a8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:42.909578  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:42.910235  4257 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:42.910604  4396 tablet_service.cc:1511] Processing CreateTablet for tablet a2c18c2d1c094cb9a849a72508c8962f (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:42.911540  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:42.912748  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:42.912806  4398 tablet_service.cc:1511] Processing CreateTablet for tablet e070006215b747e39d88b78e59a78364 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 12:19:42.914381  4372 leader_election.cc:343] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:42.915139  4393 tablet_service.cc:1511] Processing CreateTablet for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:42.916512  4238 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8c0670d52b4df8ad46e1549814b7a8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:42.917023  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fa0b9753bf4f05871dfa6b329de33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.917471  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:42.917870  4238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c0670d52b4df8ad46e1549814b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.918156  4408 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:42.923583  4456 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.923983  4456 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.924356  4456 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.926991  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f50fa8d8c34c06a67470615046629f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.928975  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:42.930235  4455 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:42.930620  4455 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.930975  4455 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:42.907143  4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b8a9170934f31b770429d237cdb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.935617  4390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f50fa8d8c34c06a67470615046629f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.942168  4392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c0670d52b4df8ad46e1549814b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.942847  4396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c18c2d1c094cb9a849a72508c8962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.944357  4395 tablet_service.cc:1511] Processing CreateTablet for tablet 374e8fa3690a41af9874f32b270bf3e1 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:42.945683  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374e8fa3690a41af9874f32b270bf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.946981  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.948072  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e070006215b747e39d88b78e59a78364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.947988  4394 tablet_service.cc:1511] Processing CreateTablet for tablet be5f00fff96847178a1970711feff2f0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:42.949316  4394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5f00fff96847178a1970711feff2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.951054  4239 tablet_service.cc:1511] Processing CreateTablet for tablet a0fa0b9753bf4f05871dfa6b329de33a (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:42.952312  4242 tablet_service.cc:1511] Processing CreateTablet for tablet b9d53e2537c9446fb3bf3c50fc0d5556 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:42.952325  4239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fa0b9753bf4f05871dfa6b329de33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.953361  4245 tablet_service.cc:1511] Processing CreateTablet for tablet 1abb211136c54a29beecc019715aaa2d (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:42.954011  4389 tablet_service.cc:1511] Processing CreateTablet for tablet b9d53e2537c9446fb3bf3c50fc0d5556 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:42.954808  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abb211136c54a29beecc019715aaa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.955474  4242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d53e2537c9446fb3bf3c50fc0d5556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.956872  4397 tablet_service.cc:1511] Processing CreateTablet for tablet a0fa0b9753bf4f05871dfa6b329de33a (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:42.957594  4243 tablet_service.cc:1511] Processing CreateTablet for tablet be5f00fff96847178a1970711feff2f0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:42.966466  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5f00fff96847178a1970711feff2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.961211  4459 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.978962  4409 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:42.971868  4314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b8a9170934f31b770429d237cdb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.984386  4449 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:42.984542  4218 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:42.985076  4449 ts_tablet_manager.cc:1403] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.390s	user 0.021s	sys 0.000s
I20260709 12:19:42.985914  4472 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:42.976372  4389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d53e2537c9446fb3bf3c50fc0d5556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.988538  4449 raft_consensus.cc:359] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.989297  4449 raft_consensus.cc:385] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:42.989509  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fa0b9753bf4f05871dfa6b329de33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.989646  4449 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.990482  4449 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.966364  4323 tablet_service.cc:1511] Processing CreateTablet for tablet be5f00fff96847178a1970711feff2f0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:42.992102  4323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5f00fff96847178a1970711feff2f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.992944  4449 ts_tablet_manager.cc:1434] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:19:42.996271  4455 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:42.998508  4455 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:42.999375  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:43.000447  4459 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:43.002894  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:43.003724  4257 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:19:43.004954  4219 leader_election.cc:343] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.006165  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:43.007658  4372 leader_election.cc:343] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.008100  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.009490  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:43.010322  4459 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.033156  4459 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.033682  4459 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.036465  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:43.037294  4449 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
W20260709 12:19:43.037985  4371 leader_election.cc:343] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.040141  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:43.040731  4334 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:43.041850  4372 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:43.045193  4459 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:43.046496  4459 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.046857  4459 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.048995  4459 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.018838  4321 tablet_service.cc:1511] Processing CreateTablet for tablet b9d53e2537c9446fb3bf3c50fc0d5556 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:43.055399  4319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b63478950f49c4a21f85e72a0a2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.065212  4451 tablet_bootstrap.cc:654] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:43.093019  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51262us
I20260709 12:19:43.093987  4394 tablet_service.cc:1511] Processing CreateTablet for tablet 1abb211136c54a29beecc019715aaa2d (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:43.094337  4240 tablet_service.cc:1511] Processing CreateTablet for tablet 90175b58ea034e69b889717ca0ad0333 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:43.095288  4394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abb211136c54a29beecc019715aaa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.095600  4240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90175b58ea034e69b889717ca0ad0333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.103209  4449 tablet_bootstrap.cc:654] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.118098  4450 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:43.118634  4450 ts_tablet_manager.cc:1403] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.234s	user 0.009s	sys 0.005s
I20260709 12:19:43.105683  4318 tablet_service.cc:1511] Processing CreateTablet for tablet 1abb211136c54a29beecc019715aaa2d (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:43.127012  4395 tablet_service.cc:1511] Processing CreateTablet for tablet 34ae0ae4c14d4870b094e2733b40e647 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:43.128563  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ae0ae4c14d4870b094e2733b40e647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.129453  4323 tablet_service.cc:1511] Processing CreateTablet for tablet 34ae0ae4c14d4870b094e2733b40e647 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:43.109109  4321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d53e2537c9446fb3bf3c50fc0d5556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.133162  4450 raft_consensus.cc:359] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.133863  4237 tablet_service.cc:1511] Processing CreateTablet for tablet 34ae0ae4c14d4870b094e2733b40e647 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:43.135998  4242 tablet_service.cc:1511] Processing CreateTablet for tablet 7b29d30a957d40fdbc729fc5e9955b1b (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:43.139014  4244 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa28105446e4c7c9261f9a99c5dc017 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:43.144187  4391 tablet_service.cc:1511] Processing CreateTablet for tablet 90175b58ea034e69b889717ca0ad0333 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:43.146615  4398 tablet_service.cc:1511] Processing CreateTablet for tablet 7b29d30a957d40fdbc729fc5e9955b1b (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:43.154352  4450 raft_consensus.cc:385] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.131347  4456 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.163420  4317 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4dedbb3ee0412db92c974e0c25a776 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:43.165071  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abb211136c54a29beecc019715aaa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.167542  4238 tablet_service.cc:1511] Processing CreateTablet for tablet 853b8c508a614bb4b9fdc0c62fe13342 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:43.168817  4238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853b8c508a614bb4b9fdc0c62fe13342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.170759  4409 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:43.174257  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:43.175022  4257 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:43.158820  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4dedbb3ee0412db92c974e0c25a776 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:43.162120  4450 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.176211  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4dedbb3ee0412db92c974e0c25a776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.176620  4450 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.178821  4456 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:43.179057  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:43.170828  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:19:43.180495  4372 leader_election.cc:343] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.180933  4372 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.182106  4475 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.184875  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa28105446e4c7c9261f9a99c5dc017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.187638  4241 tablet_service.cc:1511] Processing CreateTablet for tablet f77d531cd9f54dcbb332d1ff622d8443 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:43.189033  4241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77d531cd9f54dcbb332d1ff622d8443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.189615  4242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b29d30a957d40fdbc729fc5e9955b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.178900  4450 ts_tablet_manager.cc:1434] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 12:19:43.195960  4455 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.196527  4455 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.197579  4323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ae0ae4c14d4870b094e2733b40e647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.199326  4455 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.200760  4390 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa28105446e4c7c9261f9a99c5dc017 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:43.201049  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:43.206363  4219 leader_election.cc:343] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.207659  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.210373  4322 tablet_service.cc:1511] Processing CreateTablet for tablet 7b29d30a957d40fdbc729fc5e9955b1b (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:43.196941  4314 tablet_service.cc:1511] Processing CreateTablet for tablet 6aa28105446e4c7c9261f9a99c5dc017 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:43.211776  4322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b29d30a957d40fdbc729fc5e9955b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.212209  4455 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.195181  4243 tablet_service.cc:1511] Processing CreateTablet for tablet c75e006bba424d8b9ae7dfa589237877 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:43.170712  4392 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4dedbb3ee0412db92c974e0c25a776 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:43.221974  4237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ae0ae4c14d4870b094e2733b40e647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.219151  4317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4dedbb3ee0412db92c974e0c25a776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.228523  4451 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:43.229058  4451 ts_tablet_manager.cc:1403] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.330s	user 0.018s	sys 0.000s
I20260709 12:19:43.231964  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e006bba424d8b9ae7dfa589237877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.232577  4320 tablet_service.cc:1511] Processing CreateTablet for tablet 853b8c508a614bb4b9fdc0c62fe13342 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:43.241415  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:43.242071  4449 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:43.242201  4408 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:43.242580  4449 ts_tablet_manager.cc:1403] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.013s
I20260709 12:19:43.243825  4218 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.244166  4239 tablet_service.cc:1511] Processing CreateTablet for tablet 795c79b77a3c478183b1eaf256f074d5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:43.245445  4455 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.245911  4455 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.246248  4455 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.245534  4449 raft_consensus.cc:359] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.247794  4449 raft_consensus.cc:385] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.239763  4315 tablet_service.cc:1511] Processing CreateTablet for tablet 90175b58ea034e69b889717ca0ad0333 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:43.248103  4449 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.247453  4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90175b58ea034e69b889717ca0ad0333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.250876  4242 tablet_service.cc:1511] Processing CreateTablet for tablet 01644bc7ce5c458c882adfcf42aa8d83 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:43.249012  4449 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.255576  4451 raft_consensus.cc:359] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.256349  4451 raft_consensus.cc:385] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.256683  4450 tablet_bootstrap.cc:492] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:43.257484  4396 tablet_service.cc:1511] Processing CreateTablet for tablet 853b8c508a614bb4b9fdc0c62fe13342 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:43.258952  4396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853b8c508a614bb4b9fdc0c62fe13342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.260655  4393 tablet_service.cc:1511] Processing CreateTablet for tablet f77d531cd9f54dcbb332d1ff622d8443 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:43.261955  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77d531cd9f54dcbb332d1ff622d8443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.262554  4392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4dedbb3ee0412db92c974e0c25a776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.266898  4450 tablet_bootstrap.cc:654] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.256698  4451 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.270454  4451 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.271011  4390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa28105446e4c7c9261f9a99c5dc017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.273159  4245 tablet_service.cc:1511] Processing CreateTablet for tablet 8afcac1f47834987ac3889edd37f61a3 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:43.275707  4389 tablet_service.cc:1511] Processing CreateTablet for tablet c75e006bba424d8b9ae7dfa589237877 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:43.277004  4389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e006bba424d8b9ae7dfa589237877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.287701  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b29d30a957d40fdbc729fc5e9955b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.287701  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90175b58ea034e69b889717ca0ad0333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.286934  4316 tablet_service.cc:1511] Processing CreateTablet for tablet f77d531cd9f54dcbb332d1ff622d8443 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:43.300282  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77d531cd9f54dcbb332d1ff622d8443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.307632  4314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa28105446e4c7c9261f9a99c5dc017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.245445  4239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c79b77a3c478183b1eaf256f074d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.289974  4455 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.311630  4242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01644bc7ce5c458c882adfcf42aa8d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.313356  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:43.313805  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcac1f47834987ac3889edd37f61a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:43.314858  4219 leader_election.cc:343] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.290316  4397 tablet_service.cc:1511] Processing CreateTablet for tablet 795c79b77a3c478183b1eaf256f074d5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:43.290957  4449 ts_tablet_manager.cc:1434] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:19:43.319579  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853b8c508a614bb4b9fdc0c62fe13342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.319878  4449 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:43.323913  4455 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.325173  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:43.325832  4408 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.326581  4390 tablet_service.cc:1511] Processing CreateTablet for tablet 01644bc7ce5c458c882adfcf42aa8d83 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:43.327907  4390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01644bc7ce5c458c882adfcf42aa8d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.331938  4316 tablet_service.cc:1511] Processing CreateTablet for tablet c75e006bba424d8b9ae7dfa589237877 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:43.335832  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e006bba424d8b9ae7dfa589237877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.336709  4449 tablet_bootstrap.cc:654] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.338004  4408 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:43.340245  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c79b77a3c478183b1eaf256f074d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.310715  4459 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.362094  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:19:43.363574  4371 leader_election.cc:343] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.364603  4459 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:43.365768  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:43.366405  4334 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.373737  4334 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:43.375078  4372 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:43.376133  4218 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.377321  4455 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.377874  4455 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:43.378749  4455 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.377395  4395 tablet_service.cc:1511] Processing CreateTablet for tablet 8afcac1f47834987ac3889edd37f61a3 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:43.381218  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcac1f47834987ac3889edd37f61a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.382020  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 4c52d75f63d54dbeba6b3c868117e4c4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:43.355062  4319 tablet_service.cc:1511] Processing CreateTablet for tablet 795c79b77a3c478183b1eaf256f074d5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:43.387616  4459 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.388252  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c52d75f63d54dbeba6b3c868117e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.388417  4319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c79b77a3c478183b1eaf256f074d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.389582  4240 tablet_service.cc:1511] Processing CreateTablet for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:43.384387  4237 tablet_service.cc:1511] Processing CreateTablet for tablet 7935718b80b24232b822244ef31fa44b (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:19:43.396852  4137 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52524.7us
I20260709 12:19:43.408998  4244 tablet_service.cc:1511] Processing CreateTablet for tablet d97e8a8c644540508f2457db68e20be8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:43.420066  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 78ee025f73f248629704f4ff6eaad5a0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:43.391703  4459 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:43.409515  4240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.432662  4450 tablet_bootstrap.cc:492] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:43.433784  4153 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:43.409809  4138 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 56978.4us
I20260709 12:19:43.438925  4238 tablet_service.cc:1511] Processing CreateTablet for tablet 7d321543daa94c458a2b9ed5e9d553a3 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:43.439880  4315 tablet_service.cc:1511] Processing CreateTablet for tablet 78ee025f73f248629704f4ff6eaad5a0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:43.441447  4242 tablet_service.cc:1511] Processing CreateTablet for tablet ff19d9953d5b4cddb487ccf873740dee (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:43.442600  4320 tablet_service.cc:1511] Processing CreateTablet for tablet 7935718b80b24232b822244ef31fa44b (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:43.465595  4389 tablet_service.cc:1511] Processing CreateTablet for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:43.466935  4389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.467476  4449 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:43.467952  4449 ts_tablet_manager.cc:1403] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.007s
I20260709 12:19:43.467268  4394 tablet_service.cc:1511] Processing CreateTablet for tablet 78ee025f73f248629704f4ff6eaad5a0 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:43.445562  4318 tablet_service.cc:1511] Processing CreateTablet for tablet 7d321543daa94c458a2b9ed5e9d553a3 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:43.452438  4450 ts_tablet_manager.cc:1403] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.006s
I20260709 12:19:43.471488  4394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ee025f73f248629704f4ff6eaad5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.471547  4317 tablet_service.cc:1511] Processing CreateTablet for tablet 4c52d75f63d54dbeba6b3c868117e4c4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:43.472934  4243 tablet_service.cc:1511] Processing CreateTablet for tablet 6675e0fefdad403abd03803e0c2bf3dd (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:43.472949  4449 raft_consensus.cc:359] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.473838  4449 raft_consensus.cc:385] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.473659  4450 raft_consensus.cc:359] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.474193  4449 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.474406  4450 raft_consensus.cc:385] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.474756  4450 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.475620  4450 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.475957  4391 tablet_service.cc:1511] Processing CreateTablet for tablet ff19d9953d5b4cddb487ccf873740dee (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:43.477649  4459 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.478528  4450 ts_tablet_manager.cc:1434] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:19:43.475636  4449 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.457218  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ee025f73f248629704f4ff6eaad5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.457548  4451 ts_tablet_manager.cc:1434] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.228s	user 0.011s	sys 0.005s
I20260709 12:19:43.457950  4393 tablet_service.cc:1511] Processing CreateTablet for tablet 7935718b80b24232b822244ef31fa44b (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:43.436318  4392 tablet_service.cc:1511] Processing CreateTablet for tablet d97e8a8c644540508f2457db68e20be8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:43.460100  4316 tablet_service.cc:1511] Processing CreateTablet for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:43.464710  4321 tablet_service.cc:1511] Processing CreateTablet for tablet d97e8a8c644540508f2457db68e20be8 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:43.408035  4323 tablet_service.cc:1511] Processing CreateTablet for tablet 01644bc7ce5c458c882adfcf42aa8d83 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:43.444828  4241 tablet_service.cc:1511] Processing CreateTablet for tablet fd41dc8658414bcfb8662c0efe3caffc (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:43.477180  4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff19d9953d5b4cddb487ccf873740dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.488583  4451 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:43.489852  4450 tablet_bootstrap.cc:492] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:43.491158  4449 ts_tablet_manager.cc:1434] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:19:43.495600  4321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e8a8c644540508f2457db68e20be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.470963  4314 tablet_service.cc:1511] Processing CreateTablet for tablet ff19d9953d5b4cddb487ccf873740dee (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:43.500100  4323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01644bc7ce5c458c882adfcf42aa8d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.501179  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d321543daa94c458a2b9ed5e9d553a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.502699  4390 tablet_service.cc:1511] Processing CreateTablet for tablet 7d321543daa94c458a2b9ed5e9d553a3 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:43.503218  4449 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:43.507098  4238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d321543daa94c458a2b9ed5e9d553a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.514133  4392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e8a8c644540508f2457db68e20be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.513854  4322 tablet_service.cc:1511] Processing CreateTablet for tablet 8afcac1f47834987ac3889edd37f61a3 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:43.514797  4393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7935718b80b24232b822244ef31fa44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.519438  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.523526  4320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7935718b80b24232b822244ef31fa44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.527357  4315 tablet_service.cc:1511] Processing CreateTablet for tablet 709bcc39a1e14a66abd5e1d758132d0a (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:43.528206  4396 tablet_service.cc:1511] Processing CreateTablet for tablet 4c52d75f63d54dbeba6b3c868117e4c4 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:43.529007  4314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff19d9953d5b4cddb487ccf873740dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.529686  4396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c52d75f63d54dbeba6b3c868117e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.529876  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709bcc39a1e14a66abd5e1d758132d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.533079  4398 tablet_service.cc:1511] Processing CreateTablet for tablet 6675e0fefdad403abd03803e0c2bf3dd (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:43.514111  4243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6675e0fefdad403abd03803e0c2bf3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.480679  4245 tablet_service.cc:1511] Processing CreateTablet for tablet 709bcc39a1e14a66abd5e1d758132d0a (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:43.506599  4451 tablet_bootstrap.cc:654] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.534982  4241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd41dc8658414bcfb8662c0efe3caffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.535756  4242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff19d9953d5b4cddb487ccf873740dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.539613  4237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7935718b80b24232b822244ef31fa44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.547622  4244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e8a8c644540508f2457db68e20be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.547853  4315 tablet_service.cc:1511] Processing CreateTablet for tablet fdb68505c01944fb98aa2334aa5c28e9 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:43.548396  4322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcac1f47834987ac3889edd37f61a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.549109  4315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb68505c01944fb98aa2334aa5c28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.549582  4245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709bcc39a1e14a66abd5e1d758132d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.532429  4390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d321543daa94c458a2b9ed5e9d553a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.550335  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ee025f73f248629704f4ff6eaad5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.570837  4246 tablet_service.cc:1511] Processing CreateTablet for tablet fdb68505c01944fb98aa2334aa5c28e9 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:43.570721  4317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c52d75f63d54dbeba6b3c868117e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.572074  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb68505c01944fb98aa2334aa5c28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.573378  4450 tablet_bootstrap.cc:654] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.577203  4239 tablet_service.cc:1511] Processing CreateTablet for tablet c64033b0103b421a95ee1540d4b31df5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:43.578514  4239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64033b0103b421a95ee1540d4b31df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.582937  4455 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.583425  4455 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.584048  4395 tablet_service.cc:1511] Processing CreateTablet for tablet fdb68505c01944fb98aa2334aa5c28e9 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:43.585568  4455 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.587234  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:43.588071  4334 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:43.589412  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:43.590307  4455 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:43.590642  4455 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.590972  4455 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.594303  4246 tablet_service.cc:1511] Processing CreateTablet for tablet 6bee4570f5474c8f916b3144395312d5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:43.595505  4246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bee4570f5474c8f916b3144395312d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.595603  4449 tablet_bootstrap.cc:654] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.603547  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:43.606830  4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6675e0fefdad403abd03803e0c2bf3dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:43.606115  4218 leader_election.cc:343] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.617993  4392 tablet_service.cc:1511] Processing CreateTablet for tablet 709bcc39a1e14a66abd5e1d758132d0a (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:43.618790  4455 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.621762  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:43.622370  4334 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.623734  4479 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.624387  4479 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.628360  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:43.629153  4257 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:43.629585  4479 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.630160  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:43.630930  4408 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:43.632786  4296 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:43.636041  4479 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.642379  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:43.643257  4397 tablet_service.cc:1511] Processing CreateTablet for tablet fd41dc8658414bcfb8662c0efe3caffc (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:43.644829  4451 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:43.645320  4451 ts_tablet_manager.cc:1403] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.008s
W20260709 12:19:43.647971  4218 leader_election.cc:343] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.649029  4459 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.649492  4459 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.651643  4459 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:43.651813  4334 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:43.658583  4451 raft_consensus.cc:359] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.660277  4451 raft_consensus.cc:385] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.660454  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:43.660660  4451 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.661563  4451 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.661716  4389 tablet_service.cc:1511] Processing CreateTablet for tablet c64033b0103b421a95ee1540d4b31df5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:43.663049  4389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64033b0103b421a95ee1540d4b31df5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:43.664202  4372 leader_election.cc:343] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.664299  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:43.665710  4371 leader_election.cc:343] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.666141  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.666853  4391 tablet_service.cc:1511] Processing CreateTablet for tablet 6bee4570f5474c8f916b3144395312d5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:43.668113  4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bee4570f5474c8f916b3144395312d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.668041  4459 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.672068  4322 tablet_service.cc:1511] Processing CreateTablet for tablet fd41dc8658414bcfb8662c0efe3caffc (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:43.673367  4322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd41dc8658414bcfb8662c0efe3caffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.662568  4152 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.732336  4392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709bcc39a1e14a66abd5e1d758132d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.654498  4455 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.698772  4319 tablet_service.cc:1511] Processing CreateTablet for tablet 6675e0fefdad403abd03803e0c2bf3dd (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:43.741281  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:19:43.742955  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080016aee0 after lost signal to thread 3105
W20260709 12:19:43.744453  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08001695c0 after lost signal to thread 4187
W20260709 12:19:43.746048  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08000946e0 after lost signal to thread 4281
I20260709 12:19:43.747664  4397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd41dc8658414bcfb8662c0efe3caffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.741815  4319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6675e0fefdad403abd03803e0c2bf3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.736321  4479 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.753573  4449 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:43.754534  4449 ts_tablet_manager.cc:1403] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.252s	user 0.005s	sys 0.011s
W20260709 12:19:43.751327  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080019efe0 after lost signal to thread 4358
W20260709 12:19:43.757412  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08000a82e0 after lost signal to thread 4433
I20260709 12:19:43.761116  4395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb68505c01944fb98aa2334aa5c28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.767882  4449 raft_consensus.cc:359] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.768688  4449 raft_consensus.cc:385] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.768996  4449 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.769771  4449 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.781634  4316 tablet_service.cc:1511] Processing CreateTablet for tablet c64033b0103b421a95ee1540d4b31df5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:43.783092  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64033b0103b421a95ee1540d4b31df5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:43.783654  4485 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:19:43.794086  4318 tablet_service.cc:1511] Processing CreateTablet for tablet 6bee4570f5474c8f916b3144395312d5 (DEFAULT_TABLE table=test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:43.797120  4450 tablet_bootstrap.cc:492] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:43.797749  4450 ts_tablet_manager.cc:1403] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.318s	user 0.031s	sys 0.039s
I20260709 12:19:43.751776  4455 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:43.803929  4318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bee4570f5474c8f916b3144395312d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:43.806444  4451 ts_tablet_manager.cc:1434] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.161s	user 0.022s	sys 0.021s
I20260709 12:19:43.816035  4449 ts_tablet_manager.cc:1434] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.003s
I20260709 12:19:43.803527  4455 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:43.835834  4323 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55244 (request call id 44) took 1017 ms. Trace:
I20260709 12:19:43.838581  4455 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.838218  4323 rpcz_store.cc:276] 0709 12:19:42.817966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.407013 (+589047us) service_pool.cc:224] Handling call
0709 12:19:43.491919 (+ 84906us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5db2831 00007fdbb5d8fac3 00007fdbb5d3e400 00007fdbaf1c3af4 00007fdbaf1c3a82 00007fdbaf1c39b1
0709 12:19:43.492047 (+   128us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:43.492129 (+    82us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:43.681363 (+189234us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:43.822278 (+140915us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:43.835768 (+ 13490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11271552}
I20260709 12:19:43.837747  4321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55244 (request call id 46) took 1014 ms. Trace:
I20260709 12:19:43.829698  4449 tablet_bootstrap.cc:492] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:43.829210  4451 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:43.859351  4449 tablet_bootstrap.cc:654] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.842507  4321 rpcz_store.cc:276] 0709 12:19:42.822936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.419388 (+596452us) service_pool.cc:224] Handling call
0709 12:19:43.491146 (+ 71758us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:19:43.491236 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:19:43.644961 (+153725us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:43.837288 (+192327us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:43.837689 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:43.863063  4450 raft_consensus.cc:359] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.863849  4450 raft_consensus.cc:385] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.864085  4451 tablet_bootstrap.cc:654] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.864151  4450 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.865074  4450 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.869163  4488 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.869681  4488 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.872072  4488 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.874145  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:43.875344  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:43.876901  4296 leader_election.cc:343] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.867213  4450 ts_tablet_manager.cc:1434] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.069s	user 0.002s	sys 0.002s
I20260709 12:19:43.878872  4450 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
W20260709 12:19:43.879212  4296 leader_election.cc:343] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:43.879676  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:43.880714  4488 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.887748  4450 tablet_bootstrap.cc:654] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.890518  4449 tablet_bootstrap.cc:492] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:43.891204  4449 ts_tablet_manager.cc:1403] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.003s
I20260709 12:19:43.890347  4153 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.897987  4455 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.895109  4449 raft_consensus.cc:359] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.900523  4449 raft_consensus.cc:385] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.900907  4449 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.911623  4449 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.914860  4449 ts_tablet_manager.cc:1434] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.007s
I20260709 12:19:43.916268  4449 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:43.925712  4449 tablet_bootstrap.cc:654] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.928932  4459 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:43.929936  4450 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:43.930454  4450 ts_tablet_manager.cc:1403] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.009s
I20260709 12:19:43.935940  4450 raft_consensus.cc:359] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.936687  4450 raft_consensus.cc:385] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.937005  4450 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.937976  4450 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.945822  4449 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:43.946343  4450 ts_tablet_manager.cc:1434] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:19:43.946506  4449 ts_tablet_manager.cc:1403] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
W20260709 12:19:43.946707  4219 consensus_peers.cc:597] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:43.947450  4450 tablet_bootstrap.cc:492] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:43.947376  4455 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.947911  4455 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.949539  4449 raft_consensus.cc:359] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.950129  4257 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:43.952181  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:43.950204  4449 raft_consensus.cc:385] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:43.953974  4449 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.954413  4455 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:43.954643  4449 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:43.956794  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:43.957280  4449 ts_tablet_manager.cc:1434] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:43.958269  4449 tablet_bootstrap.cc:492] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:43.958630  4219 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:43.959200  4475 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:43.959477  4472 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:43.959846  4450 tablet_bootstrap.cc:654] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.969265  4449 tablet_bootstrap.cc:654] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:43.990922  4450 tablet_bootstrap.cc:492] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:43.991425  4450 ts_tablet_manager.cc:1403] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.005s
I20260709 12:19:44.006192  4449 tablet_bootstrap.cc:492] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.006804  4449 ts_tablet_manager.cc:1403] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.002s
I20260709 12:19:44.008484  4450 raft_consensus.cc:359] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.009210  4450 raft_consensus.cc:385] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.009492  4450 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.013077  4450 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:44.017274  4360 tablet.cc:2406] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:44.017855  4450 ts_tablet_manager.cc:1434] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:19:44.018756  4450 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.036043  4450 tablet_bootstrap.cc:654] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.039914  4449 raft_consensus.cc:359] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.044755  4449 raft_consensus.cc:385] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.044821  4451 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.045282  4449 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.045678  4451 ts_tablet_manager.cc:1403] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.217s	user 0.047s	sys 0.059s
I20260709 12:19:44.046312  4449 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.049037  4449 ts_tablet_manager.cc:1434] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 12:19:44.049997  4449 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.050140  4451 raft_consensus.cc:359] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.051180  4451 raft_consensus.cc:385] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.051589  4451 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.052723  4451 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.056239  4451 ts_tablet_manager.cc:1434] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:19:44.057859  4451 tablet_bootstrap.cc:492] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.067047  4451 tablet_bootstrap.cc:654] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.088753  4451 tablet_bootstrap.cc:492] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.089407  4451 ts_tablet_manager.cc:1403] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 12:19:44.101419  4449 tablet_bootstrap.cc:654] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.101763  4450 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.102267  4450 ts_tablet_manager.cc:1403] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.005s
I20260709 12:19:44.104576  4507 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.105105  4507 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.107470  4507 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.108671  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.109022  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.109366  4256 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:44.109210  4450 raft_consensus.cc:359] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.109928  4333 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:44.110126  4450 raft_consensus.cc:385] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.110565  4450 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.110460  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:44.111642  4475 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.112074  4475 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.112511  4475 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.115247  4455 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.115751  4455 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.117715  4451 raft_consensus.cc:359] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.118465  4451 raft_consensus.cc:385] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.118784  4451 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.119022  4450 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.119494  4451 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.120180  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.120868  4333 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.121742  4451 ts_tablet_manager.cc:1434] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 12:19:44.122244  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:44.122731  4451 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.123164  4472 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.123588  4472 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.123924  4472 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.118047  4455 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.130389  4451 tablet_bootstrap.cc:654] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.132467  4472 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.134855  4450 ts_tablet_manager.cc:1434] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:19:44.135526  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:44.139889  4333 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.136709  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.138825  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:44.159474  4408 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.160143  4506 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.160578  4506 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.139387  4472 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.158970  4333 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:44.162767  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:44.165072  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.166149  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.167092  4334 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:44.167587  4449 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.168031  4449 ts_tablet_manager.cc:1403] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.004s
I20260709 12:19:44.168715  4506 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.163938  4472 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.172966  4472 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:44.170972  4449 raft_consensus.cc:359] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.175326  4449 raft_consensus.cc:385] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.175701  4449 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.175928  4450 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.177004  4449 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.180295  4449 ts_tablet_manager.cc:1434] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 12:19:44.183003  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:44.183207  4449 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.174012  4472 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.184322  4451 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.184821  4451 ts_tablet_manager.cc:1403] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.031s
I20260709 12:19:44.187744  4451 raft_consensus.cc:359] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.188438  4451 raft_consensus.cc:385] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.188737  4451 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.189661  4451 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.176937  4475 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.191121  4449 tablet_bootstrap.cc:654] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.195616  4450 tablet_bootstrap.cc:654] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.197613  4475 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.197705  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:44.203622  4257 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.198560  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:44.207625  4333 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.200026  4371 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.212421  4475 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.201330  4451 ts_tablet_manager.cc:1434] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:19:44.217187  4451 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.223964  4451 tablet_bootstrap.cc:654] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.227320  4152 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.231700  4472 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.232244  4472 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.232990  4257 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:44.234308  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:44.234462  4472 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.235179  4475 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.235384  4506 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.222892  4333 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:44.235875  4506 raft_consensus.cc:697] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:44.236726  4506 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.237195  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:44.238783  4219 leader_election.cc:343] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.240200  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.240828  4408 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.241683  4449 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.242134  4449 ts_tablet_manager.cc:1403] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.006s
I20260709 12:19:44.242012  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.243235  4472 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.243680  4472 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.244091  4472 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.248875  4449 raft_consensus.cc:359] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.249699  4449 raft_consensus.cc:385] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.250025  4449 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.250471  4451 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.251008  4451 ts_tablet_manager.cc:1403] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:19:44.251147  4449 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.254493  4449 ts_tablet_manager.cc:1434] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:19:44.254191  4451 raft_consensus.cc:359] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.254940  4451 raft_consensus.cc:385] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.255225  4451 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.256049  4451 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.255692  4449 tablet_bootstrap.cc:492] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.263234  4450 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.266757  4450 ts_tablet_manager.cc:1403] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.005s
I20260709 12:19:44.268093  4449 tablet_bootstrap.cc:654] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.267493  4451 ts_tablet_manager.cc:1434] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:19:44.268122  4472 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.270714  4472 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.273380  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:44.273691  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:44.274037  4449 tablet_bootstrap.cc:492] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.274024  4408 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.274981  4451 tablet_bootstrap.cc:492] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
W20260709 12:19:44.276160  4219 leader_election.cc:343] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.276965  4450 raft_consensus.cc:359] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.281405  4450 raft_consensus.cc:385] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.281708  4450 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.282205  4451 tablet_bootstrap.cc:654] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.282528  4449 ts_tablet_manager.cc:1403] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.002s
I20260709 12:19:44.282539  4450 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.284250  4488 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.284719  4488 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.285607  4449 raft_consensus.cc:359] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.286300  4449 raft_consensus.cc:385] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.286572  4449 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.287268  4488 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.288594  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.288830  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.291926  4409 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:44.293133  4450 ts_tablet_manager.cc:1434] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:19:44.294102  4450 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.294291  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:44.295619  4506 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.296310  4506 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.282210  4408 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:44.287392  4449 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.300918  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.301254  4450 tablet_bootstrap.cc:654] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.301527  4449 ts_tablet_manager.cc:1434] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:19:44.302440  4449 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.303478  4257 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:44.304550  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.305177  4256 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:44.290369  4150 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:44.306641  4372 leader_election.cc:343] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.307464  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.308308  4475 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.308660  4475 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.308987  4475 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.313503  4449 tablet_bootstrap.cc:654] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.315763  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.316883  4472 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.317363  4472 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:44.317546  4488 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.318234  4472 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.318998  4506 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.321884  4475 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.318199  4488 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.327271  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:44.328812  4372 leader_election.cc:343] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.327271  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:44.330224  4475 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.330926  4256 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.329378  4488 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.338116  4488 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.338459  4488 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.338817  4488 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.333245  4451 tablet_bootstrap.cc:492] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.332795  4450 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.341457  4450 ts_tablet_manager.cc:1403] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.018s
I20260709 12:19:44.341403  4451 ts_tablet_manager.cc:1403] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.003s
I20260709 12:19:44.343791  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.344547  4257 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:44.345255  4450 raft_consensus.cc:359] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.345937  4450 raft_consensus.cc:385] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.346202  4450 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.346292  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.347153  4408 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:44.346936  4450 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.348443  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:44.350602  4519 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.352824  4450 ts_tablet_manager.cc:1434] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:44.353842  4450 tablet_bootstrap.cc:492] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.355974  4256 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:44.357728  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.358098  4472 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.358220  4451 raft_consensus.cc:359] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.358930  4451 raft_consensus.cc:385] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.359203  4451 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.359391  4475 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.359917  4475 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:44.359905  4451 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.360877  4475 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.358593  4472 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.362851  4519 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.364929  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:44.366407  4219 leader_election.cc:343] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.369446  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.369995  4488 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:44.371013  4218 leader_election.cc:343] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.371526  4218 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.372617  4455 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.373345  4472 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.374218  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:44.375103  4256 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.375825  4150 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.369473  4450 tablet_bootstrap.cc:654] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.384744  4256 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:44.386024  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:44.386879  4519 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.387557  4519 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:44.390709  4519 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.392192  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:44.393083  4408 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.399628  4472 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.399627  4488 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.400568  4472 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.401417  4153 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:44.401741  4408 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:44.393165  4451 ts_tablet_manager.cc:1434] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.051s	user 0.021s	sys 0.013s
I20260709 12:19:44.404484  4472 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.406191  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.406920  4408 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.406102  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.407922  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:19:44.408471  4219 leader_election.cc:343] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.408694  4472 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.409077  4472 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.409427  4472 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.410840  4449 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.411633  4449 ts_tablet_manager.cc:1403] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.003s
I20260709 12:19:44.414636  4449 raft_consensus.cc:359] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.415254  4449 raft_consensus.cc:385] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.416087  4150 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.417035  4472 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.421285  4449 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.422081  4449 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.423225  4472 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.421005  4451 tablet_bootstrap.cc:492] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.419916  4450 tablet_bootstrap.cc:492] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.430644  4450 ts_tablet_manager.cc:1403] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.017s
I20260709 12:19:44.431141  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:44.431826  4408 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.442498  4449 ts_tablet_manager.cc:1434] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:19:44.444026  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:44.445783  4219 leader_election.cc:343] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.450677  4451 tablet_bootstrap.cc:654] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.450994  4409 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.455158  4450 raft_consensus.cc:359] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.455873  4450 raft_consensus.cc:385] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.456143  4450 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.456895  4450 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.462046  4449 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.465571  4408 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:44.462471  4472 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.466718  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.466998  4450 ts_tablet_manager.cc:1434] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 12:19:44.467517  4472 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.468814  4472 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:44.469748  4472 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.476723  4449 tablet_bootstrap.cc:654] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.480589  4450 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.483588  4455 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:44.492391  4451 tablet_bootstrap.cc:492] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.492880  4451 ts_tablet_manager.cc:1403] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.003s
I20260709 12:19:44.492820  4152 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.495664  4451 raft_consensus.cc:359] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.497988  4333 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.512532  4451 raft_consensus.cc:385] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.513017  4451 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.513880  4451 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.516060  4451 ts_tablet_manager.cc:1434] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:19:44.520567  4449 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.524077  4451 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.524418  4449 ts_tablet_manager.cc:1403] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.006s
I20260709 12:19:44.527503  4449 raft_consensus.cc:359] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.529378  4449 raft_consensus.cc:385] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.529718  4449 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.530411  4449 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.532474  4449 ts_tablet_manager.cc:1434] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:44.529091  4450 tablet_bootstrap.cc:654] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.535580  4455 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.536144  4449 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.536093  4455 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.542866  4449 tablet_bootstrap.cc:654] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.543386  4455 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.544869  4450 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.545074  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.545293  4450 ts_tablet_manager.cc:1403] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.001s
W20260709 12:19:44.546715  4219 leader_election.cc:343] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.548470  4450 raft_consensus.cc:359] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.549129  4450 raft_consensus.cc:385] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.549409  4450 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.550050  4450 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.552347  4450 ts_tablet_manager.cc:1434] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:44.552901  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.553220  4450 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
W20260709 12:19:44.555846  4218 leader_election.cc:343] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.556352  4218 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.557129  4472 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.561146  4451 tablet_bootstrap.cc:654] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.563356  4450 tablet_bootstrap.cc:654] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.576825  4451 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.577555  4451 ts_tablet_manager.cc:1403] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.005s
I20260709 12:19:44.576994  4449 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.578320  4449 ts_tablet_manager.cc:1403] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.004s
I20260709 12:19:44.581229  4451 raft_consensus.cc:359] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.584494  4451 raft_consensus.cc:385] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.584906  4451 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.585767  4451 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.586191  4449 raft_consensus.cc:359] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.587606  4449 raft_consensus.cc:385] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.587965  4449 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.589469  4449 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.591921  4449 ts_tablet_manager.cc:1434] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:44.593012  4449 tablet_bootstrap.cc:492] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.594301  4451 ts_tablet_manager.cc:1434] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:19:44.595467  4451 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.600939  4450 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.601456  4450 ts_tablet_manager.cc:1403] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.013s
I20260709 12:19:44.604198  4450 raft_consensus.cc:359] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.604903  4450 raft_consensus.cc:385] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.605180  4450 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.605857  4450 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.608043  4450 ts_tablet_manager.cc:1434] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:44.609227  4451 tablet_bootstrap.cc:654] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.611860  4450 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.618693  4450 tablet_bootstrap.cc:654] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.624806  4449 tablet_bootstrap.cc:654] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.636034  4533 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.639953  4451 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.640538  4451 ts_tablet_manager.cc:1403] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.012s
I20260709 12:19:44.641743  4449 tablet_bootstrap.cc:492] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.642306  4449 ts_tablet_manager.cc:1403] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.001s
I20260709 12:19:44.644593  4451 raft_consensus.cc:359] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.645224  4449 raft_consensus.cc:359] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.645664  4451 raft_consensus.cc:385] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.645962  4449 raft_consensus.cc:385] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.646296  4451 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.647508  4451 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.649744  4451 ts_tablet_manager.cc:1434] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:44.646306  4449 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.651521  4451 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.651051  4449 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.653357  4449 ts_tablet_manager.cc:1434] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:44.649950  4450 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.653905  4450 ts_tablet_manager.cc:1403] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.007s
I20260709 12:19:44.656584  4450 raft_consensus.cc:359] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.657285  4450 raft_consensus.cc:385] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.657557  4450 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.658818  4449 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.658861  4451 tablet_bootstrap.cc:654] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.665138  4449 tablet_bootstrap.cc:654] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.666005  4450 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.668104  4475 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.668617  4475 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.670771  4475 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.672048  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.672706  4333 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:44.674700  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:44.676414  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.677076  4256 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:44.679491  4475 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:44.679893  4449 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.680405  4449 ts_tablet_manager.cc:1403] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 12:19:44.681133  4533 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.681612  4533 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.683142  4449 raft_consensus.cc:359] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.683763  4533 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.679906  4475 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.684507  4475 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.685886  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.668182  4450 ts_tablet_manager.cc:1434] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:19:44.688447  4450 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.688252  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.688939  4333 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.690373  4219 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:19:44.692868  4218 leader_election.cc:343] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.693116  4475 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.694085  4533 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.694712  4533 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.696744  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:44.697351  4256 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.698766  4450 tablet_bootstrap.cc:654] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.699991  4472 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.704221  4519 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.695164  4533 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.683830  4449 raft_consensus.cc:385] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.693926  4506 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.704789  4519 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.706041  4449 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.706813  4519 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.712145  4506 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.688225  4451 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.712641  4506 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.713779  4449 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.714663  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.715698  4408 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:44.719864  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.720279  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.721728  4451 ts_tablet_manager.cc:1403] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.000s
W20260709 12:19:44.722052  4371 leader_election.cc:343] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.722185  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:44.723801  4519 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.728569  4506 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.729004  4256 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:19:44.730170  4371 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:44.731465  4449 ts_tablet_manager.cc:1434] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:19:44.732416  4449 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.733893  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.731592  4506 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:44.735591  4372 leader_election.cc:343] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.736281  4372 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.738612  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:44.739266  4331 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.742334  4533 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.745205  4549 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.737193  4519 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.748085  4331 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:19:44.750398  4506 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:44.751386  4506 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.735881  4475 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:44.753466  4475 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.754829  4451 raft_consensus.cc:359] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.755553  4455 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.755831  4451 raft_consensus.cc:385] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.760483  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:44.760708  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:44.766353  4330 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:44.767027  4218 leader_election.cc:343] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.761456  4533 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.772225  4450 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.773097  4450 ts_tablet_manager.cc:1403] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.008s
I20260709 12:19:44.774538  4330 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:44.775843  4219 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:44.775955  4450 raft_consensus.cc:359] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.776618  4450 raft_consensus.cc:385] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.777217  4451 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.777493  4450 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.778237  4450 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.779142  4451 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.780998  4450 ts_tablet_manager.cc:1434] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:44.781890  4450 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.781975  4451 ts_tablet_manager.cc:1434] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:19:44.783492  4451 tablet_bootstrap.cc:492] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.780998  4545 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.785609  4545 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:44.789247  4450 tablet_bootstrap.cc:654] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.790679  4545 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.796789  4449 tablet_bootstrap.cc:654] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.797061  4152 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 2, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:44.801964  4451 tablet_bootstrap.cc:654] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.817987  4455 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:44.829871  4519 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.830430  4519 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.832940  4519 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.835592  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.837592  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.838368  4256 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:44.840554  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:44.844235  4519 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.849309  4523 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:44.853361  4519 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.848312  4151 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.858371  4449 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:44.858819  4449 ts_tablet_manager.cc:1403] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.127s	user 0.005s	sys 0.009s
I20260709 12:19:44.859422  4519 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.859879  4519 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.861413  4449 raft_consensus.cc:359] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.863771  4449 raft_consensus.cc:385] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.864041  4449 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.864372  4450 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:44.862987  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.865271  4450 ts_tablet_manager.cc:1403] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.084s	user 0.040s	sys 0.032s
I20260709 12:19:44.865413  4409 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:44.863040  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.868048  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:44.868515  4450 raft_consensus.cc:359] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.868961  4523 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.869210  4450 raft_consensus.cc:385] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.869535  4450 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.870286  4450 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.871445  4545 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.871937  4545 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.872597  4450 ts_tablet_manager.cc:1434] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:44.873489  4450 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:44.875082  4455 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.875587  4455 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.877207  4488 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.878033  4488 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.878511  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.879192  4409 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.880035  4488 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.880515  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:44.881369  4472 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:44.881524  4523 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.881757  4472 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.882192  4472 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.883646  4450 tablet_bootstrap.cc:654] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:44.884266  4545 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.883635  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:44.884336  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.885214  4449 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.885643  4533 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.861858  4519 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:44.888923  4219 leader_election.cc:343] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.890182  4451 tablet_bootstrap.cc:492] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:44.890756  4451 ts_tablet_manager.cc:1403] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.005s
I20260709 12:19:44.886065  4533 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.892143  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.892781  4533 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.892791  4409 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:44.895344  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:44.896561  4455 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.897974  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.898198  4488 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:44.898319  4296 leader_election.cc:343] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.898566  4488 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.899569  4488 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.898008  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:44.900349  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.900943  4409 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:44.900691  4472 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:44.901278  4219 leader_election.cc:343] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:44.901978  4219 leader_election.cc:343] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.902460  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.902761  4472 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:44.904933  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:44.906136  4451 raft_consensus.cc:359] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:44.906618  4219 leader_election.cc:343] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.906811  4451 raft_consensus.cc:385] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:44.907117  4451 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.907015  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:44.907373  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:44.907673  4408 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.907866  4451 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.903259  4472 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:44.915591  4218 leader_election.cc:343] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:44.915818  4472 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.916134  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.920796  4455 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:44.922163  4472 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:44.926353  4408 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:44.946708  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:44.947636  4455 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:44.948190  4455 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:44.949307  4455 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.956040  4545 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:44.926523  4523 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:19:44.926899  4488 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.966717  4449 ts_tablet_manager.cc:1434] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.108s	user 0.017s	sys 0.025s
I20260709 12:19:44.968149  4449 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:44.988483  4451 ts_tablet_manager.cc:1434] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.097s	user 0.014s	sys 0.011s
I20260709 12:19:44.992432  4451 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:44.996362  4549 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.997884  4549 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:44.994879  4550 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:45.000067  4549 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.001895  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:19:45.004484  4296 leader_election.cc:343] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.005837  4550 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:45.005735  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.008316  4450 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.050189  4450 ts_tablet_manager.cc:1403] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.048s
I20260709 12:19:45.050588  4449 tablet_bootstrap.cc:654] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:45.052845  4372 leader_election.cc:343] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.009867  4561 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:19:45.012235  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.010938  4488 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.078341  4450 raft_consensus.cc:359] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.080098  4450 raft_consensus.cc:385] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.080487  4450 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.010249  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.083232  4408 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.088258  4451 tablet_bootstrap.cc:654] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.095351  4450 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.027593  4151 catalog_manager.cc:5697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.097093  4488 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:45.106321  4371 leader_election.cc:343] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.106989  4371 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.112259  4450 ts_tablet_manager.cc:1434] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.001s
I20260709 12:19:45.116675  4450 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.111897  4550 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.111259  4472 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.108155  4488 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.130056  4472 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:45.133344  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 54057.6us
I20260709 12:19:45.179242  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.180259  4407 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.208093  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.209249  4406 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:45.210965  4332 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:45.217900  4506 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.218503  4506 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.227644  4561 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.228296  4561 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.230583  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.245151  4533 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.245880  4533 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.247030  4549 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.247668  4549 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.156005  4488 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.249042  4533 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.253980  4549 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.255376  4449 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:45.255952  4449 ts_tablet_manager.cc:1403] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.288s	user 0.038s	sys 0.031s
I20260709 12:19:45.258183  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:45.259786  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:19:45.262152  4219 leader_election.cc:343] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.263991  4488 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.264199  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.264812  4255 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:45.268013  4561 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.269685  4506 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.272099  4451 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.283589  4451 ts_tablet_manager.cc:1403] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.294s	user 0.037s	sys 0.046s
I20260709 12:19:45.286240  4451 raft_consensus.cc:359] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.286927  4451 raft_consensus.cc:385] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.287204  4451 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.274266  4407 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:45.274518  4450 tablet_bootstrap.cc:654] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.287987  4451 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.258842  4449 raft_consensus.cc:359] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.290439  4449 raft_consensus.cc:385] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.271160  4488 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.275840  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.276535  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.277161  4549 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.279403  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.279673  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.280566  4408 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:45.266374  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:19:45.282379  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:45.290611  4451 ts_tablet_manager.cc:1434] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:45.290761  4449 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.318692  4451 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:45.319530  4330 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:45.320786  4219 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:19:45.321758  4219 leader_election.cc:343] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.322361  4545 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:45.322728  4545 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.312592  4450 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.323087  4545 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.323644  4450 ts_tablet_manager.cc:1403] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.002s
W20260709 12:19:45.324311  4372 leader_election.cc:343] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.326507  4450 raft_consensus.cc:359] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.327469  4450 raft_consensus.cc:385] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.327749  4450 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
W20260709 12:19:45.328591  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 62292us
I20260709 12:19:45.329767  4450 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.331511  4475 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:45.332007  4450 ts_tablet_manager.cc:1434] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:45.332638  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.333015  4450 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.332880  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.333595  4257 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:45.333767  4561 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.334259  4561 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:45.331902  4475 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.334973  4475 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.319171  4449 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.335127  4561 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.331928  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.340529  4331 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:45.340492  4408 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:45.341077  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.341356  4451 tablet_bootstrap.cc:654] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.337226  4449 ts_tablet_manager.cc:1434] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.007s
I20260709 12:19:45.342514  4449 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:45.342363  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:45.338333  4545 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.343662  4488 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.344183  4488 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:45.345041  4488 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.346103  4475 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.347482  4407 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 2: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:45.348658  4450 tablet_bootstrap.cc:654] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.348562  4218 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.349051  4545 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.349655  4545 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.350015  4545 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.350350  4545 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.350451  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.351325  4506 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.351734  4506 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.352111  4506 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.350855  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:45.362716  4332 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:45.360682  4533 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.372082  4407 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.381286  4255 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:45.384163  4450 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.384822  4450 ts_tablet_manager.cc:1403] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.007s
I20260709 12:19:45.385000  4550 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.387779  4450 raft_consensus.cc:359] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.388523  4450 raft_consensus.cc:385] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.388815  4450 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.389845  4450 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.392177  4450 ts_tablet_manager.cc:1434] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:45.393097  4450 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.394294  4449 tablet_bootstrap.cc:654] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.395573  4550 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.396085  4550 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.398518  4550 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.399151  4451 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.361858  4506 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.399609  4451 ts_tablet_manager.cc:1403] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.005s
I20260709 12:19:45.401284  4506 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.402288  4545 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.403252  4451 raft_consensus.cc:359] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.404219  4451 raft_consensus.cc:385] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.404548  4451 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.405443  4451 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.405839  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:45.358315  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.365790  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:45.407400  4219 leader_election.cc:343] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.365922  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:45.408187  4451 ts_tablet_manager.cc:1434] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:19:45.408587  4257 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 2: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:45.409263  4451 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:45.410282  4475 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.399595  4450 tablet_bootstrap.cc:654] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.413389  4545 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.414470  4408 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 2: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:45.418313  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:45.419010  4330 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.423830  4451 tablet_bootstrap.cc:654] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.424566  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.427194  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:45.427826  4257 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.428929  4450 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.428875  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.429520  4450 ts_tablet_manager.cc:1403] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.002s
I20260709 12:19:45.430305  4562 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.430886  4562 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.432713  4450 raft_consensus.cc:359] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.433255  4562 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.433452  4450 raft_consensus.cc:385] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.433753  4450 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.435554  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.436237  4256 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:45.437500  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:45.435029  4450 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.438774  4523 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.439196  4523 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.439636  4523 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.440488  4450 ts_tablet_manager.cc:1434] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:19:45.442785  4450 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.444608  4330 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:45.448484  4449 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:45.449080  4449 ts_tablet_manager.cc:1403] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.007s
I20260709 12:19:45.450807  4451 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.451368  4451 ts_tablet_manager.cc:1403] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.008s
I20260709 12:19:45.452404  4449 raft_consensus.cc:359] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.453182  4449 raft_consensus.cc:385] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.453485  4449 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
W20260709 12:19:45.430316  4372 leader_election.cc:343] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.454411  4449 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.454859  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:45.455065  4451 raft_consensus.cc:359] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.455811  4451 raft_consensus.cc:385] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.456146  4451 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.456193  4585 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.456568  4332 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:19:45.456811  4449 ts_tablet_manager.cc:1434] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:19:45.456900  4585 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:45.457774  4449 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:45.457984  4219 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:45.459015  4472 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:45.458508  4585 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.459514  4472 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:45.460088  4450 tablet_bootstrap.cc:654] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.460369  4472 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.448925  4523 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.463616  4451 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.464385  4449 tablet_bootstrap.cc:654] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.465834  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:45.466219  4451 ts_tablet_manager.cc:1434] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:45.466488  4255 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.467252  4451 tablet_bootstrap.cc:492] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:45.453368  4257 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:45.488657  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.489503  4408 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.493991  4475 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.494679  4475 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.494848  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.496374  4549 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:45.488097  4255 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
W20260709 12:19:45.498340  4371 leader_election.cc:343] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.498732  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:45.516633  4149 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.525199  4562 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.528927  4562 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:45.529860  4562 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.513868  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.542852  4451 tablet_bootstrap.cc:654] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.545385  4549 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.537892  4545 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:19:45.556972  4523 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:45.562134  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63847.5us
I20260709 12:19:45.583520  4472 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.584300  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.593150  4573 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.593802  4573 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.599887  4450 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.600449  4450 ts_tablet_manager.cc:1403] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.158s	user 0.009s	sys 0.014s
I20260709 12:19:45.601768  4573 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.589677  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.610682  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.591840  4475 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:45.595607  4408 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
W20260709 12:19:45.612744  4219 leader_election.cc:343] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.614789  4472 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:45.619158  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.621693  4372 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.622977  4585 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:45.627446  4152 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:45.632189  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.635380  4218 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.635388  4153 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.639637  4572 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.640168  4572 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:45.642482  4449 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:45.643095  4449 ts_tablet_manager.cc:1403] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.186s	user 0.034s	sys 0.002s
I20260709 12:19:45.641047  4572 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.653043  4450 raft_consensus.cc:359] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.653677  4450 raft_consensus.cc:385] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.653903  4450 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.654596  4450 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:45.650839  4218 leader_election.cc:343] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.657994  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.664677  4218 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.666136  4573 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.663599  4409 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:45.672523  4451 tablet_bootstrap.cc:492] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.672951  4451 ts_tablet_manager.cc:1403] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.206s	user 0.008s	sys 0.007s
I20260709 12:19:45.677348  4450 ts_tablet_manager.cc:1434] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.077s	user 0.002s	sys 0.005s
I20260709 12:19:45.678110  4450 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.676324  4451 raft_consensus.cc:359] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.679101  4451 raft_consensus.cc:385] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.679418  4451 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.680076  4451 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.682426  4451 ts_tablet_manager.cc:1434] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:45.683336  4451 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:45.685009  4149 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 2, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.691000  4449 raft_consensus.cc:359] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.691751  4449 raft_consensus.cc:385] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.692062  4449 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.692831  4449 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.695318  4449 ts_tablet_manager.cc:1434] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:19:45.696273  4449 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:45.697029  4451 tablet_bootstrap.cc:654] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.701952  4572 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.702505  4572 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.702978  4449 tablet_bootstrap.cc:654] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.705261  4572 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.706260  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:45.708195  4219 leader_election.cc:343] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.708029  4152 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.708214  4450 tablet_bootstrap.cc:654] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.709896  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.710549  4405 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:45.711725  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.713701  4572 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.714059  4572 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.714361  4572 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.721705  4572 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.727165  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:45.727628  4572 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:45.729195  4219 leader_election.cc:343] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.727165  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.732573  4405 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.745280  4594 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.745922  4594 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.748023  4449 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:45.748584  4449 ts_tablet_manager.cc:1403] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.007s
I20260709 12:19:45.749239  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:45.756685  4296 leader_election.cc:343] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.749146  4153 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.758481  4405 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:45.750587  4594 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.752174  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.759840  4406 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:45.761242  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:45.763404  4594 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:45.763370  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.765826  4572 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.766289  4572 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:45.764559  4594 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.767663  4594 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.767531  4449 raft_consensus.cc:359] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.768532  4449 raft_consensus.cc:385] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.768904  4449 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.767099  4572 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.777329  4449 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.777755  4472 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.778307  4472 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.779193  4449 ts_tablet_manager.cc:1434] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:19:45.780803  4472 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.781670  4451 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.782270  4451 ts_tablet_manager.cc:1403] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.099s	user 0.025s	sys 0.028s
I20260709 12:19:45.783497  4449 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:45.785586  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:45.785933  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:45.787346  4219 leader_election.cc:343] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:45.788655  4218 leader_election.cc:343] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.788269  4451 raft_consensus.cc:359] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.789661  4451 raft_consensus.cc:385] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.789592  4218 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:45.789991  4451 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.790540  4472 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.785605  4594 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.791585  4451 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.792492  4450 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.792999  4450 ts_tablet_manager.cc:1403] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.002s
I20260709 12:19:45.793646  4153 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.796066  4451 ts_tablet_manager.cc:1434] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:19:45.797538  4451 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:45.803594  4594 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.804832  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:45.805583  4255 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.808809  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:45.809531  4406 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.818360  4572 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:45.818246  4219 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:45.827984  4255 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:45.833467  4449 tablet_bootstrap.cc:654] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.841964  4406 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:45.846365  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:45.847280  4594 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:45.848470  4594 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:45.848902  4451 tablet_bootstrap.cc:654] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.849373  4594 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.850652  4450 raft_consensus.cc:359] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.855314  4450 raft_consensus.cc:385] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.855612  4450 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.856452  4450 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.861363  4450 ts_tablet_manager.cc:1434] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.004s
I20260709 12:19:45.862454  4450 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.869410  4594 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.869978  4594 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.870667  4451 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.871142  4451 ts_tablet_manager.cc:1403] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.000s
I20260709 12:19:45.872186  4594 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.873571  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:45.873986  4451 raft_consensus.cc:359] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.874657  4451 raft_consensus.cc:385] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.874927  4451 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.875653  4451 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:45.875982  4296 leader_election.cc:343] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.877159  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:45.877902  4451 ts_tablet_manager.cc:1434] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:19:45.878700  4296 leader_election.cc:343] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:45.879160  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:45.879997  4449 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:45.880218  4488 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:45.880467  4449 ts_tablet_manager.cc:1403] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.007s
I20260709 12:19:45.882968  4449 raft_consensus.cc:359] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.883836  4449 raft_consensus.cc:385] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.884142  4449 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.884878  4449 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.889912  4450 tablet_bootstrap.cc:654] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.890799  4153 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:45.893110  4449 ts_tablet_manager.cc:1434] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:19:45.894055  4449 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:45.900918  4451 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:45.907186  4594 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:45.908087  4449 tablet_bootstrap.cc:654] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.911612  4451 tablet_bootstrap.cc:654] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.915158  4450 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.915659  4450 ts_tablet_manager.cc:1403] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.000s
I20260709 12:19:45.918059  4450 raft_consensus.cc:359] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.918644  4450 raft_consensus.cc:385] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.918872  4450 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.919680  4450 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.921677  4450 ts_tablet_manager.cc:1434] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:45.922552  4450 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:45.925335  4449 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:45.925789  4449 ts_tablet_manager.cc:1403] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.004s
I20260709 12:19:45.928699  4449 raft_consensus.cc:359] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.929384  4449 raft_consensus.cc:385] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.929653  4449 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.931419  4255 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:45.931586  4449 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.936769  4450 tablet_bootstrap.cc:654] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.941920  4449 ts_tablet_manager.cc:1434] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:19:45.942955  4449 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:45.946318  4594 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:19:45.964843  4330 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:45.966600  4449 tablet_bootstrap.cc:654] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.966562  4545 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:45.975999  4450 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:45.976603  4450 ts_tablet_manager.cc:1403] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 12:19:45.982712  4475 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.983354  4405 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:45.987674  4545 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:45.989079  4594 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.989645  4594 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.991349  4451 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:45.991904  4451 ts_tablet_manager.cc:1403] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.004s
I20260709 12:19:45.991860  4594 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:45.995607  4451 raft_consensus.cc:359] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.996382  4451 raft_consensus.cc:385] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:45.996676  4451 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:45.997423  4451 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:45.999364  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:46.000239  4405 raft_consensus.cc:2393] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:46.001650  4451 ts_tablet_manager.cc:1434] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:19:46.002696  4451 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.003564  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.005586  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:46.007045  4593 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:46.008630  4593 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.013077  4451 tablet_bootstrap.cc:654] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:45.983834  4450 raft_consensus.cc:359] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.025547  4450 raft_consensus.cc:385] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.025924  4450 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.028687  4593 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.026733  4450 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.033990  4450 ts_tablet_manager.cc:1434] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:19:46.034318  4451 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.034806  4451 ts_tablet_manager.cc:1403] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 12:19:46.034991  4450 tablet_bootstrap.cc:492] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:46.053223  4585 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:46.056479  4594 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.057054  4594 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.061355  4594 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.066252  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.067214  4256 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:46.068708  4409 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.068653  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.072608  4593 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.073195  4593 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.077001  4593 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.128726  4545 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.172456  4545 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.187676  4475 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.188337  4475 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.199160  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.197295  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:46.200776  4372 leader_election.cc:343] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.199546  4449 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.201184  4475 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.201711  4449 ts_tablet_manager.cc:1403] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.259s	user 0.012s	sys 0.028s
I20260709 12:19:46.204813  4451 raft_consensus.cc:359] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.205529  4451 raft_consensus.cc:385] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.205803  4451 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.206621  4451 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.207144  4594 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.207749  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.208213  4451 ts_tablet_manager.cc:1434] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.004s
I20260709 12:19:46.208338  4256 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:46.209089  4451 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.210047  4449 raft_consensus.cc:359] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.210528  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.210610  4449 raft_consensus.cc:385] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.214470  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.215134  4330 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:46.216117  4219 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.216866  4573 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.217242  4573 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.217579  4573 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.212984  4449 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.222038  4449 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.226009  4573 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.229061  4545 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.216893  4450 tablet_bootstrap.cc:654] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.232049  4408 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:46.239737  4549 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.248068  4549 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.248456  4549 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.249526  4593 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.259450  4449 ts_tablet_manager.cc:1434] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.004s
I20260709 12:19:46.260125  4593 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.260478  4449 tablet_bootstrap.cc:492] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.265650  4573 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.257370  4475 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.269580  4475 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.277232  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:46.277921  4408 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:46.280491  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:46.281067  4403 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.280387  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:46.284708  4334 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.288545  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:46.276633  4488 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:46.287143  4219 consensus_peers.cc:597] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:46.272184  4625 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:19:46.296650  4408 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.291976  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:46.287443  4549 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.303858  4624 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:46.311794  4549 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.312513  4451 tablet_bootstrap.cc:654] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.298349  4488 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.316495  4488 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.317194  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:46.317947  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:46.318552  4372 leader_election.cc:343] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.320811  4408 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:46.321259  4475 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.322566  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.304526  4255 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:46.324005  4372 leader_election.cc:343] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.330085  4255 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:46.331403  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.332274  4488 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.333012  4488 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:46.333855  4488 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.357918  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.355675  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:46.363994  4257 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.366557  4403 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
W20260709 12:19:46.371513  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:46.373134  4450 tablet_bootstrap.cc:492] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:46.373822  4450 ts_tablet_manager.cc:1403] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.339s	user 0.026s	sys 0.010s
I20260709 12:19:46.380976  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:46.382344  4334 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:46.384965  4219 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.385054  4450 raft_consensus.cc:359] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.385854  4450 raft_consensus.cc:385] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.386118  4450 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.387243  4545 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.388849  4545 raft_consensus.cc:697] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:46.390008  4545 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.387243  4450 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.413267  4623 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:46.416971  4450 ts_tablet_manager.cc:1434] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:19:46.418061  4450 tablet_bootstrap.cc:492] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:46.420456  4451 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.420884  4451 ts_tablet_manager.cc:1403] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.013s
I20260709 12:19:46.418037  4334 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.424113  4153 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.427277  4449 tablet_bootstrap.cc:654] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.435765  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:19:46.480609  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 53331.3us
W20260709 12:19:46.436203  4371 leader_election.cc:343] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.457665  4257 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:46.507520  4371 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.508353  4629 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.513219  4488 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:46.514679  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 79942.8us
I20260709 12:19:46.511446  4451 raft_consensus.cc:359] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.523418  4451 raft_consensus.cc:385] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.523855  4451 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.533258  4451 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.540491  4451 ts_tablet_manager.cc:1434] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.119s	user 0.011s	sys 0.000s
I20260709 12:19:46.541467  4451 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.542068  4450 tablet_bootstrap.cc:654] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:46.545526  4631 log.cc:927] Time spent T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:19:46.555382  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.556366  4629 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.557101  4629 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:46.559466  4629 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.585412  4475 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.588027  4475 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.590803  4475 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.592506  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:46.594695  4372 leader_election.cc:343] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.596097  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.599918  4488 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:19:46.608697  4371 leader_election.cc:343] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.609249  4449 tablet_bootstrap.cc:492] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.609937  4449 ts_tablet_manager.cc:1403] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.350s	user 0.033s	sys 0.035s
I20260709 12:19:46.610004  4371 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.617877  4549 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.619477  4594 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.649780  4451 tablet_bootstrap.cc:654] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.653580  4449 raft_consensus.cc:359] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.654174  4449 raft_consensus.cc:385] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.654371  4449 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.660037  4450 tablet_bootstrap.cc:492] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:46.660672  4450 ts_tablet_manager.cc:1403] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.243s	user 0.009s	sys 0.013s
I20260709 12:19:46.654992  4449 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.664026  4449 ts_tablet_manager.cc:1434] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:19:46.665340  4449 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.666564  4450 raft_consensus.cc:359] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.671734  4450 raft_consensus.cc:385] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.672765  4450 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.674696  4450 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.681288  4450 ts_tablet_manager.cc:1434] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:19:46.676826  4449 tablet_bootstrap.cc:654] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.686926  4450 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:46.690939  4451 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.691566  4451 ts_tablet_manager.cc:1403] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.000s
I20260709 12:19:46.698168  4451 raft_consensus.cc:359] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.698874  4451 raft_consensus.cc:385] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.699138  4451 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.699797  4451 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.702092  4451 ts_tablet_manager.cc:1434] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:19:46.703097  4451 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.704421  4629 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.704895  4629 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.706995  4629 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.708482  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.708918  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.709594  4451 tablet_bootstrap.cc:654] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:46.710037  4372 leader_election.cc:343] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:46.710592  4371 leader_election.cc:343] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.711024  4371 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.712121  4475 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.712441  4449 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.713034  4449 ts_tablet_manager.cc:1403] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.000s
I20260709 12:19:46.715909  4450 tablet_bootstrap.cc:654] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.716405  4572 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.717046  4572 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.720202  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.720640  4451 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.721078  4451 ts_tablet_manager.cc:1403] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
W20260709 12:19:46.721596  4219 leader_election.cc:343] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.721699  4149 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.724932  4572 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.725258  4451 raft_consensus.cc:359] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.725661  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:46.725955  4451 raft_consensus.cc:385] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.726244  4451 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
W20260709 12:19:46.726850  4218 leader_election.cc:343] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.727325  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.728526  4572 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.726966  4451 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.730155  4449 raft_consensus.cc:359] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.730819  4449 raft_consensus.cc:385] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.730865  4451 ts_tablet_manager.cc:1434] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:46.731165  4449 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.731985  4451 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.731830  4449 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.739781  4451 tablet_bootstrap.cc:654] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.744675  4449 ts_tablet_manager.cc:1434] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:19:46.746023  4449 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.755884  4449 tablet_bootstrap.cc:654] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.761490  4451 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.761992  4451 ts_tablet_manager.cc:1403] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.011s
I20260709 12:19:46.764750  4451 raft_consensus.cc:359] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.765444  4451 raft_consensus.cc:385] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.765710  4451 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.765884  4488 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.766547  4451 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.766446  4488 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.768815  4488 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.770370  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:46.770402  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.772389  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:46.773918  4593 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.779227  4449 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.779119  4622 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.779731  4449 ts_tablet_manager.cc:1403] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 12:19:46.782482  4449 raft_consensus.cc:359] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.784287  4622 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.784792  4622 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.786044  4451 ts_tablet_manager.cc:1434] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:19:46.786826  4622 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.787068  4451 tablet_bootstrap.cc:492] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.790114  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.790738  4257 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:46.792616  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.783143  4449 raft_consensus.cc:385] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.794114  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:46.795447  4449 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.795641  4403 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:46.794709  4622 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.796404  4449 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.799124  4449 ts_tablet_manager.cc:1434] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:19:46.798425  4151 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:46.800242  4449 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.800781  4622 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.801944  4622 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.803946  4622 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.807003  4449 tablet_bootstrap.cc:654] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.807988  4451 tablet_bootstrap.cc:654] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.808779  4594 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.809284  4594 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.811431  4594 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.813036  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.815192  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:46.815439  4296 leader_election.cc:343] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.815822  4403 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:46.817128  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:46.819100  4594 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.819517  4594 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.819896  4594 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.826514  4594 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.834833  4594 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:46.832700  4475 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.836762  4334 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.836665  4475 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.837893  4622 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.838773  4475 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.840401  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.840799  4622 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:46.841614  4372 leader_election.cc:343] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.842871  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:46.844111  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:46.844338  4403 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.844718  4256 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.818554  4450 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:46.846408  4450 ts_tablet_manager.cc:1403] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.160s	user 0.025s	sys 0.036s
I20260709 12:19:46.846619  4449 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.847049  4449 ts_tablet_manager.cc:1403] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:19:46.849078  4450 raft_consensus.cc:359] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.843451  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:46.849531  4449 raft_consensus.cc:359] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.849856  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:46.850193  4449 raft_consensus.cc:385] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.843650  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.850404  4408 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.850495  4449 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
W20260709 12:19:46.851564  4371 leader_election.cc:343] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.851408  4449 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.852013  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.853497  4475 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:46.854048  4449 ts_tablet_manager.cc:1434] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:19:46.854995  4449 tablet_bootstrap.cc:492] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.855701  4403 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:46.860730  4449 tablet_bootstrap.cc:654] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:46.863623  4296 leader_election.cc:343] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.864897  4451 tablet_bootstrap.cc:492] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.865352  4451 ts_tablet_manager.cc:1403] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.004s
I20260709 12:19:46.849721  4450 raft_consensus.cc:385] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.872402  4450 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.872468  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.873549  4450 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.874388  4256 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:46.875659  4622 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.876170  4622 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:46.876567  4450 ts_tablet_manager.cc:1434] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:19:46.877240  4449 tablet_bootstrap.cc:492] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.877005  4622 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.877583  4450 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:46.877699  4449 ts_tablet_manager.cc:1403] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:19:46.882889  4451 raft_consensus.cc:359] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.883646  4451 raft_consensus.cc:385] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.883937  4451 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.884271  4450 tablet_bootstrap.cc:654] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.887571  4449 raft_consensus.cc:359] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.888250  4449 raft_consensus.cc:385] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.888554  4449 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.889274  4449 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.870783  4408 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:46.891816  4449 ts_tablet_manager.cc:1434] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:19:46.893746  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:46.894513  4594 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:46.895018  4594 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:46.895884  4594 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.897176  4451 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.899712  4451 ts_tablet_manager.cc:1434] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:19:46.894532  4449 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.900744  4451 tablet_bootstrap.cc:492] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.906476  4449 tablet_bootstrap.cc:654] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.907773  4451 tablet_bootstrap.cc:654] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.928392  4451 tablet_bootstrap.cc:492] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.928826  4451 ts_tablet_manager.cc:1403] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 12:19:46.932061  4475 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.932646  4475 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.934741  4475 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.935039  4450 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:46.935663  4450 ts_tablet_manager.cc:1403] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.058s	user 0.036s	sys 0.013s
I20260709 12:19:46.936463  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.935786  4451 raft_consensus.cc:359] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.948935  4451 raft_consensus.cc:385] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.948997  4330 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:46.949276  4451 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.949993  4451 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.950524  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:46.943555  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.952149  4451 ts_tablet_manager.cc:1434] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:19:46.952008  4450 raft_consensus.cc:359] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:46.952512  4371 leader_election.cc:343] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.952960  4450 raft_consensus.cc:385] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.953346  4450 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.948117  4625 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:46.953814  4451 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:46.954243  4450 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.955137  4475 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.957692  4450 ts_tablet_manager.cc:1434] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:19:46.959041  4450 tablet_bootstrap.cc:492] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:46.959833  4152 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.962038  4451 tablet_bootstrap.cc:654] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.964558  4449 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.965521  4450 tablet_bootstrap.cc:654] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.966368  4449 ts_tablet_manager.cc:1403] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.009s
I20260709 12:19:46.967697  4545 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:46.969596  4449 raft_consensus.cc:359] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.970265  4449 raft_consensus.cc:385] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.970544  4449 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.971143  4449 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.955585  4475 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.972196  4475 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:46.977128  4449 ts_tablet_manager.cc:1434] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:19:46.978305  4449 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:46.978319  4506 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.979025  4506 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.981344  4506 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:46.985881  4449 tablet_bootstrap.cc:654] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.985632  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:46.987812  4450 tablet_bootstrap.cc:492] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:46.988359  4450 ts_tablet_manager.cc:1403] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
W20260709 12:19:46.990381  4372 leader_election.cc:343] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:46.991928  4450 raft_consensus.cc:359] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.993274  4450 raft_consensus.cc:385] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:46.993664  4450 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:46.994688  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:46.995030  4451 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:46.994628  4450 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:46.995525  4256 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:46.996239  4451 ts_tablet_manager.cc:1403] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.007s
I20260709 12:19:46.998050  4449 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:46.997947  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:46.998172  4450 ts_tablet_manager.cc:1434] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:46.998632  4449 ts_tablet_manager.cc:1403] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 12:19:46.999370  4506 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:46.999523  4450 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:46.999827  4506 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.000248  4506 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.001592  4449 raft_consensus.cc:359] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.002367  4449 raft_consensus.cc:385] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.002683  4449 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.003690  4449 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.004618  4152 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:47.006796  4449 ts_tablet_manager.cc:1434] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:19:47.006944  4450 tablet_bootstrap.cc:654] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:46.999039  4451 raft_consensus.cc:359] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.007511  4451 raft_consensus.cc:385] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.007858  4449 tablet_bootstrap.cc:492] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:47.007818  4451 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.008663  4451 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.010908  4451 ts_tablet_manager.cc:1434] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:19:47.012125  4451 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:47.014521  4449 tablet_bootstrap.cc:654] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.018453  4451 tablet_bootstrap.cc:654] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.020726  4450 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:47.021275  4450 ts_tablet_manager.cc:1403] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 12:19:47.024695  4450 raft_consensus.cc:359] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.025585  4450 raft_consensus.cc:385] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.025942  4450 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.026700  4450 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.029731  4450 ts_tablet_manager.cc:1434] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:47.030776  4450 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:47.031510  4449 tablet_bootstrap.cc:492] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:47.031987  4449 ts_tablet_manager.cc:1403] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.012s
I20260709 12:19:47.035111  4449 raft_consensus.cc:359] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.035852  4449 raft_consensus.cc:385] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.036134  4449 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.036779  4449 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.038179  4450 tablet_bootstrap.cc:654] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.039162  4449 ts_tablet_manager.cc:1434] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:47.039270  4451 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:47.039721  4451 ts_tablet_manager.cc:1403] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.009s
I20260709 12:19:47.040153  4449 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:47.049806  4450 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:47.050422  4450 ts_tablet_manager.cc:1403] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:19:47.042218  4451 raft_consensus.cc:359] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.051891  4451 raft_consensus.cc:385] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.052170  4451 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.053429  4451 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.053910  4450 raft_consensus.cc:359] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.054827  4450 raft_consensus.cc:385] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.055358  4451 ts_tablet_manager.cc:1434] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:19:47.056257  4451 tablet_bootstrap.cc:492] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:47.055150  4450 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.056530  4449 tablet_bootstrap.cc:654] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.057186  4572 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.057749  4572 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.057173  4450 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.064492  4450 ts_tablet_manager.cc:1434] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:19:47.064597  4625 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.065035  4625 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.065555  4450 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:47.071462  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.072309  4334 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.075866  4451 tablet_bootstrap.cc:654] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.067118  4625 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.062107  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.075709  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.077939  4624 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.078337  4624 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.078719  4624 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.079541  4450 tablet_bootstrap.cc:654] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.060969  4572 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.086488  4451 tablet_bootstrap.cc:492] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:47.087010  4451 ts_tablet_manager.cc:1403] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.004s
I20260709 12:19:47.089721  4451 raft_consensus.cc:359] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.090391  4451 raft_consensus.cc:385] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.090685  4451 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.091459  4451 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.092808  4449 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:47.093248  4449 ts_tablet_manager.cc:1403] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.022s
I20260709 12:19:47.093551  4451 ts_tablet_manager.cc:1434] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:47.094506  4451 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
W20260709 12:19:47.089929  4372 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:47.096632  4449 raft_consensus.cc:359] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.097323  4449 raft_consensus.cc:385] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.097628  4449 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.098420  4449 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.100178  4451 tablet_bootstrap.cc:654] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.100428  4449 ts_tablet_manager.cc:1434] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:47.101358  4449 tablet_bootstrap.cc:492] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:47.111685  4449 tablet_bootstrap.cc:654] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.117015  4451 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:47.117635  4451 ts_tablet_manager.cc:1403] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:19:47.120621  4572 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.121356  4572 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.126121  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:47.127362  4219 leader_election.cc:343] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.128995  4451 raft_consensus.cc:359] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.129837  4451 raft_consensus.cc:385] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.130182  4451 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.131067  4451 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.132871  4572 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.136435  4451 ts_tablet_manager.cc:1434] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:19:47.137782  4451 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:47.137899  4572 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.138412  4572 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.140867  4572 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.142374  4572 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.143646  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:47.144760  4219 leader_election.cc:343] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.142814  4572 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.147331  4451 tablet_bootstrap.cc:654] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.147861  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.148691  4332 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.149875  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.151366  4625 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.151808  4625 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.152208  4625 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.161099  4572 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.166319  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.167474  4408 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 1: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:19:47.177912  4629 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.178556  4629 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.181371  4629 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:47.183475  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.184305  4333 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:47.185828  4372 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.186985  4629 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.187492  4629 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.187932  4629 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.192574  4475 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.198073  4572 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.198750  4572 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.200753  4624 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.203178  4572 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.204398  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.204881  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.205258  4332 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.205761  4333 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.207865  4219 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.208871  4572 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.209357  4572 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.209796  4572 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.227380  4572 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.197177  4506 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.241513  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.242401  4406 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.245463  4572 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.251991  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.252815  4333 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.265492  4332 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:47.271031  4624 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.273923  4475 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:47.284171  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.288215  4677 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.288753  4677 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:47.289307  4625 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.289620  4677 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.293200  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.293534  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.294127  4334 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.293851  4332 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.304672  4629 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.305428  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.305701  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.309814  4256 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.294431  4623 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.321473  4450 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:47.321956  4450 ts_tablet_manager.cc:1403] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.257s	user 0.040s	sys 0.068s
I20260709 12:19:47.323084  4594 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.325150  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:47.325768  4409 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.325914  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.326556  4408 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.325419  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:47.328364  4405 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.328708  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.338794  4450 raft_consensus.cc:359] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.339383  4450 raft_consensus.cc:385] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.339619  4450 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.340802  4451 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:47.341141  4451 ts_tablet_manager.cc:1403] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.204s	user 0.047s	sys 0.032s
I20260709 12:19:47.341877  4506 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:47.344550  4449 tablet_bootstrap.cc:492] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:47.344684  4409 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:47.344991  4449 ts_tablet_manager.cc:1403] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.244s	user 0.067s	sys 0.106s
I20260709 12:19:47.349076  4450 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.337359  4624 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.354257  4449 raft_consensus.cc:359] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.354830  4449 raft_consensus.cc:385] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.355248  4449 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.338246  4625 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.350490  4332 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:47.331427  4623 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.355867  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.359417  4450 ts_tablet_manager.cc:1434] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:19:47.486052  4450 tablet_bootstrap.cc:492] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:47.487027  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.416555  4622 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.487753  4331 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.487807  4622 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.489451  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.490283  4475 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.491355  4475 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:47.412940  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:47.492074  4451 raft_consensus.cc:359] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.492882  4451 raft_consensus.cc:385] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.413432  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:47.492321  4475 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.494419  4629 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:47.400655  4334 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:47.457394  4152 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:47.496549  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.471606  4333 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:47.497699  4330 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.498832  4219 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.413822  4488 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.499687  4572 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.500018  4488 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.500736  4545 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.501238  4545 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:47.502125  4545 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.502872  4488 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.500255  4572 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:47.411178  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.504318  4572 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.505219  4623 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.507858  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:47.507875  4623 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.508591  4255 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.512295  4622 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.512777  4449 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.493541  4451 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.492280  4254 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:47.514802  4451 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.576021  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:47.588526  4450 tablet_bootstrap.cc:654] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.519071  4449 ts_tablet_manager.cc:1434] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.174s	user 0.007s	sys 0.002s
I20260709 12:19:47.600783  4451 ts_tablet_manager.cc:1434] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.259s	user 0.011s	sys 0.007s
I20260709 12:19:47.600921  4449 tablet_bootstrap.cc:492] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:47.547391  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.549640  4330 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
W20260709 12:19:47.609668  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:47.550654  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:47.528357  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:47.616796  4257 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:47.617615  4254 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.356369  4624 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.522120  4405 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:47.606699  4256 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:47.630613  4254 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:47.631620  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.632563  4506 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.633301  4506 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:47.610984  4331 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:47.620038  4333 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.639072  4253 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.645825  4678 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:47.637322  4488 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:19:47.643060  4506 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.640105  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.656176  4594 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.656639  4594 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.656785  4624 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.657115  4594 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.661324  4450 tablet_bootstrap.cc:492] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:47.661737  4450 ts_tablet_manager.cc:1403] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.016s
I20260709 12:19:47.663954  4451 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:47.665052  4449 tablet_bootstrap.cc:654] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.661376  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.668594  4253 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:47.670390  4623 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.674980  4623 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.675395  4623 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.682214  4255 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:47.684535  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.685709  4333 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:47.673974  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:47.691735  4629 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.692446  4629 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:47.692420  4152 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.693835  4629 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:47.707846  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 296784us
I20260709 12:19:47.708840  4150 catalog_manager.cc:5697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:47.712626  4150 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:47.716461  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45179us
W20260709 12:19:47.746356  4218 leader_election.cc:343] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.747069  4218 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.748061  4625 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.748202  4450 raft_consensus.cc:359] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.749020  4450 raft_consensus.cc:385] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.749366  4450 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.750228  4450 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:47.748592  4218 leader_election.cc:343] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.755734  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.756621  4624 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.756522  4594 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.766013  4450 ts_tablet_manager.cc:1434] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.104s	user 0.012s	sys 0.005s
I20260709 12:19:47.768874  4450 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:47.773037  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:47.774499  4622 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.774860  4622 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.775169  4622 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.780887  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.781801  4408 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:47.791611  4678 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.798553  4678 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.800024  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.800791  4408 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:47.801703  4678 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:47.805444  4451 tablet_bootstrap.cc:654] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.812714  4449 tablet_bootstrap.cc:492] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:47.813205  4449 ts_tablet_manager.cc:1403] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.213s	user 0.013s	sys 0.014s
I20260709 12:19:47.797557  4623 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.790315  4594 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.817561  4678 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.829233  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.845763  4404 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:47.847330  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.848194  4329 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 1: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:19:47.839385  4678 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.852142  4623 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.853196  4678 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:47.854367  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:47.864605  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:47.865782  4449 raft_consensus.cc:359] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.867174  4449 raft_consensus.cc:385] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.867492  4449 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.869189  4449 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.869988  4694 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.870517  4694 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.874702  4694 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.879876  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:47.883599  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:47.884232  4257 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.885761  4449 ts_tablet_manager.cc:1434] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:19:47.890820  4449 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:47.884256  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:47.890076  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:47.899674  4405 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.900043  4407 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.906544  4450 tablet_bootstrap.cc:654] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:47.885773  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:47.896040  4403 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.881006  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:47.910161  4372 leader_election.cc:343] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:47.914340  4257 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:47.911986  4256 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:47.918289  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.921334  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.919174  4594 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:47.927610  4506 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:47.928121  4506 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.928537  4506 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:47.917433  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:47.933840  4622 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.935760  4330 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 1: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:19:47.936151  4622 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.938592  4407 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:47.939694  4475 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.942461  4677 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.947057  4405 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:47.947655  4629 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.951268  4451 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:47.951751  4451 ts_tablet_manager.cc:1403] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.288s	user 0.008s	sys 0.011s
I20260709 12:19:47.953698  4677 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:47.956838  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.956897  4451 raft_consensus.cc:359] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.957914  4451 raft_consensus.cc:385] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:47.958249  4451 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:47.958815  4623 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:47.958997  4451 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.966015  4687 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:47.968532  4488 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:47.972082  4451 ts_tablet_manager.cc:1434] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:19:47.975945  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:47.976898  4687 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:47.977536  4687 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:47.979884  4687 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.980798  4153 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.982409  4153 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.990118  4449 tablet_bootstrap.cc:654] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.004360  4625 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.004894  4625 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:47.990948  4403 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:48.013108  4625 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:47.978657  4506 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.019637  4451 tablet_bootstrap.cc:492] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:48.021381  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:48.028859  4218 leader_election.cc:343] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.008360  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:48.037029  4328 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.039909  4488 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.041719  4488 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:48.042598  4488 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.046331  4687 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:48.048506  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:48.052451  4219 leader_election.cc:343] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.057727  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:48.059365  4475 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:48.052417  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:48.062451  4254 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.064553  4623 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.072099  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:48.079665  4506 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:48.096872  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:48.097313  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:48.097740  4408 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:19:48.101738  4296 leader_election.cc:343] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.066429  4687 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:19:48.116241  4449 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:48.116897  4449 ts_tablet_manager.cc:1403] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.230s	user 0.026s	sys 0.008s
I20260709 12:19:48.095718  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:48.125665  4703 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:19:48.151721  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:19:48.145304  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61637.8us
I20260709 12:19:48.176731  4451 tablet_bootstrap.cc:654] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:48.167258  4296 leader_election.cc:343] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.185949  4296 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:48.186913  4622 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.193933  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:48.194968  4694 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:19:48.188067  4372 leader_election.cc:343] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.219867  4449 raft_consensus.cc:359] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.220803  4449 raft_consensus.cc:385] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.221131  4449 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.224721  4449 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.244079  4449 ts_tablet_manager.cc:1434] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.127s	user 0.016s	sys 0.007s
I20260709 12:19:48.293819  4254 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
W20260709 12:19:48.351774  4709 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.098s	user 0.004s	sys 0.000s
I20260709 12:19:48.385627  4712 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.073s
I20260709 12:19:48.381407  4678 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:19:48.370111  4677 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:19:48.388780  4450 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:48.389258  4450 ts_tablet_manager.cc:1403] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.621s	user 0.035s	sys 0.029s
I20260709 12:19:48.394461  4450 raft_consensus.cc:359] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.395278  4450 raft_consensus.cc:385] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.395599  4450 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.399394  4450 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.401579  4450 ts_tablet_manager.cc:1434] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:19:48.402508  4450 tablet_bootstrap.cc:492] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:48.406008  4451 tablet_bootstrap.cc:492] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:48.406651  4451 ts_tablet_manager.cc:1403] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.387s	user 0.027s	sys 0.041s
I20260709 12:19:48.414454  4451 raft_consensus.cc:359] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.415573  4451 raft_consensus.cc:385] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.415994  4451 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.416832  4451 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.418921  4451 ts_tablet_manager.cc:1434] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:19:48.419175  4449 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:48.420127  4451 tablet_bootstrap.cc:492] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:48.428406  4451 tablet_bootstrap.cc:654] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:48.451484  4715 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 12:19:48.464223  4688 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:48.469075  4450 tablet_bootstrap.cc:654] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.474599  4449 tablet_bootstrap.cc:654] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.481884  4710 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.482602  4710 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.501931  4710 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:48.511212  4450 tablet_bootstrap.cc:492] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:48.512274  4450 ts_tablet_manager.cc:1403] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.110s	user 0.001s	sys 0.033s
I20260709 12:19:48.514635  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:48.515714  4506 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:48.521653  4152 catalog_manager.cc:5697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.529351  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:48.530719  4372 leader_election.cc:343] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.524773  4506 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:48.537437  4450 raft_consensus.cc:359] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.555172  4153 catalog_manager.cc:5697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.562368  4450 raft_consensus.cc:385] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.562671  4450 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.563946  4450 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.569017  4450 ts_tablet_manager.cc:1434] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.056s	user 0.001s	sys 0.006s
I20260709 12:19:48.569610  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:48.572320  4728 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.084s	user 0.004s	sys 0.000s
I20260709 12:19:48.575047  4687 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.579537  4450 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:48.580314  4712 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:48.579133  4677 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:19:48.583000  4732 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:48.588598  4506 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:48.598898  4371 leader_election.cc:343] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.600756  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:48.601646  4678 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.608469  4688 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:48.721951  4449 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:48.722642  4449 ts_tablet_manager.cc:1403] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.304s	user 0.018s	sys 0.002s
I20260709 12:19:48.729049  4451 tablet_bootstrap.cc:492] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:48.729530  4451 ts_tablet_manager.cc:1403] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.310s	user 0.014s	sys 0.013s
I20260709 12:19:48.735016  4451 raft_consensus.cc:359] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.736702  4451 raft_consensus.cc:385] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.736948  4451 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.737782  4451 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.750684  4449 raft_consensus.cc:359] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.751571  4449 raft_consensus.cc:385] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.751639  4451 ts_tablet_manager.cc:1434] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:19:48.751976  4449 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.752835  4451 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:48.738830  4721 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.757995  4449 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.759390  4721 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.769567  4450 tablet_bootstrap.cc:654] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.761193  4688 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.785212  4449 ts_tablet_manager.cc:1434] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:19:48.786460  4449 tablet_bootstrap.cc:492] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:48.797550  4694 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.784657  4688 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.822379  4694 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.828214  4694 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:48.802760  4721 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:48.853338  4449 tablet_bootstrap.cc:654] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:48.854103  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:48.860961  4688 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:48.864879  4451 tablet_bootstrap.cc:654] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:48.872030  4219 leader_election.cc:343] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.879752  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:48.882514  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:48.883047  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:48.880288  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 57331.9us
I20260709 12:19:48.897657  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:48.898574  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:48.903641  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:48.904062  4296 leader_election.cc:343] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.905310  4688 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.905754  4688 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.906150  4688 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.906821  4403 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:48.911957  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:19:48.912954  4296 leader_election.cc:343] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.920305  4743 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:48.920796  4743 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.921213  4743 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.923650  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:48.939083  4218 leader_election.cc:343] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:48.939718  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:48.940656  4677 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:48.946246  4451 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:48.947137  4451 ts_tablet_manager.cc:1403] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.023s
I20260709 12:19:48.947582  4449 tablet_bootstrap.cc:492] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:48.952065  4449 ts_tablet_manager.cc:1403] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.005s
I20260709 12:19:48.954795  4449 raft_consensus.cc:359] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.955289  4450 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:48.955493  4449 raft_consensus.cc:385] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.955763  4450 ts_tablet_manager.cc:1403] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.376s	user 0.015s	sys 0.012s
I20260709 12:19:48.955749  4449 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.961989  4450 raft_consensus.cc:359] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.962833  4450 raft_consensus.cc:385] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:48.963595  4450 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:48.964465  4450 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.971328  4450 ts_tablet_manager.cc:1434] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:19:48.972378  4450 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:48.976753  4449 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.931615  4743 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.985124  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:48.985852  4250 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:48.983973  4449 ts_tablet_manager.cc:1434] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:19:48.992195  4449 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:48.998548  4688 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:48.999487  4451 raft_consensus.cc:359] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.001811  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.000631  4451 raft_consensus.cc:385] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.002506  4253 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.002897  4451 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.003728  4451 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.006318  4451 ts_tablet_manager.cc:1434] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:19:49.007349  4451 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:49.009584  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.007324  4688 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:49.013048  4296 leader_election.cc:343] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.012140  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.013934  4401 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.016645  4743 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.021865  4450 tablet_bootstrap.cc:654] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.022970  4712 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.029832  4401 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.033965  4250 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.035591  4152 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.042870  4449 tablet_bootstrap.cc:654] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.043260  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:49.045370  4688 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.045774  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.035185  4451 tablet_bootstrap.cc:654] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.050726  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:49.052836  4488 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.053337  4488 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:49.054200  4488 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.058928  4450 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:49.059517  4450 ts_tablet_manager.cc:1403] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.009s
I20260709 12:19:49.060593  4449 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:49.061055  4449 ts_tablet_manager.cc:1403] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 12:19:49.062074  4450 raft_consensus.cc:359] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.062780  4450 raft_consensus.cc:385] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.063042  4450 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.063814  4450 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.064109  4449 raft_consensus.cc:359] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.064741  4449 raft_consensus.cc:385] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.065066  4449 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.066468  4450 ts_tablet_manager.cc:1434] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:49.067656  4332 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.067651  4449 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.067628  4450 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:49.071664  4451 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:49.072621  4449 ts_tablet_manager.cc:1434] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:19:49.074214  4451 ts_tablet_manager.cc:1403] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.002s
I20260709 12:19:49.075858  4450 tablet_bootstrap.cc:654] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.077073  4451 raft_consensus.cc:359] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.077751  4451 raft_consensus.cc:385] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.078007  4451 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.079934  4684 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.079120  4451 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.080106  4449 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:49.080494  4684 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.084060  4684 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.085985  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:49.087347  4450 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:49.087836  4450 ts_tablet_manager.cc:1403] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
W20260709 12:19:49.089301  4219 leader_election.cc:343] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.090427  4451 ts_tablet_manager.cc:1434] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:19:49.091727  4451 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:49.092847  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.093477  4401 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:49.099413  4451 tablet_bootstrap.cc:654] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:49.100270  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:49.102224  4449 tablet_bootstrap.cc:654] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.102216  4450 raft_consensus.cc:359] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.103184  4450 raft_consensus.cc:385] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.103511  4450 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.103757  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.104183  4450 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.104933  4684 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.105356  4684 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.105710  4684 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.106644  4450 ts_tablet_manager.cc:1434] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 12:19:49.107652  4450 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:49.115861  4450 tablet_bootstrap.cc:654] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.119458  4451 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:49.119972  4451 ts_tablet_manager.cc:1403] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 12:19:49.123369  4451 raft_consensus.cc:359] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.124084  4451 raft_consensus.cc:385] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.124416  4451 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.125088  4451 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.125700  4449 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:49.126621  4449 ts_tablet_manager.cc:1403] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.003s
I20260709 12:19:49.126518  4688 raft_consensus.cc:697] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:49.127583  4451 ts_tablet_manager.cc:1434] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:49.128517  4451 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:49.129139  4449 raft_consensus.cc:359] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.129765  4449 raft_consensus.cc:385] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.130003  4449 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.131844  4688 consensus_queue.cc:237] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.132784  4449 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.135337  4451 tablet_bootstrap.cc:654] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.136746  4449 ts_tablet_manager.cc:1434] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:19:49.137717  4449 tablet_bootstrap.cc:492] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:49.154484  4449 tablet_bootstrap.cc:654] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.166981  4449 tablet_bootstrap.cc:492] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:49.167586  4449 ts_tablet_manager.cc:1403] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.006s
I20260709 12:19:49.186894  4732 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.187496  4684 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.190267  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:49.190593  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.191113  4401 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:49.191808  4219 leader_election.cc:343] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.171059  4449 raft_consensus.cc:359] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.192998  4449 raft_consensus.cc:385] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.193370  4449 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.196816  4449 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.200145  4743 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.200619  4743 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.201711  4449 ts_tablet_manager.cc:1434] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:19:49.202613  4743 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.205338  4449 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:49.207012  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.207955  4250 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:49.209059  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:49.209872  4743 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.210280  4743 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.210676  4743 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.217456  4449 tablet_bootstrap.cc:654] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.225244  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.217649  4743 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:49.233927  4296 leader_election.cc:343] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.238041  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.242302  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.242998  4256 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:49.244961  4296 leader_election.cc:343] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.236728  4743 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.239316  4694 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.247972  4694 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.251690  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.252494  4252 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:49.253784  4296 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:49.254935  4688 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.255371  4688 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.261574  4694 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.275638  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.276479  4407 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:49.270845  4688 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.287500  4744 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.244041  4684 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.289870  4153 catalog_manager.cc:5697] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.293044  4153 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.300374  4450 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:49.294970  4688 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.300896  4450 ts_tablet_manager.cc:1403] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.194s	user 0.032s	sys 0.040s
I20260709 12:19:49.300582  4401 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:49.300410  4449 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:49.290722  4744 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.305143  4449 ts_tablet_manager.cc:1403] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.020s
I20260709 12:19:49.305881  4256 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.307323  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:49.308284  4743 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.308784  4743 raft_consensus.cc:697] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:49.309204  4450 raft_consensus.cc:359] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.309913  4450 raft_consensus.cc:385] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.309583  4743 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.313834  4450 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.315158  4688 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.316118  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:49.316172  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.314906  4450 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.317471  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.317545  4744 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.319401  4451 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:49.320590  4451 ts_tablet_manager.cc:1403] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.192s	user 0.057s	sys 0.054s
I20260709 12:19:49.320714  4687 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.321305  4687 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:49.322691  4450 ts_tablet_manager.cc:1434] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:19:49.322167  4687 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.323971  4449 raft_consensus.cc:359] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.327409  4449 raft_consensus.cc:385] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.328143  4449 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.323076  4451 raft_consensus.cc:359] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:49.330641  4219 leader_election.cc:343] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.331389  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.331998  4451 raft_consensus.cc:385] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.326709  4450 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:49.332505  4451 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.332181  4449 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.333303  4451 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.334918  4449 ts_tablet_manager.cc:1434] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:19:49.335345  4451 ts_tablet_manager.cc:1434] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:19:49.332062  4256 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.339732  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.340394  4401 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:49.341660  4449 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:49.343019  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.343547  4451 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:49.348875  4407 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.345546  4684 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.361541  4732 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.362288  4732 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.360157  4684 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.401906  4684 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.404239  4407 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.400067  4506 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.408093  4506 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.418165  4256 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.440375  4684 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.441205  4506 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:49.443902  4296 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:49.444983  4743 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.459498  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.460930  4253 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:49.462484  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:49.460141  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.463925  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:49.455997  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.455703  4732 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:19:49.465884  4219 leader_election.cc:343] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.456418  4684 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.456984  4743 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:49.467964  4450 tablet_bootstrap.cc:654] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.465221  4403 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.465377  4694 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.467159  4506 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:49.471784  4371 leader_election.cc:343] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.472388  4451 tablet_bootstrap.cc:654] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.473665  4743 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.472499  4694 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.478569  4694 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.479575  4153 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.482210  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.472728  4506 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.483243  4506 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.486291  4403 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:49.482838  4256 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:49.489660  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.487480  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.491710  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:49.492558  4325 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:49.494333  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:49.495131  4325 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:49.498745  4687 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.499245  4687 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:49.500067  4687 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.504454  4372 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:49.505559  4732 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.505995  4732 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.506328  4732 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.507543  4152 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.511899  4449 tablet_bootstrap.cc:654] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.513021  4296 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:49.515089  4488 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.515502  4488 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.515841  4488 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.525765  4488 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:49.534277  4296 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.540203  4732 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.545773  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.548928  4256 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.548659  4506 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.549247  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.550137  4407 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:49.551170  4506 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:49.551509  4488 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:49.553061  4371 leader_election.cc:343] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.555791  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.558236  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:49.566197  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:49.568274  4332 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 1: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:19:49.569350  4402 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:49.569775  4450 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:49.570243  4450 ts_tablet_manager.cc:1403] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.244s	user 0.046s	sys 0.037s
I20260709 12:19:49.573030  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:49.573670  4325 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.574396  4372 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.581537  4678 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.582245  4744 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.561825  4732 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:49.582726  4744 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.584334  4153 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.586004  4744 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:49.586071  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:49.587718  4219 leader_election.cc:343] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.582335  4450 raft_consensus.cc:359] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.588620  4450 raft_consensus.cc:385] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.588896  4450 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.589582  4450 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.595151  4451 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:49.595680  4451 ts_tablet_manager.cc:1403] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.252s	user 0.017s	sys 0.000s
I20260709 12:19:49.596685  4450 ts_tablet_manager.cc:1434] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:19:49.598865  4450 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:49.590385  4325 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:49.602079  4449 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:49.602437  4449 ts_tablet_manager.cc:1403] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.261s	user 0.029s	sys 0.011s
I20260709 12:19:49.594729  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.605985  4372 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:49.602996  4687 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:49.610934  4218 leader_election.cc:343] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.607936  4506 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.611433  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.607559  4256 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:49.611176  4687 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.618811  4688 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.614221  4744 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.618659  4449 raft_consensus.cc:359] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.620066  4449 raft_consensus.cc:385] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.620460  4449 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.621475  4449 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.622684  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:49.623456  4687 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:49.632736  4219 leader_election.cc:343] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.615424  4506 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:49.634199  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:49.635210  4506 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.627264  4296 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:49.636511  4688 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.637039  4688 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:49.637212  4449 ts_tablet_manager.cc:1434] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:19:49.638192  4449 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:49.637949  4688 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.649513  4152 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.651423  4451 raft_consensus.cc:359] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.657617  4451 raft_consensus.cc:385] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.658021  4451 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
W20260709 12:19:49.654598  4218 leader_election.cc:343] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.663070  4218 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.663139  4451 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.665390  4744 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:49.689312  4451 ts_tablet_manager.cc:1434] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 12:19:49.665395  4743 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:19:49.703567  4450 tablet_bootstrap.cc:654] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.714634  4451 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:49.724557  4153 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.737560  4449 tablet_bootstrap.cc:654] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.741405  4775 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.742131  4775 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:49.773219  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 87692.9us
W20260709 12:19:49.767519  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 133390us
I20260709 12:19:49.783744  4688 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.785497  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.783744  4775 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:49.803519  4256 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
W20260709 12:19:49.823555  4777 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:19:49.823734  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:49.824573  4732 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:49.824939  4732 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.825273  4732 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.832818  4451 tablet_bootstrap.cc:654] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:49.834267  4219 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.858903  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:49.864542  4372 leader_election.cc:343] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.868208  4449 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:49.868774  4449 ts_tablet_manager.cc:1403] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.012s
W20260709 12:19:49.869184  4296 consensus_peers.cc:597] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.873723  4732 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.879272  4449 raft_consensus.cc:359] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.879999  4449 raft_consensus.cc:385] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.880249  4449 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.884666  4152 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.884966  4778 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:49.880837  4449 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.891248  4450 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:49.891800  4450 ts_tablet_manager.cc:1403] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.294s	user 0.016s	sys 0.015s
I20260709 12:19:49.894240  4449 ts_tablet_manager.cc:1434] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:19:49.895084  4449 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:49.894690  4688 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:49.906536  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:49.908380  4372 leader_election.cc:343] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:49.911023  4732 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:49.913141  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:49.913805  4256 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:49.914947  4450 raft_consensus.cc:359] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.919492  4450 raft_consensus.cc:385] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.921361  4450 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.941592  4256 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:49.943243  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.941767  4684 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:49.945781  4451 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:49.946412  4451 ts_tablet_manager.cc:1403] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.000s
I20260709 12:19:49.947088  4450 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.948187  4775 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:49.951524  4775 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:49.952442  4775 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.960963  4450 ts_tablet_manager.cc:1434] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 12:19:49.962034  4450 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:49.964617  4451 raft_consensus.cc:359] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.965333  4451 raft_consensus.cc:385] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:49.965665  4451 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:49.967128  4451 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.974089  4732 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.974874  4488 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:49.974786  4732 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:49.977725  4732 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:49.978801  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:49.981406  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:49.983146  4371 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:49.986037  4449 tablet_bootstrap.cc:654] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:49.992221  4451 ts_tablet_manager.cc:1434] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:19:49.993542  4451 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:49.990127  4732 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.061966  4624 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.073120  4624 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.100871  4622 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.109427  4622 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.115832  4622 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.124677  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:50.117345  4624 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.137441  4794 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.143066  4451 tablet_bootstrap.cc:654] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.147727  4450 tablet_bootstrap.cc:654] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.169373  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:50.170742  4404 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:50.181941  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:50.184228  4329 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:50.189364  4449 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:50.156277  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:50.189906  4449 ts_tablet_manager.cc:1403] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.295s	user 0.019s	sys 0.026s
I20260709 12:19:50.156769  4622 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.195334  4150 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.197638  4622 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.205860  4622 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.211359  4329 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.217273  4296 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:50.219620  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:50.219790  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:50.220552  4257 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:50.244490  4449 raft_consensus.cc:359] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.245257  4449 raft_consensus.cc:385] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.245514  4449 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.246096  4449 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.255429  4450 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:50.255934  4450 ts_tablet_manager.cc:1403] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.294s	user 0.007s	sys 0.045s
I20260709 12:19:50.258517  4450 raft_consensus.cc:359] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.262005  4253 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.259166  4450 raft_consensus.cc:385] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.265138  4450 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.265820  4450 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:50.282315  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 65391.4us
I20260709 12:19:50.283429  4219 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:50.286955  4450 ts_tablet_manager.cc:1434] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:19:50.289530  4450 tablet_bootstrap.cc:492] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:50.290673  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:50.291546  4594 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.296651  4451 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:50.297138  4451 ts_tablet_manager.cc:1403] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.304s	user 0.022s	sys 0.028s
I20260709 12:19:50.319418  4622 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.357577  4449 ts_tablet_manager.cc:1434] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.009s
I20260709 12:19:50.358654  4449 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:50.361605  4688 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.370913  4810 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.374428  4403 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.419968  4772 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.394546  4804 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:50.474856  4594 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.478823  4775 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.481340  4449 tablet_bootstrap.cc:654] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.484788  4624 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.524482  4772 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:50.488919  4775 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:50.489887  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:50.529989  4775 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.499964  4451 raft_consensus.cc:359] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.532114  4451 raft_consensus.cc:385] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.532172  4775 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:50.532550  4451 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.533212  4451 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.510090  4450 tablet_bootstrap.cc:654] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.537315  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:50.538018  4252 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:50.539362  4451 ts_tablet_manager.cc:1434] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.242s	user 0.013s	sys 0.018s
I20260709 12:19:50.540405  4451 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:50.552459  4732 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:19:50.556366  4804 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.552768  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:50.547286  4451 tablet_bootstrap.cc:654] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.559453  4804 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.563050  4804 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.563500  4775 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.563984  4775 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.564343  4775 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.565486  4450 tablet_bootstrap.cc:492] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:50.566038  4450 ts_tablet_manager.cc:1403] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.277s	user 0.009s	sys 0.018s
I20260709 12:19:50.569201  4450 raft_consensus.cc:359] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.570303  4450 raft_consensus.cc:385] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.571434  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:50.571066  4450 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
W20260709 12:19:50.573071  4218 leader_election.cc:343] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.573722  4450 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.576067  4450 ts_tablet_manager.cc:1434] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:50.576295  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:50.576946  4450 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
W20260709 12:19:50.577878  4219 leader_election.cc:343] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.579144  4219 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:50.580078  4506 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.580888  4506 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.588208  4775 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.590234  4506 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:50.590498  4775 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:50.598459  4401 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.587491  4624 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.605386  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:50.626114  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:50.627730  4252 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.633488  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:50.638003  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:50.641144  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:50.646982  4449 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:50.647535  4449 ts_tablet_manager.cc:1403] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.289s	user 0.036s	sys 0.027s
I20260709 12:19:50.649000  4450 tablet_bootstrap.cc:654] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.649020  4451 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:50.649748  4451 ts_tablet_manager.cc:1403] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.000s
W20260709 12:19:50.653360  4372 leader_election.cc:343] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.653578  4449 raft_consensus.cc:359] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.664004  4449 raft_consensus.cc:385] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.664341  4449 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.654402  4252 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:50.665100  4449 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:50.667095  4372 leader_election.cc:343] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.667402  4449 ts_tablet_manager.cc:1434] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:19:50.668352  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:50.671865  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:50.672822  4775 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.673339  4775 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:50.674221  4775 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.675654  4449 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:50.682299  4450 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:50.682387  4449 tablet_bootstrap.cc:654] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.682922  4450 ts_tablet_manager.cc:1403] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.001s
I20260709 12:19:50.686461  4451 raft_consensus.cc:359] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.690435  4451 raft_consensus.cc:385] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.693646  4451 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.702340  4449 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:50.702906  4449 ts_tablet_manager.cc:1403] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 12:19:50.705778  4449 raft_consensus.cc:359] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.706530  4449 raft_consensus.cc:385] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.706664  4807 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.706833  4449 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.707274  4807 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.707659  4449 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.692606  4450 raft_consensus.cc:359] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.709511  4450 raft_consensus.cc:385] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.710026  4450 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.710170  4449 ts_tablet_manager.cc:1434] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:19:50.710868  4450 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.711612  4449 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:50.715154  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:50.716238  4807 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.717374  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:50.718773  4218 leader_election.cc:343] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.721464  4449 tablet_bootstrap.cc:654] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.723435  4450 ts_tablet_manager.cc:1434] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:19:50.695457  4451 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.725972  4506 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.739674  4325 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:50.743980  4219 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:50.745800  4624 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:50.746145  4624 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.746438  4624 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.751094  4450 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:50.753305  4624 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.776126  4152 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.777832  4449 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:50.779982  4624 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.780334  4449 ts_tablet_manager.cc:1403] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.036s
I20260709 12:19:50.780575  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:50.781170  4332 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.783066  4449 raft_consensus.cc:359] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.783764  4449 raft_consensus.cc:385] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.784009  4449 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.784713  4449 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.785670  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:50.786761  4449 ts_tablet_manager.cc:1434] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:19:50.788357  4218 leader_election.cc:343] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.788971  4451 ts_tablet_manager.cc:1434] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:19:50.789949  4451 tablet_bootstrap.cc:492] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:50.793740  4449 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:50.799566  4624 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.800109  4624 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.802241  4624 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:50.803529  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:50.804559  4450 tablet_bootstrap.cc:654] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:50.804942  4219 leader_election.cc:343] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.809476  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:50.809999  4451 tablet_bootstrap.cc:654] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:50.812062  4449 tablet_bootstrap.cc:654] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:50.812445  4218 leader_election.cc:343] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.812894  4218 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:50.813685  4807 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:50.828217  4325 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.833303  4332 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:50.835001  4219 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:50.836444  4624 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:50.837352  4624 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:50.838479  4624 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.963061  4506 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.963585  4506 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.965764  4506 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:50.970672  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:50.971899  4372 leader_election.cc:343] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:50.972276  4153 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.986704  4451 tablet_bootstrap.cc:492] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:50.987372  4451 ts_tablet_manager.cc:1403] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.198s	user 0.036s	sys 0.065s
I20260709 12:19:50.988319  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:50.989111  4252 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:50.990356  4450 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:50.990821  4450 ts_tablet_manager.cc:1403] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.240s	user 0.039s	sys 0.093s
I20260709 12:19:50.992376  4451 raft_consensus.cc:359] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.993347  4451 raft_consensus.cc:385] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.993724  4451 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.993458  4450 raft_consensus.cc:359] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.994280  4450 raft_consensus.cc:385] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:50.994576  4450 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:50.995365  4450 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:50.998768  4449 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:50.999239  4449 ts_tablet_manager.cc:1403] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.206s	user 0.060s	sys 0.094s
I20260709 12:19:51.000295  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:51.001091  4772 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.001523  4772 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.001878  4772 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:50.994695  4451 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.002935  4449 raft_consensus.cc:359] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.003612  4449 raft_consensus.cc:385] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.003863  4449 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.004328  4451 ts_tablet_manager.cc:1434] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:19:51.004611  4449 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.005206  4451 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:51.008508  4450 ts_tablet_manager.cc:1434] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:19:51.008530  4449 ts_tablet_manager.cc:1434] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:51.010257  4449 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:51.010492  4450 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.014369  4694 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:19:51.016148  4694 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.022464  4451 tablet_bootstrap.cc:654] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.023643  4694 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.025962  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.025986  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.028795  4296 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:51.033357  4594 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:51.045336  4449 tablet_bootstrap.cc:654] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.048180  4450 tablet_bootstrap.cc:654] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.046638  4772 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.081784  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:51.081919  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:51.082844  4252 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:51.083750  4372 leader_election.cc:343] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.084859  4772 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:51.113227  4451 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:51.114533  4451 ts_tablet_manager.cc:1403] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.110s	user 0.036s	sys 0.022s
I20260709 12:19:51.116914  4799 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.117419  4799 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.118178  4451 raft_consensus.cc:359] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.119438  4451 raft_consensus.cc:385] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.119868  4799 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.119963  4451 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.121654  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.124799  4451 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.134620  4451 ts_tablet_manager.cc:1434] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 12:19:51.136544  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:51.126299  4219 leader_election.cc:343] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.137529  4451 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:51.140354  4450 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:51.140851  4450 ts_tablet_manager.cc:1403] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.131s	user 0.021s	sys 0.032s
I20260709 12:19:51.135888  4252 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:51.162683  4449 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:51.163285  4449 ts_tablet_manager.cc:1403] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.153s	user 0.026s	sys 0.026s
W20260709 12:19:51.164165  4218 leader_election.cc:343] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.164672  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:51.166126  4449 raft_consensus.cc:359] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.166951  4449 raft_consensus.cc:385] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.167250  4449 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.168134  4449 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.169085  4624 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.170400  4449 ts_tablet_manager.cc:1434] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:19:51.171720  4694 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.172629  4450 raft_consensus.cc:359] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.171967  4451 tablet_bootstrap.cc:654] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.173360  4450 raft_consensus.cc:385] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.173733  4450 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.172206  4694 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.174490  4450 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.175328  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:51.176913  4450 ts_tablet_manager.cc:1434] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.036s	user 0.016s	sys 0.009s
I20260709 12:19:51.177112  4772 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.177621  4772 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:51.177942  4449 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:51.178439  4772 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.184676  4449 tablet_bootstrap.cc:654] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.188199  4450 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.196053  4450 tablet_bootstrap.cc:654] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:51.200078  4372 consensus_peers.cc:597] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.212067  4694 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.215065  4450 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:51.215651  4450 ts_tablet_manager.cc:1403] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 12:19:51.219461  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.220124  4252 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:51.218772  4450 raft_consensus.cc:359] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.223569  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.224047  4450 raft_consensus.cc:385] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.224462  4403 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:51.225540  4799 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.226029  4799 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.224442  4450 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.227916  4450 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.229413  4799 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.230573  4450 ts_tablet_manager.cc:1434] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:19:51.230826  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.231736  4450 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.230819  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.232380  4401 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:51.233459  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:19:51.234091  4219 leader_election.cc:343] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.234223  4799 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.228344  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:51.234598  4799 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.235164  4799 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.239821  4450 tablet_bootstrap.cc:654] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.245091  4449 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:51.245708  4449 ts_tablet_manager.cc:1403] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.007s
I20260709 12:19:51.247326  4799 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.247956  4624 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.248435  4624 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.248804  4449 raft_consensus.cc:359] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.249663  4449 raft_consensus.cc:385] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.249985  4449 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.250170  4799 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.250365  4624 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.250684  4449 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.251406  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:51.251688  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.251991  4401 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:51.253005  4218 leader_election.cc:343] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.253156  4449 ts_tablet_manager.cc:1434] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:19:51.254467  4449 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:51.256970  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.242942  4153 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:51.258073  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:51.261053  4449 tablet_bootstrap.cc:654] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.261894  4794 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.262266  4794 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.262579  4794 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.265512  4450 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:51.266068  4450 ts_tablet_manager.cc:1403] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.009s
I20260709 12:19:51.268936  4450 raft_consensus.cc:359] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.269896  4450 raft_consensus.cc:385] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.270368  4450 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.269944  4794 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.271360  4450 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.273834  4450 ts_tablet_manager.cc:1434] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:51.275049  4450 tablet_bootstrap.cc:492] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.277607  4772 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.284113  4450 tablet_bootstrap.cc:654] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:51.284528  4219 leader_election.cc:343] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.269141  4401 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:51.284963  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:19:51.287986  4219 leader_election.cc:343] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.288841  4807 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.291191  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:51.292259  4799 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.292744  4799 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:51.293982  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:51.294680  4804 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:51.296900  4449 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:51.297421  4449 ts_tablet_manager.cc:1403] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.003s
I20260709 12:19:51.297089  4799 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.294716  4257 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.304571  4449 raft_consensus.cc:359] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.316272  4449 raft_consensus.cc:385] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.316579  4449 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.322791  4450 tablet_bootstrap.cc:492] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:51.323418  4450 ts_tablet_manager.cc:1403] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 12:19:51.327344  4449 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.326804  4450 raft_consensus.cc:359] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.329974  4450 raft_consensus.cc:385] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.330914  4449 ts_tablet_manager.cc:1434] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:19:51.332842  4449 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:51.326761  4257 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:51.330331  4450 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.340430  4450 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:51.355161  4218 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.360848  4450 ts_tablet_manager.cc:1434] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 12:19:51.361649  4449 tablet_bootstrap.cc:654] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.362416  4450 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.340747  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:51.371402  4688 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.372061  4688 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:51.373175  4688 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.386138  4450 tablet_bootstrap.cc:654] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.393664  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:51.392520  4794 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.404462  4808 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.429039  4451 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:51.429543  4451 ts_tablet_manager.cc:1403] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.292s	user 0.060s	sys 0.036s
I20260709 12:19:51.412012  4403 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.424182  4808 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.455231  4449 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:51.455758  4449 ts_tablet_manager.cc:1403] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.019s
I20260709 12:19:51.456079  4451 raft_consensus.cc:359] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.456772  4451 raft_consensus.cc:385] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.457017  4451 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.457589  4451 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.458189  4449 raft_consensus.cc:359] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.458811  4449 raft_consensus.cc:385] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.459057  4449 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.460762  4804 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.461269  4804 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.461841  4808 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.462242  4450 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:51.463167  4804 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.463327  4450 ts_tablet_manager.cc:1403] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.007s
I20260709 12:19:51.465564  4403 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:51.465762  4449 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.468569  4450 raft_consensus.cc:359] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.469228  4450 raft_consensus.cc:385] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.469486  4450 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.470048  4449 ts_tablet_manager.cc:1434] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:19:51.470248  4450 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.471004  4449 tablet_bootstrap.cc:492] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:51.470892  4794 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.471479  4794 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.473816  4794 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.465569  4451 ts_tablet_manager.cc:1434] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:19:51.475013  4451 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:51.475255  4450 ts_tablet_manager.cc:1434] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:19:51.476986  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.479419  4450 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.479823  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.481128  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:51.487216  4296 leader_election.cc:343] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.485809  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.488337  4402 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:51.495033  4451 tablet_bootstrap.cc:654] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.496366  4450 tablet_bootstrap.cc:654] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.499029  4449 tablet_bootstrap.cc:654] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.542116  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:19:51.543030  4506 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.560173  4506 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:51.543989  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 69166us
I20260709 12:19:51.561053  4807 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.563671  4807 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.564213  4807 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.570261  4594 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.571077  4594 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.573912  4594 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.567977  4506 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:51.580238  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.582811  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.596197  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.597429  4253 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:51.586258  4153 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.599253  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:19:51.603657  4219 leader_election.cc:343] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.608464  4450 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
W20260709 12:19:51.619884  4219 leader_election.cc:343] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:51.631187  4296 leader_election.cc:343] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.631800  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:51.640610  4688 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:51.643445  4218 leader_election.cc:343] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.626698  4807 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.644001  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:51.645216  4804 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.646588  4807 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.648015  4450 ts_tablet_manager.cc:1403] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.005s
I20260709 12:19:51.656160  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:51.661300  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:51.662245  4406 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.665750  4451 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:51.666594  4451 ts_tablet_manager.cc:1403] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.007s
I20260709 12:19:51.670243  4451 raft_consensus.cc:359] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.671458  4451 raft_consensus.cc:385] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.671927  4451 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
W20260709 12:19:51.675762  4219 leader_election.cc:343] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.673537  4804 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:51.672850  4371 leader_election.cc:343] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.678390  4451 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.682756  4450 raft_consensus.cc:359] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.686856  4450 raft_consensus.cc:385] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.687148  4450 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.688700  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.690486  4449 tablet_bootstrap.cc:492] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:51.691215  4449 ts_tablet_manager.cc:1403] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.220s	user 0.018s	sys 0.009s
I20260709 12:19:51.677680  4804 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.694183  4152 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.702354  4449 raft_consensus.cc:359] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.703820  4449 raft_consensus.cc:385] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:51.705252  4449 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:51.706218  4449 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.706929  4804 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.696906  4450 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.709028  4450 ts_tablet_manager.cc:1434] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:19:51.710790  4450 tablet_bootstrap.cc:492] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:51.711887  4449 ts_tablet_manager.cc:1434] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:19:51.719393  4449 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:51.722519  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.725421  4406 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:51.726747  4860 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.727274  4860 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.729717  4860 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:51.730938  4332 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:51.734691  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:19:51.743531  4451 ts_tablet_manager.cc:1434] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 12:19:51.743572  4732 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.745150  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.745563  4732 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.746122  4732 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.750913  4451 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:51.731719  4859 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:51.753895  4219 leader_election.cc:343] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.755762  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:51.756507  4401 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
W20260709 12:19:51.759207  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 59929us
I20260709 12:19:51.764101  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:51.753746  4859 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.804749  4775 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.805384  4775 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.805778  4732 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.834203  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:51.837950  4775 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:51.842499  4624 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:51.839145  4694 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.845417  4732 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:51.846858  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.861128  4449 tablet_bootstrap.cc:654] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:51.884160  4296 leader_election.cc:343] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.884598  4450 tablet_bootstrap.cc:654] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:51.896111  4859 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:51.906086  4451 tablet_bootstrap.cc:654] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:51.907903  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 70823.9us
W20260709 12:19:51.908409  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 71314.1us
I20260709 12:19:51.886080  4624 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:19:51.924696  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 86960.1us
I20260709 12:19:51.925348  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:19:51.928331  4219 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:51.930481  4732 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:19:51.936595  4808 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.914580  4594 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:19:51.944679  4694 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:51.915763  4804 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.938566  4853 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:51.951932  4853 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.960935  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.961438  4449 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:51.964468  4449 ts_tablet_manager.cc:1403] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.250s	user 0.011s	sys 0.010s
I20260709 12:19:51.965528  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.966822  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:51.964793  4853 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:51.967320  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:19:51.971380  4372 leader_election.cc:343] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:51.952855  4804 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.950212  4808 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.978812  4624 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:51.987826  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:51.990010  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:51.990670  4329 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.007076  4804 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.010802  4449 raft_consensus.cc:359] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.011584  4449 raft_consensus.cc:385] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:19:52.000299  4372 leader_election.cc:343] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.012176  4449 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.014339  4775 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.014793  4449 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.022289  4254 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.029876  4449 ts_tablet_manager.cc:1434] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.002s
I20260709 12:19:52.033358  4450 tablet_bootstrap.cc:492] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:52.033993  4450 ts_tablet_manager.cc:1403] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.324s	user 0.018s	sys 0.006s
I20260709 12:19:52.035171  4449 tablet_bootstrap.cc:492] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:52.014724  4853 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:52.037541  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 87897.1us
I20260709 12:19:52.039778  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:52.040215  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:52.053099  4808 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.053948  4254 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:52.084589  4329 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
W20260709 12:19:52.085105  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:52.089049  4853 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:19:52.088943  4219 leader_election.cc:343] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:52.094300  4219 leader_election.cc:343] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.094914  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:52.099852  4450 raft_consensus.cc:359] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.100571  4450 raft_consensus.cc:385] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.100860  4450 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.121536  4450 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.131788  4450 ts_tablet_manager.cc:1434] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.004s
I20260709 12:19:52.109660  4867 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.128703  4449 tablet_bootstrap.cc:654] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.133093  4867 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:52.133718  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.138685  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:52.134897  4867 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.152406  4450 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
W20260709 12:19:52.162933  4219 leader_election.cc:343] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.191711  4152 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.204317  4451 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:52.204928  4451 ts_tablet_manager.cc:1403] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.454s	user 0.009s	sys 0.016s
I20260709 12:19:52.223254  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:19:52.227614  4371 leader_election.cc:343] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.228523  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.229888  4451 raft_consensus.cc:359] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.230541  4451 raft_consensus.cc:385] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.230794  4451 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.229305  4688 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.232905  4775 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.234552  4864 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.238903  4488 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:52.241765  4371 leader_election.cc:343] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.242205  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.249132  4451 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.263496  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.245047  4775 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.266503  4449 tablet_bootstrap.cc:492] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:52.267024  4449 ts_tablet_manager.cc:1403] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.236s	user 0.019s	sys 0.002s
I20260709 12:19:52.268076  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.269958  4449 raft_consensus.cc:359] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.270691  4449 raft_consensus.cc:385] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.270988  4449 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.273790  4450 tablet_bootstrap.cc:654] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.279209  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:52.279929  4405 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.289551  4449 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:19:52.304018  4218 leader_election.cc:343] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.304520  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:19:52.305876  4218 leader_election.cc:343] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.306290  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.306421  4451 ts_tablet_manager.cc:1434] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.002s
I20260709 12:19:52.310366  4451 tablet_bootstrap.cc:492] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:52.305905  4449 ts_tablet_manager.cc:1434] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:19:52.324090  4869 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.320406  4864 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.336716  4449 tablet_bootstrap.cc:492] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:52.375787  4451 tablet_bootstrap.cc:654] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.380672  4405 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:52.385862  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.388397  4873 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.389591  4873 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:52.390508  4873 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.391996  4151 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.400373  4450 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:52.401043  4450 ts_tablet_manager.cc:1403] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.255s	user 0.014s	sys 0.011s
I20260709 12:19:52.394754  4449 tablet_bootstrap.cc:654] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.433920  4450 raft_consensus.cc:359] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.436444  4450 raft_consensus.cc:385] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.436748  4450 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.446235  4450 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.467743  4450 ts_tablet_manager.cc:1434] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.002s
I20260709 12:19:52.464114  4694 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.471690  4694 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.472550  4451 tablet_bootstrap.cc:492] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:52.473073  4451 ts_tablet_manager.cc:1403] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.002s
I20260709 12:19:52.480587  4450 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:52.488556  4333 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.491680  4153 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.504822  4694 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.513211  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:52.515039  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.519409  4407 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:52.522342  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:52.524724  4450 tablet_bootstrap.cc:654] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.528213  4449 tablet_bootstrap.cc:492] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:52.528684  4449 ts_tablet_manager.cc:1403] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.205s	user 0.018s	sys 0.013s
I20260709 12:19:52.528734  4694 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.530031  4807 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.529604  4451 raft_consensus.cc:359] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.531561  4451 raft_consensus.cc:385] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.531873  4451 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.532737  4451 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.532925  4449 raft_consensus.cc:359] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.533560  4449 raft_consensus.cc:385] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.533804  4449 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.535799  4449 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.539309  4449 ts_tablet_manager.cc:1434] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:52.540261  4449 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:19:52.540503  4451 ts_tablet_manager.cc:1434] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 12:19:52.541929  4450 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:52.542374  4450 ts_tablet_manager.cc:1403] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.001s
I20260709 12:19:52.543852  4775 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.544543  4775 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.546627  4775 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:52.547636  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:52.547986  4449 tablet_bootstrap.cc:654] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.550309  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:52.551801  4372 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.552829  4732 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.554270  4451 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:52.564415  4450 raft_consensus.cc:359] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.565114  4450 raft_consensus.cc:385] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.565362  4450 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.567404  4450 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.569126  4450 ts_tablet_manager.cc:1434] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
I20260709 12:19:52.578720  4450 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:52.614442  4451 tablet_bootstrap.cc:654] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.617457  4449 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: No bootstrap required, opened a new log
I20260709 12:19:52.617990  4449 ts_tablet_manager.cc:1403] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.006s
I20260709 12:19:52.619504  4450 tablet_bootstrap.cc:654] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.619905  4865 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:52.622750  4775 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.623226  4775 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.625430  4775 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:52.630697  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:52.632741  4372 leader_election.cc:343] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.638747  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:52.639437  4252 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:52.640915  4449 raft_consensus.cc:359] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.641896  4449 raft_consensus.cc:385] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.642169  4449 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.642946  4449 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.654785  4873 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.655289  4873 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.657454  4873 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.659113  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:52.660576  4219 leader_election.cc:343] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.663722  4449 ts_tablet_manager.cc:1434] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:19:52.669361  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.670362  4867 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.670734  4867 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.671075  4867 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.688161  4451 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:52.688684  4451 ts_tablet_manager.cc:1403] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.135s	user 0.025s	sys 0.023s
I20260709 12:19:52.691591  4451 raft_consensus.cc:359] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.692237  4451 raft_consensus.cc:385] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.692531  4451 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.693130  4451 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.695194  4451 ts_tablet_manager.cc:1434] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:52.697824  4451 tablet_bootstrap.cc:492] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:52.701640  4867 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.703332  4865 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.709232  4869 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:52.704214  4451 tablet_bootstrap.cc:654] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.706350  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.710206  4405 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:52.712977  4867 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:52.714370  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:52.721017  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.722580  4869 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.722599  4450 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:52.723121  4869 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.723834  4869 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.723852  4450 ts_tablet_manager.cc:1403] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.145s	user 0.013s	sys 0.002s
W20260709 12:19:52.728037  4372 leader_election.cc:343] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.737260  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:52.738013  4252 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.738013  4450 raft_consensus.cc:359] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.739089  4450 raft_consensus.cc:385] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.739468  4450 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.744455  4873 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.756040  4873 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.762233  4869 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.763646  4450 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.767452  4694 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.768023  4873 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.767992  4694 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.772181  4694 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.781741  4694 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.782239  4694 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.785219  4694 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.786636  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.789628  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:52.789914  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:52.790288  4254 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
I20260709 12:19:52.790512  4250 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
W20260709 12:19:52.793089  4218 leader_election.cc:343] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.797760  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:52.800768  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:52.801230  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.802085  4407 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 0.
W20260709 12:19:52.802233  4219 leader_election.cc:343] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.799634  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:52.803388  4694 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:52.803431  4219 leader_election.cc:343] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.803828  4694 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.804198  4694 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.804071  4219 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.805837  4873 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:52.811570  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.812630  4694 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.811707  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:52.815042  4488 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.815399  4488 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.815714  4488 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.823396  4869 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.823179  4488 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.769744  4450 ts_tablet_manager.cc:1434] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:19:52.823441  4694 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.824929  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:52.825218  4488 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.826542  4252 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:52.827258  4257 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.830780  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:52.831439  4407 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:52.831570  4296 leader_election.cc:343] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.834888  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:52.836220  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:19:52.836912  4401 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.837173  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.830770  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:52.840054  4859 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.840478  4450 tablet_bootstrap.cc:492] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
W20260709 12:19:52.843087  4296 leader_election.cc:343] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.840214  4252 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.845992  4257 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:52.839395  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:52.852473  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.852607  4405 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.853600  4799 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.854241  4799 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:52.848685  4859 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:52.858530  4859 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.873495  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:52.874501  4488 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.874953  4488 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:52.870517  4799 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.875730  4488 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.870594  4868 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 12:19:52.886906  4219 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:52.893522  4401 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:52.893711  4252 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:19:52.895195  4807 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.903414  4807 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.907876  4807 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.910540  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:52.911670  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.912382  4402 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
W20260709 12:19:52.913025  4219 leader_election.cc:343] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:52.914270  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:19:52.915198  4488 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:52.915844  4488 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:19:52.916746  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:52.916584  4488 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.917912  4868 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:52.918327  4868 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.919445  4868 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.926591  4153 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.934464  4451 tablet_bootstrap.cc:492] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:52.934983  4451 ts_tablet_manager.cc:1403] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.237s	user 0.070s	sys 0.076s
I20260709 12:19:52.938509  4451 raft_consensus.cc:359] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.941351  4451 raft_consensus.cc:385] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:52.941609  4451 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:52.942621  4451 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.957139  4688 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.957592  4688 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:52.955664  4151 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.961527  4688 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:52.964241  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:52.966287  4450 tablet_bootstrap.cc:654] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:52.968549  4252 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:52.946327  4153 catalog_manager.cc:5697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.980712  4451 ts_tablet_manager.cc:1434] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:19:52.984720  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:52.987996  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:52.989571  4694 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:52.992883  4807 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.993427  4807 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.006047  4451 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.017400  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:19:53.019363  4218 leader_election.cc:343] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.019951  4865 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.020464  4865 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.021136  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:53.021908  4333 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 0.
I20260709 12:19:53.025409  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:19:53.026662  4372 leader_election.cc:343] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.031575  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:53.033100  4865 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:53.035537  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:53.036244  4252 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:53.037632  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.038672  4867 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.039062  4867 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.039417  4867 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.055394  4869 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.057837  4869 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.058190  4869 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.002904  4868 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.028192  4807 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:53.076439  4867 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.077925  4869 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.079134  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:53.079771  4252 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.085494  4694 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.085621  4252 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:53.087459  4450 tablet_bootstrap.cc:492] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:53.087950  4450 ts_tablet_manager.cc:1403] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.248s	user 0.033s	sys 0.021s
I20260709 12:19:53.090811  4450 raft_consensus.cc:359] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.091558  4450 raft_consensus.cc:385] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.091831  4450 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.092535  4869 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:53.092633  4450 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.093528  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:19:53.094857  4218 leader_election.cc:343] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.094496  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:53.097009  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:53.097376  4867 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:19:53.098272  4372 leader_election.cc:343] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.095176  4451 tablet_bootstrap.cc:654] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.098920  4868 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:53.098999  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:19:53.100728  4450 ts_tablet_manager.cc:1434] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:19:53.102838  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.105095  4450 tablet_bootstrap.cc:492] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:53.103623  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:19:53.105640  4219 leader_election.cc:343] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.110013  4405 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.107674  4865 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.112634  4865 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:53.114480  4865 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.096627  4333 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.121428  4450 tablet_bootstrap.cc:654] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.124599  4152 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.143695  4405 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:53.146714  4333 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:19:53.150867  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.152140  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:53.152730  4868 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.152967  4869 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.153285  4868 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:53.153436  4869 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:19:53.154310  4450 tablet_bootstrap.cc:492] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:53.154825  4450 ts_tablet_manager.cc:1403] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 12:19:53.154168  4868 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.154245  4869 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.160072  4450 raft_consensus.cc:359] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.160805  4450 raft_consensus.cc:385] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.161089  4450 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.161767  4450 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.164018  4450 ts_tablet_manager.cc:1434] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:53.165031  4450 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Bootstrap starting.
I20260709 12:19:53.171675  4451 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.173868  4450 tablet_bootstrap.cc:654] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.173913  4451 ts_tablet_manager.cc:1403] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.028s
I20260709 12:19:53.182986  4451 raft_consensus.cc:359] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.183706  4451 raft_consensus.cc:385] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.183974  4451 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.192526  4451 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.196409  4451 ts_tablet_manager.cc:1434] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:19:53.198143  4451 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.200966  4450 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: No bootstrap required, opened a new log
I20260709 12:19:53.201496  4450 ts_tablet_manager.cc:1403] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.012s
I20260709 12:19:53.204443  4451 tablet_bootstrap.cc:654] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.220463  4450 raft_consensus.cc:359] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.221223  4450 raft_consensus.cc:385] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.221487  4450 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.222110  4450 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.224237  4450 ts_tablet_manager.cc:1434] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:19:53.224123  4153 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.225505  4153 catalog_manager.cc:5697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:53.220489  4152 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.256547  4451 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.257050  4451 ts_tablet_manager.cc:1403] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.010s
I20260709 12:19:53.259639  4451 raft_consensus.cc:359] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.260280  4451 raft_consensus.cc:385] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.260586  4451 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.261327  4451 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.263393  4451 ts_tablet_manager.cc:1434] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 12:19:53.268867  4867 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.269381  4867 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.276280  4594 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.279177  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:53.279428  4867 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:19:53.280567  4372 leader_election.cc:343] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:53.281013  4867 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.281531  4867 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.284050  4451 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.292366  4865 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.296700  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:53.297482  4257 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 0.
I20260709 12:19:53.300671  4867 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:53.302174  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:53.302285  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:53.305137  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.306133  4867 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:53.306547  4867 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:53.306973  4867 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.314158  4451 tablet_bootstrap.cc:654] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.309026  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.319821  4865 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.359265  4401 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.380023  4867 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.382230  4867 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:53.383641  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:19:53.385654  4372 leader_election.cc:343] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:53.393450  4201 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:53.397432  4694 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.403206  4869 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.406687  4865 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.438834  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:19:53.439536  4253 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.454595  4253 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:19:53.455379  4451 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.455878  4451 ts_tablet_manager.cc:1403] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.172s	user 0.030s	sys 0.020s
I20260709 12:19:53.457638  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.460959  4865 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:53.458464  4451 raft_consensus.cc:359] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.461140  4775 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.461961  4865 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:19:53.462208  4775 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.463392  4865 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.464814  4775 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:53.466296  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:19:53.467051  4334 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 1: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:19:53.462756  4451 raft_consensus.cc:385] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.475193  4451 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.476655  4451 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.478626  4451 ts_tablet_manager.cc:1434] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:19:53.479811  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:53.480221  4451 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.489899  4688 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.494607  4451 tablet_bootstrap.cc:654] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.495544  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:19:53.496650  4775 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.504673  4688 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.505385  4775 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:53.509163  4219 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.528244  4153 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:53.536026  4334 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.544621  4594 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:19:53.545087  4594 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.547143  4594 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:53.557577  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:53.563987  4451 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.566069  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:53.566123  4451 ts_tablet_manager.cc:1403] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.014s
I20260709 12:19:53.568729  4889 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:53.571285  4451 raft_consensus.cc:359] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.579430  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:19:53.582069  4372 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.582765  4488 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:53.584494  4451 raft_consensus.cc:385] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.584846  4451 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.589424  4451 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.590133  4333 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.591696  4451 ts_tablet_manager.cc:1434] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:19:53.592717  4451 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.598822  4451 tablet_bootstrap.cc:654] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.616839  4451 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.617306  4451 ts_tablet_manager.cc:1403] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 12:19:53.619263  4451 raft_consensus.cc:359] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.619966  4451 raft_consensus.cc:385] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.620234  4451 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.620913  4451 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.623215  4451 ts_tablet_manager.cc:1434] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:19:53.625290  4451 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.642946  4451 tablet_bootstrap.cc:654] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.643075  4869 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:53.652105  4219 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.661414  4451 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.663141  4451 ts_tablet_manager.cc:1403] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.007s
I20260709 12:19:53.669152  4451 raft_consensus.cc:359] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.669799  4451 raft_consensus.cc:385] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.670055  4451 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.672210  4451 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.673481  4451 ts_tablet_manager.cc:1434] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 12:19:53.674338  4451 tablet_bootstrap.cc:492] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
I20260709 12:19:53.681208  4451 tablet_bootstrap.cc:654] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:53.683640  4868 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.701699  4451 tablet_bootstrap.cc:492] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: No bootstrap required, opened a new log
I20260709 12:19:53.702160  4451 ts_tablet_manager.cc:1403] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.010s
I20260709 12:19:53.707912  4451 raft_consensus.cc:359] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.708488  4451 raft_consensus.cc:385] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:53.708947  4451 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: FOLLOWER
I20260709 12:19:53.709595  4451 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.711285  4451 ts_tablet_manager.cc:1434] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:19:53.744714  4775 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.816038  4333 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.852020  4594 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.852509  4594 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:53.854259  4594 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:53.855604  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:53.856405  4253 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 1: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:19:53.860188  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:53.861477  4296 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:53.862918  4594 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:53.869067  4594 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:53.933224  4865 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:53.946786  4732 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:54.013569  4488 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.014065  4488 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:54.015913  4488 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:54.020656  4333 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.026623  4594 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.033519  4594 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:19:54.035547  4594 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:54.059505  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:54.062089  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:19:54.065454  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:54.069852  4334 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.070571  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:19:54.084234  4296 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:54.085551  4296 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:19:54.086617  4941 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.090191  4941 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:54.110508  4334 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:54.185041  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:54.222100  4947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:54.222134  4946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:54.225896  3102 server_base.cc:1061] running on GCE node
W20260709 12:19:54.226933  4949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:54.231077  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:54.231457  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:54.232105  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599594232082 us; error 0 us; skew 500 ppm
I20260709 12:19:54.232964  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:54.241762  3102 webserver.cc:533] Webserver started at http://127.3.7.132:40667/ using document root <none> and password file <none>
I20260709 12:19:54.242393  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:54.242710  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:54.243129  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:54.244618  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-3-root/instance:
uuid: "0952d204644f41a88e5e463e697dcc27"
format_stamp: "Formatted at 2026-07-09 12:19:54 on dist-test-slave-6qf7"
I20260709 12:19:54.250567  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:19:54.254712  4954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:54.255720  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:54.256142  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-3-root
uuid: "0952d204644f41a88e5e463e697dcc27"
format_stamp: "Formatted at 2026-07-09 12:19:54 on dist-test-slave-6qf7"
I20260709 12:19:54.256558  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:54.288223  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:54.290094  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:54.302038  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:54.306320  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:54.306704  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:19:54.307085  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:54.307340  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:54.612500  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.132:43853
I20260709 12:19:54.612633  5016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.132:43853 every 8 connection(s)
I20260709 12:19:54.653568  3102 auto_leader_rebalancer-test.cc:439] add a tserver: 0952d204644f41a88e5e463e697dcc27
I20260709 12:19:54.660889  5018 heartbeater.cc:344] Connected to a master server at 127.3.7.190:34185
I20260709 12:19:54.661336  5018 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:54.662034  5018 heartbeater.cc:507] Master 127.3.7.190:34185 requested a full tablet report, sending...
I20260709 12:19:54.663975  4153 ts_manager.cc:194] Registered new tserver with Master: 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:19:54.665433  4153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50716
I20260709 12:19:55.692085  5018 heartbeater.cc:499] Master 127.3.7.190:34185 was elected leader, sending a full tablet report...
W20260709 12:19:55.790956  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52111.1us
I20260709 12:19:55.797083  4333 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:55.862285  4253 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:55.864190  4402 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:55.867261  4688 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:55.892138  4688 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:55.907974  4252 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:55.940595  4153 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.963693  5026 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:55.968554  4296 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89ea196b53354b90b1803ebad82f35ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.974927  4407 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:55.984622  4402 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.003341  4333 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:56.007387  5033 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:56.010895  4252 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:56.014413  5033 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:56.024869  4371 consensus_peers.cc:597] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd8463b2beaf488989ffd8e005249050. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.037811  5033 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.040567  4327 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.040834  4253 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.072499  4152 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:56.104740  4253 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.130597  4333 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:56.136324  4868 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:56.149376  4400 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:56.151827  5022 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:56.161227  5024 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.166574  4327 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:19:56.175575  4218 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6675e0fefdad403abd03803e0c2bf3dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.176525  4407 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.183215  4400 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.193409  4152 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.215170  4253 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:56.216580  4371 consensus_peers.cc:597] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9d53e2537c9446fb3bf3c50fc0d5556. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.218644  5036 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:56.220449  4325 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:56.222041  5033 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:56.274507  5072 ts_tablet_manager.cc:933] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:19:56.273723  5033 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.275260  4252 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.276908  4327 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.314755  4151 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:19:56.320884  5072 tablet_copy_client.cc:323] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:19:56.351472  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 89ea196b53354b90b1803ebad82f35ff from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:19:56.352061  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 89ea196b53354b90b1803ebad82f35ff from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-89ea196b53354b90b1803ebad82f35ff
I20260709 12:19:56.365532  4344 tablet_copy_source_session.cc:215] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:56.369648  5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ea196b53354b90b1803ebad82f35ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.388003  5072 tablet_copy_client.cc:806] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:56.389072  5072 tablet_copy_client.cc:670] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:56.394973  5072 tablet_copy_client.cc:538] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:56.405962  5072 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:19:56.418413  5076 ts_tablet_manager.cc:933] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:56.426097  5076 tablet_copy_client.cc:323] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:19:56.438359  5072 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:56.438544  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet dd8463b2beaf488989ffd8e005249050 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:19:56.439117  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet dd8463b2beaf488989ffd8e005249050 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-dd8463b2beaf488989ffd8e005249050
I20260709 12:19:56.440088  5072 tablet_bootstrap.cc:492] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:19:56.440898  5072 ts_tablet_manager.cc:1403] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.009s
I20260709 12:19:56.444397  5072 raft_consensus.cc:359] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.445182  5072 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:19:56.445824  5072 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.446972  4419 tablet_copy_source_session.cc:215] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:56.452068  5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8463b2beaf488989ffd8e005249050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.478006  5072 ts_tablet_manager.cc:1434] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.037s	user 0.019s	sys 0.016s
I20260709 12:19:56.478703  5076 tablet_copy_client.cc:806] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:56.479328  5076 tablet_copy_client.cc:670] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:56.481802  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-89ea196b53354b90b1803ebad82f35ff received from {username='slave'} at 127.0.0.1:40644
I20260709 12:19:56.482365  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-89ea196b53354b90b1803ebad82f35ff on tablet 89ea196b53354b90b1803ebad82f35ff with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:19:56.487417  5076 tablet_copy_client.cc:538] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:56.497206  5076 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:19:56.524878  5076 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:56.525774  5076 tablet_bootstrap.cc:492] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:19:56.526430  5076 ts_tablet_manager.cc:1403] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 12:19:56.529435  5076 raft_consensus.cc:359] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.530285  5076 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:19:56.530922  5076 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.534600  5076 ts_tablet_manager.cc:1434] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 12:19:56.537209  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-dd8463b2beaf488989ffd8e005249050 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:19:56.537642  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-dd8463b2beaf488989ffd8e005249050 on tablet dd8463b2beaf488989ffd8e005249050 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:19:56.571671  5076 ts_tablet_manager.cc:933] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:19:56.576303  5076 tablet_copy_client.cc:323] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:19:56.599740  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 6675e0fefdad403abd03803e0c2bf3dd from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:19:56.600445  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 6675e0fefdad403abd03803e0c2bf3dd from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-6675e0fefdad403abd03803e0c2bf3dd
W20260709 12:19:56.603490  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0600 after lost signal to thread 3105
W20260709 12:19:56.604722  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4480 after lost signal to thread 4187
W20260709 12:19:56.605942  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1800 after lost signal to thread 4281
W20260709 12:19:56.607048  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0140 after lost signal to thread 4358
W20260709 12:19:56.608204  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff7a0 after lost signal to thread 4433
I20260709 12:19:56.618911  4267 tablet_copy_source_session.cc:215] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:56.624712  5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6675e0fefdad403abd03803e0c2bf3dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:56.660806  5076 tablet_copy_client.cc:806] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:56.661398  5076 tablet_copy_client.cc:670] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:56.667001  5076 tablet_copy_client.cc:538] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:56.676432  5076 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:19:56.720460  5076 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:56.721472  5076 tablet_bootstrap.cc:492] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:19:56.722218  5076 ts_tablet_manager.cc:1403] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.011s
I20260709 12:19:56.725270  5076 raft_consensus.cc:359] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.726109  5076 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:19:56.726763  5076 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:56.731715  5076 ts_tablet_manager.cc:1434] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 12:19:56.733836  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-6675e0fefdad403abd03803e0c2bf3dd received from {username='slave'} at 127.0.0.1:57876
I20260709 12:19:56.734354  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-6675e0fefdad403abd03803e0c2bf3dd on tablet 6675e0fefdad403abd03803e0c2bf3dd with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:19:56.763826  5076 ts_tablet_manager.cc:933] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:19:56.794121  5076 tablet_copy_client.cc:323] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:19:56.967763  4989 raft_consensus.cc:1217] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:56.969754  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet b9d53e2537c9446fb3bf3c50fc0d5556 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:19:56.970436  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet b9d53e2537c9446fb3bf3c50fc0d5556 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-b9d53e2537c9446fb3bf3c50fc0d5556
I20260709 12:19:57.012408  4989 raft_consensus.cc:1217] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:57.028623  4419 tablet_copy_source_session.cc:215] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:57.033360  5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d53e2537c9446fb3bf3c50fc0d5556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:57.051239  4989 raft_consensus.cc:1217] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:19:57.119652  5076 tablet_copy_client.cc:806] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:57.120299  5076 tablet_copy_client.cc:670] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:57.171339  5076 tablet_copy_client.cc:538] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:57.206027  5076 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:19:57.307188  5076 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:57.308121  5076 tablet_bootstrap.cc:492] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:19:57.308799  5076 ts_tablet_manager.cc:1403] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.000s
I20260709 12:19:57.311519  5076 raft_consensus.cc:359] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:57.312397  5076 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:19:57.313056  5076 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:57.322232  5076 ts_tablet_manager.cc:1434] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:19:57.332934  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-b9d53e2537c9446fb3bf3c50fc0d5556 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:19:57.333438  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-b9d53e2537c9446fb3bf3c50fc0d5556 on tablet b9d53e2537c9446fb3bf3c50fc0d5556 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:19:57.390247  5087 raft_consensus.cc:1064] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:19:57.393621  5087 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:57.410681  4990 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.413823  4333 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.417524  4401 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.421149  4688 raft_consensus.cc:1064] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:19:57.422533  5094 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.423799  4688 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:57.429708  5037 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.451773  5088 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.488852  5088 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.492000  4406 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.523144  4152 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.564309  4989 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.575951  4989 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.589443  4333 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.600871  5052 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:57.611547  4252 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.769490  5086 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:57.771982  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52171.7us
I20260709 12:19:57.776247  4401 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:57.814260  4688 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.816341  4252 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.827720  4990 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.842711  5084 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.847081  4990 raft_consensus.cc:1217] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:19:57.856988  5093 raft_consensus.cc:1064] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:19:57.862764  5093 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:57.884056  4405 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.910907  4990 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:57.912624  5092 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.912662  4330 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:57.914182  4253 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:19:57.915357  4252 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:57.916879  5028 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.922242  5092 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:57.928695  4152 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.961875  4989 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:57.963718  5103 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:57.965533  4333 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:57.971026  4401 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:57.976455  5089 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:57.981993  4256 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:57.984727  5084 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:57.984273  5088 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.986920  4989 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:57.989451  5086 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:57.993719  4989 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:57.998718  5052 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.005705  4987 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.010551  4401 raft_consensus.cc:2955] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.011943  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6675e0fefdad403abd03803e0c2bf3dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:58.026989  4149 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.053198  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 6675e0fefdad403abd03803e0c2bf3dd with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:19:58.058065  4252 raft_consensus.cc:2955] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.094686  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89ea196b53354b90b1803ebad82f35ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:58.119215  5092 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.131747  4152 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.137115  4329 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.156975  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 89ea196b53354b90b1803ebad82f35ff with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:19:58.172979  4987 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.190105  4252 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.190564  4152 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.214140  5116 tablet_replica.cc:333] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:19:58.215209  5116 raft_consensus.cc:2243] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:58.215890  5116 raft_consensus.cc:2272] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:58.222440  5115 tablet_replica.cc:333] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:19:58.225675  5116 ts_tablet_manager.cc:1916] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:58.226169  4405 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:58.271039  4330 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:58.273021  5115 raft_consensus.cc:2243] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:58.273501  5093 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:58.273851  5115 raft_consensus.cc:2272] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:58.285125  4990 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:19:58.284785  5093 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.295109  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd8463b2beaf488989ffd8e005249050 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:58.297169  4333 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.285722  5115 ts_tablet_manager.cc:1916] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:58.304136  5028 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:58.318617  4987 raft_consensus.cc:2955] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.341770  5116 ts_tablet_manager.cc:1929] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:58.358458  5116 log.cc:1199] T 89ea196b53354b90b1803ebad82f35ff P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/89ea196b53354b90b1803ebad82f35ff
I20260709 12:19:58.363812  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 89ea196b53354b90b1803ebad82f35ff (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:19:58.367741  5115 ts_tablet_manager.cc:1929] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:58.368324  5115 log.cc:1199] T 6675e0fefdad403abd03803e0c2bf3dd P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/6675e0fefdad403abd03803e0c2bf3dd
I20260709 12:19:58.373672  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 6675e0fefdad403abd03803e0c2bf3dd (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:19:58.434274  5028 raft_consensus.cc:1064] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:19:58.437114  5028 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:58.438753  4153 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.469843  4987 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:58.474269  4333 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:58.475840  5028 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:58.479856  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet dd8463b2beaf488989ffd8e005249050 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:19:58.480321  4252 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:19:58.488616  5118 tablet_replica.cc:333] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:19:58.489830  5118 raft_consensus.cc:2243] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:58.490604  5118 raft_consensus.cc:2272] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:58.497126  5118 ts_tablet_manager.cc:1916] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:58.497488  5028 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:58.499881  5093 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:58.515736  4252 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.514001  5093 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.527601  5118 ts_tablet_manager.cc:1929] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:19:58.528077  5118 log.cc:1199] T dd8463b2beaf488989ffd8e005249050 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/dd8463b2beaf488989ffd8e005249050
I20260709 12:19:58.532158  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet dd8463b2beaf488989ffd8e005249050 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:19:58.552526  4333 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.583345  4153 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.578816  4987 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.608461  4401 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:19:58.719129  4987 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:58.720577  4333 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:19:58.722334  5092 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:58.723898  5093 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:58.742031  5028 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.750025  4333 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.759814  4987 raft_consensus.cc:2955] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:19:58.768797  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9d53e2537c9446fb3bf3c50fc0d5556 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:58.795354  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 46155.7us
I20260709 12:19:58.826122  4149 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.857751  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet b9d53e2537c9446fb3bf3c50fc0d5556 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:19:58.858753  5118 tablet_replica.cc:333] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:19:58.859903  5118 raft_consensus.cc:2243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:58.860723  5118 raft_consensus.cc:2272] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:58.864722  5118 ts_tablet_manager.cc:1916] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:58.883206  5118 ts_tablet_manager.cc:1929] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:19:58.883770  5118 log.cc:1199] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/b9d53e2537c9446fb3bf3c50fc0d5556
I20260709 12:19:58.885790  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet b9d53e2537c9446fb3bf3c50fc0d5556 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:19:59.973230  4254 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:19:59.981664  4400 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:19:59.982410  4333 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:19:59.983739  4218 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1abb211136c54a29beecc019715aaa2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.984576  5123 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:59.986672  5103 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:00.010080  5123 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.018185  4400 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.036489  4333 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.052160  4254 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:00.063210  4153 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.076916  4326 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.078636  5103 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:00.081233  4218 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 631cc1317abe4f99b307dee5289f9258. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.082451  4400 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:00.091951  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 47593.3us
I20260709 12:20:00.092681  5103 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:00.145392  5123 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.147423  4326 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.158967  4407 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.185289  4400 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:00.242877  4371 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 520cf0102a3945aebdd2da293d919a52. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.245688  4326 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.246069  4254 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.247831  5028 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:00.253224  5028 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:00.283372  5093 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.341769  4148 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.358479  4333 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.423734  5145 ts_tablet_manager.cc:933] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:00.430994  5145 tablet_copy_client.cc:323] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:00.433802  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 1abb211136c54a29beecc019715aaa2d from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:00.434520  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 1abb211136c54a29beecc019715aaa2d from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-1abb211136c54a29beecc019715aaa2d
I20260709 12:20:00.444355  4326 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:00.454666  4149 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.463960  4267 tablet_copy_source_session.cc:215] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:00.465255  4254 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.490283  5145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1abb211136c54a29beecc019715aaa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:00.540870  4401 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:00.541019  4296 consensus_peers.cc:597] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a08fb4e151924fb6944c6a5f82c4f9d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:00.542536  4254 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:00.542460  5130 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.544353  5052 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:00.548650  5145 tablet_copy_client.cc:806] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:00.549463  5145 tablet_copy_client.cc:670] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:00.553742  5145 tablet_copy_client.cc:538] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:00.572211  5145 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:00.590960  5052 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.595170  4401 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.615540  5151 ts_tablet_manager.cc:933] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:00.617769  4149 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:00.625221  5151 tablet_copy_client.cc:323] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:00.637645  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 631cc1317abe4f99b307dee5289f9258 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:00.638293  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 631cc1317abe4f99b307dee5289f9258 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-631cc1317abe4f99b307dee5289f9258
W20260709 12:20:00.646313  5150 log.cc:927] Time spent T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:00.653640  4254 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:00.675529  4267 tablet_copy_source_session.cc:215] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:00.680442  5151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631cc1317abe4f99b307dee5289f9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:00.703320  5154 ts_tablet_manager.cc:933] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:00.700013  5145 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:00.720160  5145 tablet_bootstrap.cc:492] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:00.725306  5145 ts_tablet_manager.cc:1403] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.154s	user 0.026s	sys 0.011s
I20260709 12:20:00.748420  5154 tablet_copy_client.cc:323] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:00.750295  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 520cf0102a3945aebdd2da293d919a52 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:00.750411  5145 raft_consensus.cc:359] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:00.750908  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 520cf0102a3945aebdd2da293d919a52 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-520cf0102a3945aebdd2da293d919a52
I20260709 12:20:00.751386  5145 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:00.752091  5145 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:00.760257  4419 tablet_copy_source_session.cc:215] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:00.794286  5151 tablet_copy_client.cc:806] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:00.795037  5151 tablet_copy_client.cc:670] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:00.805781  5151 tablet_copy_client.cc:538] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:00.819666  5154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520cf0102a3945aebdd2da293d919a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:00.834064  5151 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:00.840070  5145 ts_tablet_manager.cc:1434] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.114s	user 0.011s	sys 0.007s
I20260709 12:20:00.841969  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-1abb211136c54a29beecc019715aaa2d received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:00.842417  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-1abb211136c54a29beecc019715aaa2d on tablet 1abb211136c54a29beecc019715aaa2d with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:00.871095  5154 tablet_copy_client.cc:806] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:00.874145  5154 tablet_copy_client.cc:670] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:00.881304  5154 tablet_copy_client.cc:538] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:00.889004  5151 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:00.893615  4987 raft_consensus.cc:1217] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:00.896369  5151 tablet_bootstrap.cc:492] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:00.897230  5151 ts_tablet_manager.cc:1403] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.006s
I20260709 12:20:00.905895  5151 raft_consensus.cc:359] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:00.906730  5151 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:00.908107  5154 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:00.915532  5151 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:00.924592  5151 ts_tablet_manager.cc:1434] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:20:00.926606  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-631cc1317abe4f99b307dee5289f9258 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:00.927042  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-631cc1317abe4f99b307dee5289f9258 on tablet 631cc1317abe4f99b307dee5289f9258 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:01.008761  5154 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.009914  5154 tablet_bootstrap.cc:492] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:01.017079  5154 ts_tablet_manager.cc:1403] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.020s
I20260709 12:20:01.032869  5154 raft_consensus.cc:359] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:01.033963  5154 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:01.034782  5154 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:01.037814  5154 ts_tablet_manager.cc:1434] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:01.040156  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-520cf0102a3945aebdd2da293d919a52 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:01.040675  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-520cf0102a3945aebdd2da293d919a52 on tablet 520cf0102a3945aebdd2da293d919a52 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:01.049490  4987 raft_consensus.cc:1217] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.074503  4987 raft_consensus.cc:1217] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.162835  5154 ts_tablet_manager.cc:933] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:01.177946  5154 tablet_copy_client.cc:323] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:01.180233  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet a08fb4e151924fb6944c6a5f82c4f9d2 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:01.181156  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet a08fb4e151924fb6944c6a5f82c4f9d2 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-a08fb4e151924fb6944c6a5f82c4f9d2
I20260709 12:20:01.190348  4344 tablet_copy_source_session.cc:215] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:01.194247  5154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08fb4e151924fb6944c6a5f82c4f9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:01.305325  5154 tablet_copy_client.cc:806] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:01.307928  5154 tablet_copy_client.cc:670] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:01.315855  5154 tablet_copy_client.cc:538] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:01.351585  5154 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:01.380523  5154 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:01.381558  5154 tablet_bootstrap.cc:492] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:01.382345  5154 ts_tablet_manager.cc:1403] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.018s
I20260709 12:20:01.385635  5154 raft_consensus.cc:359] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:01.386612  5154 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:01.387387  5154 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:01.390538  5154 ts_tablet_manager.cc:1434] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:01.393000  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-a08fb4e151924fb6944c6a5f82c4f9d2 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:01.393455  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-a08fb4e151924fb6944c6a5f82c4f9d2 on tablet a08fb4e151924fb6944c6a5f82c4f9d2 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:01.512425  5087 raft_consensus.cc:1064] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:01.514815  5087 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:01.550988  4987 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.555414  5123 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:01.563611  4401 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.564613  5161 raft_consensus.cc:1064] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:01.565078  5087 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:01.568933  5123 raft_consensus.cc:1064] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:01.571044  5161 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:01.572736  5123 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:01.610602  4326 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.649989  4989 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.662957  4989 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.664788  5142 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:01.686741  4326 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.689301  5162 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:01.732908  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 94815.1us
I20260709 12:20:01.759743  4333 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.798261  5123 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:01.915664  4987 raft_consensus.cc:1217] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:01.892109  5162 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:01.945660  4405 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.947676  4252 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:01.996678  5103 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:20:01.999225  5183 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:02.000696  5123 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.002673  5161 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.004908  5128 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.041736  4333 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.045218  4404 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.037405  4989 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.071067  4985 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.074836  4252 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.173182  4149 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.179176  4326 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.245460  4153 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.316852  5103 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.330382  4404 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.390718  4985 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.403537  4330 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.432786  5130 raft_consensus.cc:1064] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:02.445997  5130 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:02.464839  4989 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.470556  4404 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.470621  5192 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.474120  5192 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:02.478713  4249 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:02.487118  5177 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:02.521411  4149 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.524119  4254 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:02.533619  4404 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.535419  5123 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.536545  5130 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.571578  4989 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.573971  5174 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.586386  5174 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.587877  4985 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.593905  4401 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:02.601845  4252 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.604597  4989 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.607554  5142 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.608700  5182 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.611037  4254 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:02.620899  4990 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.630055  5161 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.545238  4249 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.640358  4408 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.649171  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 520cf0102a3945aebdd2da293d919a52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.649922  4404 raft_consensus.cc:2955] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.652040  4989 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.650882  4151 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.657591  4987 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.657696  4331 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.659022  4153 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.661495  5184 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.663975  5123 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:02.673243  4331 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:02.678890  5123 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.680405  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 520cf0102a3945aebdd2da293d919a52 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:02.684381  4987 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.695747  4333 raft_consensus.cc:2955] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.705118  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1abb211136c54a29beecc019715aaa2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.724833  4984 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.726194  5201 tablet_replica.cc:333] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:02.728328  5201 raft_consensus.cc:2243] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.729056  5201 raft_consensus.cc:2272] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.722447  4151 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.737833  5190 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.740052  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 631cc1317abe4f99b307dee5289f9258 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:02.744622  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 631cc1317abe4f99b307dee5289f9258 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.747427  4249 raft_consensus.cc:2955] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.759500  4148 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.762210  4407 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:02.777246  5201 ts_tablet_manager.cc:1916] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.782069  5202 tablet_replica.cc:333] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:02.785513  5202 raft_consensus.cc:2243] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.789098  5130 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.791013  5202 raft_consensus.cc:2272] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.800264  5202 ts_tablet_manager.cc:1916] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.808490  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a08fb4e151924fb6944c6a5f82c4f9d2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:02.820050  5052 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:02.825769  4151 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:02.830592  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 1abb211136c54a29beecc019715aaa2d with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:02.831290  4989 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.847779  4404 raft_consensus.cc:2955] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:02.853562  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet a08fb4e151924fb6944c6a5f82c4f9d2 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:02.888965  5201 ts_tablet_manager.cc:1929] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.889735  5201 log.cc:1199] T 520cf0102a3945aebdd2da293d919a52 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/520cf0102a3945aebdd2da293d919a52
I20260709 12:20:02.897475  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 520cf0102a3945aebdd2da293d919a52 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:02.898850  5201 tablet_replica.cc:333] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:02.902822  5201 raft_consensus.cc:2243] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.903882  5201 raft_consensus.cc:2272] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.910610  5203 tablet_replica.cc:333] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:02.912341  5201 ts_tablet_manager.cc:1916] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.916326  5203 raft_consensus.cc:2243] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:02.924147  5202 ts_tablet_manager.cc:1929] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.924978  5202 log.cc:1199] T 631cc1317abe4f99b307dee5289f9258 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/631cc1317abe4f99b307dee5289f9258
I20260709 12:20:02.927008  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 631cc1317abe4f99b307dee5289f9258 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:02.928627  5203 raft_consensus.cc:2272] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:02.932546  5203 ts_tablet_manager.cc:1916] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:02.943553  5201 ts_tablet_manager.cc:1929] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.944139  5201 log.cc:1199] T 1abb211136c54a29beecc019715aaa2d P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/1abb211136c54a29beecc019715aaa2d
I20260709 12:20:02.946089  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 1abb211136c54a29beecc019715aaa2d (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:02.952788  5203 ts_tablet_manager.cc:1929] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:02.953238  5203 log.cc:1199] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/a08fb4e151924fb6944c6a5f82c4f9d2
I20260709 12:20:02.954834  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet a08fb4e151924fb6944c6a5f82c4f9d2 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:04.007203  4333 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:04.033458  4254 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:04.034438  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f8c0670d52b4df8ad46e1549814b7a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:04.035626  5052 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.035990  4404 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:04.039463  5192 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.075103  5052 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.087391  4404 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.117077  4153 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.148594  4333 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:04.164392  4254 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:04.262377  4296 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 446eb926cc6444ab93580e61ad7fc581. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:04.265594  4249 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:04.281726  5190 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.284895  4404 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:04.292083  5190 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:04.319908  5192 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.331789  4252 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.338675  4404 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.354831  4151 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.427868  4249 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:04.484061  4218 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bee4570f5474c8f916b3144395312d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:04.487944  4333 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:04.489596  5204 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:20:04.514279  4406 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:04.518880  5218 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:04.532662  5221 ts_tablet_manager.cc:933] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:04.537595  5219 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.539537  4333 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.565207  4406 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:04.564867  4404 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.577451  4151 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.582430  5221 tablet_copy_client.cc:323] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:04.585837  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 7f8c0670d52b4df8ad46e1549814b7a8 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:04.586390  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 7f8c0670d52b4df8ad46e1549814b7a8 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-7f8c0670d52b4df8ad46e1549814b7a8
I20260709 12:20:04.591670  4333 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:04.592545  4371 consensus_peers.cc:597] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66d0cf9ce16c45e399c41f8f0bfb5e32. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:04.601691  5182 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.625313  4249 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:04.627951  5182 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:04.638680  5179 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.644394  4330 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.654174  4252 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:04.668047  4344 tablet_copy_source_session.cc:215] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:04.672241  5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8c0670d52b4df8ad46e1549814b7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:04.709918  4151 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.737534  5221 tablet_copy_client.cc:806] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:04.738328  5221 tablet_copy_client.cc:670] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:04.743232  5221 tablet_copy_client.cc:538] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:04.765358  5221 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:04.885661  5221 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.888929  5221 tablet_bootstrap.cc:492] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:04.891278  5228 ts_tablet_manager.cc:933] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:04.892349  5221 ts_tablet_manager.cc:1403] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.009s
I20260709 12:20:04.897177  5221 raft_consensus.cc:359] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:04.898077  5221 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:04.899068  5221 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:04.904672  5228 tablet_copy_client.cc:323] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:04.906517  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 446eb926cc6444ab93580e61ad7fc581 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:04.907029  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 446eb926cc6444ab93580e61ad7fc581 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-446eb926cc6444ab93580e61ad7fc581
I20260709 12:20:04.914873  4344 tablet_copy_source_session.cc:215] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:04.918154  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446eb926cc6444ab93580e61ad7fc581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:04.925014  5221 ts_tablet_manager.cc:1434] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.004s
I20260709 12:20:04.926964  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-7f8c0670d52b4df8ad46e1549814b7a8 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:04.927546  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-7f8c0670d52b4df8ad46e1549814b7a8 on tablet 7f8c0670d52b4df8ad46e1549814b7a8 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:04.947554  5221 ts_tablet_manager.cc:933] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:04.945777  5228 tablet_copy_client.cc:806] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:04.956130  5228 tablet_copy_client.cc:670] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:04.979394  5228 tablet_copy_client.cc:538] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:04.989948  5221 tablet_copy_client.cc:323] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:04.992671  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 6bee4570f5474c8f916b3144395312d5 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:04.993397  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 6bee4570f5474c8f916b3144395312d5 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-6bee4570f5474c8f916b3144395312d5
I20260709 12:20:04.999177  5228 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:05.004437  4267 tablet_copy_source_session.cc:215] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:05.017390  5221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bee4570f5474c8f916b3144395312d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:05.142427  5221 tablet_copy_client.cc:806] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:05.143208  5221 tablet_copy_client.cc:670] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:05.145826  5235 ts_tablet_manager.cc:933] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:05.163728  5228 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:05.168089  4989 raft_consensus.cc:1217] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:05.172073  5228 tablet_bootstrap.cc:492] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:05.173941  5228 ts_tablet_manager.cc:1403] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.175s	user 0.030s	sys 0.014s
I20260709 12:20:05.185715  5235 tablet_copy_client.cc:323] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:05.188086  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:05.188707  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-66d0cf9ce16c45e399c41f8f0bfb5e32
I20260709 12:20:05.188599  5228 raft_consensus.cc:359] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:05.189999  5228 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:05.190896  5228 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:05.202420  5228 ts_tablet_manager.cc:1434] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:20:05.213212  5221 tablet_copy_client.cc:538] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:05.216105  4419 tablet_copy_source_session.cc:215] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:05.224555  5221 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:05.226410  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-446eb926cc6444ab93580e61ad7fc581 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:05.226877  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-446eb926cc6444ab93580e61ad7fc581 on tablet 446eb926cc6444ab93580e61ad7fc581 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:05.261919  5221 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:05.262953  5221 tablet_bootstrap.cc:492] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:05.263685  5221 ts_tablet_manager.cc:1403] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.015s
I20260709 12:20:05.266950  5221 raft_consensus.cc:359] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:05.267995  5221 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:05.268778  5221 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:05.280237  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:05.290863  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 58719.9us
I20260709 12:20:05.301527  5221 ts_tablet_manager.cc:1434] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:20:05.305965  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-6bee4570f5474c8f916b3144395312d5 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:05.306456  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-6bee4570f5474c8f916b3144395312d5 on tablet 6bee4570f5474c8f916b3144395312d5 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:05.305049  5235 tablet_copy_client.cc:806] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:05.309953  5235 tablet_copy_client.cc:670] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:05.313593  5235 tablet_copy_client.cc:538] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:05.320895  5235 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:05.353008  5235 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:05.354351  5235 tablet_bootstrap.cc:492] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:05.356683  5235 ts_tablet_manager.cc:1403] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.009s
I20260709 12:20:05.360569  5235 raft_consensus.cc:359] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:05.361486  5235 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:05.362190  5235 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:05.364856  5235 ts_tablet_manager.cc:1434] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:20:05.367549  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-66d0cf9ce16c45e399c41f8f0bfb5e32 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:05.367992  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-66d0cf9ce16c45e399c41f8f0bfb5e32 on tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:05.380489  4984 raft_consensus.cc:1217] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:05.483206  4984 raft_consensus.cc:1217] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:05.635586  5190 raft_consensus.cc:1064] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:05.642546  5190 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:05.647890  4984 raft_consensus.cc:1217] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:05.659283  4984 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.662240  4252 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.662465  5052 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.664753  5052 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.665403  4408 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.678154  5190 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.715003  5052 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.729993  4252 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.751407  4984 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.752120  4151 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.765223  4400 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.811806  4331 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:05.823904  4984 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.826540  4252 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:05.827901  5052 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:05.829833  5192 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:05.840572  5190 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.851343  4984 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.863091  4254 raft_consensus.cc:2955] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.868364  5052 raft_consensus.cc:1064] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:05.870582  5052 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:05.871070  4149 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.882325  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f8c0670d52b4df8ad46e1549814b7a8 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:05.889613  4400 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.889608  4984 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.891206  5250 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:05.892670  4254 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:05.898550  5192 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.902603  5252 tablet_replica.cc:333] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:05.904011  5252 raft_consensus.cc:2243] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:05.904763  5252 raft_consensus.cc:2272] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:05.909202  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f8c0670d52b4df8ad46e1549814b7a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:05.911350  5192 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:05.910270  5252 ts_tablet_manager.cc:1916] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:05.955787  5250 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.962289  5252 ts_tablet_manager.cc:1929] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:05.962881  5252 log.cc:1199] T 7f8c0670d52b4df8ad46e1549814b7a8 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/7f8c0670d52b4df8ad46e1549814b7a8
I20260709 12:20:05.964388  4408 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.968904  5234 raft_consensus.cc:1064] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:05.974475  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 7f8c0670d52b4df8ad46e1549814b7a8 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:05.977937  4249 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.983665  5234 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:05.980171  4984 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:05.986550  4149 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.035580  4331 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:06.050861  4330 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:06.057646  4989 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:06.060036  5192 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:06.060060  5257 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:06.062851  4989 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:06.067183  5219 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:06.070387  5250 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.075181  4408 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:06.083370  5182 raft_consensus.cc:1064] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:06.083717  5257 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:06.086923  5182 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:06.093998  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 446eb926cc6444ab93580e61ad7fc581 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:06.093205  4984 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.095983  4249 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:06.097998  5257 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.100863  5250 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:06.101240  4990 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.113517  4330 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.120510  4153 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.118239  4148 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.139017  4249 raft_consensus.cc:2955] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.152917  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 446eb926cc6444ab93580e61ad7fc581 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:06.153978  5252 tablet_replica.cc:333] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:06.154983  5252 raft_consensus.cc:2243] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:06.155783  5252 raft_consensus.cc:2272] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:06.164439  5252 ts_tablet_manager.cc:1916] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:06.166059  4330 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:06.168020  4984 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:06.168927  5182 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:06.170650  4252 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:06.172923  4400 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.180855  5182 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:06.182791  5144 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:06.191148  4252 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:06.199393  4990 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:06.204627  5218 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:06.205930  4400 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:06.209738  5252 ts_tablet_manager.cc:1929] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:06.210238  5252 log.cc:1199] T 446eb926cc6444ab93580e61ad7fc581 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/446eb926cc6444ab93580e61ad7fc581
I20260709 12:20:06.212042  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 446eb926cc6444ab93580e61ad7fc581 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:06.216553  5234 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:06.219570  5218 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.221522  4989 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.233438  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bee4570f5474c8f916b3144395312d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:06.232712  4400 raft_consensus.cc:2955] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.309919  4149 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.348943  5182 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.350930  4254 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.363262  4330 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.372264  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bee4570f5474c8f916b3144395312d5 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:06.387172  5265 tablet_replica.cc:333] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:06.391269  5265 raft_consensus.cc:2243] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:06.397257  5265 raft_consensus.cc:2272] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:06.400369  4153 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.399899  4984 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.404167  5265 ts_tablet_manager.cc:1916] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:06.436036  5265 ts_tablet_manager.cc:1929] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:06.436699  5265 log.cc:1199] T 6bee4570f5474c8f916b3144395312d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/6bee4570f5474c8f916b3144395312d5
I20260709 12:20:06.438545  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 6bee4570f5474c8f916b3144395312d5 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:06.448526  4400 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:06.455834  4330 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:06.457993  5182 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:06.458185  4984 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:06.460145  5182 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:06.464766  5266 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.466367  4330 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.478324  4984 raft_consensus.cc:2955] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:06.479842  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:06.485785  4149 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:06.501263  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:06.517891  5268 tablet_replica.cc:333] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:06.518754  5268 raft_consensus.cc:2243] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:06.519439  5268 raft_consensus.cc:2272] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:06.522995  5268 ts_tablet_manager.cc:1916] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:06.534893  5268 ts_tablet_manager.cc:1929] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:06.535264  5268 log.cc:1199] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/66d0cf9ce16c45e399c41f8f0bfb5e32
I20260709 12:20:06.536792  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 66d0cf9ce16c45e399c41f8f0bfb5e32 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:07.583782  4254 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:07.590327  4218 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff19d9953d5b4cddb487ccf873740dee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.590600  4408 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.591284  4331 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.593037  5218 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.594219  5219 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.602535  5219 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.605530  4408 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.605456  4330 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.619524  4400 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:07.623785  4153 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.640414  4331 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.641098  4254 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.642115  5267 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:07.643463  5266 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:07.648187  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f77d531cd9f54dcbb332d1ff622d8443. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.659531  5269 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.661389  4249 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.662665  4331 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.674636  4400 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:07.685369  4148 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.700034  4331 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:07.701185  4371 consensus_peers.cc:597] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01644bc7ce5c458c882adfcf42aa8d83. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.701428  5266 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.704972  4249 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.706705  5269 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.730942  5267 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.739852  4249 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.740487  4331 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.750550  4252 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:07.755069  4148 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:07.780046  4218 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f35b6d3672d440581ae00175c31e5b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:07.784281  4407 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.784739  4331 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:07.786125  5218 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.787947  5219 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.801052  5234 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.801934  4331 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.808976  4407 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:07.818575  4153 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:08.042492  5288 ts_tablet_manager.cc:933] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:08.044416  5288 tablet_copy_client.cc:323] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:08.046054  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet ff19d9953d5b4cddb487ccf873740dee from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:08.046551  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet ff19d9953d5b4cddb487ccf873740dee from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-ff19d9953d5b4cddb487ccf873740dee
I20260709 12:20:08.052305  4267 tablet_copy_source_session.cc:215] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:08.055909  5288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff19d9953d5b4cddb487ccf873740dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:08.083504  5288 tablet_copy_client.cc:806] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:08.084292  5288 tablet_copy_client.cc:670] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:08.088783  5288 tablet_copy_client.cc:538] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:08.099787  5290 ts_tablet_manager.cc:933] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:08.100239  5288 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:08.109514  5290 tablet_copy_client.cc:323] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:08.112057  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet f77d531cd9f54dcbb332d1ff622d8443 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:08.112640  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet f77d531cd9f54dcbb332d1ff622d8443 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-f77d531cd9f54dcbb332d1ff622d8443
I20260709 12:20:08.119138  4419 tablet_copy_source_session.cc:215] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:08.124398  5288 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:08.125403  5288 tablet_bootstrap.cc:492] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:08.125763  5290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77d531cd9f54dcbb332d1ff622d8443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:08.126114  5288 ts_tablet_manager.cc:1403] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 12:20:08.129153  5288 raft_consensus.cc:359] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.129997  5288 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:08.130683  5288 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.138000  5288 ts_tablet_manager.cc:1434] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.008s
I20260709 12:20:08.140128  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-ff19d9953d5b4cddb487ccf873740dee received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:08.140575  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-ff19d9953d5b4cddb487ccf873740dee on tablet ff19d9953d5b4cddb487ccf873740dee with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:08.145766  5290 tablet_copy_client.cc:806] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:08.146675  5290 tablet_copy_client.cc:670] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:08.151314  5290 tablet_copy_client.cc:538] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:08.160718  5290 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:08.177488  5288 ts_tablet_manager.cc:933] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:08.179394  5290 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:08.180334  5290 tablet_bootstrap.cc:492] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:08.181082  5290 ts_tablet_manager.cc:1403] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:20:08.182749  5288 tablet_copy_client.cc:323] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:08.184648  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 01644bc7ce5c458c882adfcf42aa8d83 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:08.185186  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 01644bc7ce5c458c882adfcf42aa8d83 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-01644bc7ce5c458c882adfcf42aa8d83
I20260709 12:20:08.185964  5290 raft_consensus.cc:359] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.188336  5290 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:08.189162  5290 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.194052  5290 ts_tablet_manager.cc:1434] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:20:08.194052  4419 tablet_copy_source_session.cc:215] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:08.196341  4418 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-f77d531cd9f54dcbb332d1ff622d8443 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:08.196847  4418 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-f77d531cd9f54dcbb332d1ff622d8443 on tablet f77d531cd9f54dcbb332d1ff622d8443 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:08.201090  5288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01644bc7ce5c458c882adfcf42aa8d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:08.230268  5288 tablet_copy_client.cc:806] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:08.231187  5288 tablet_copy_client.cc:670] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:08.239706  5288 tablet_copy_client.cc:538] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:08.249117  5288 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:08.282532  5288 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:08.283474  5288 tablet_bootstrap.cc:492] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:08.284147  5288 ts_tablet_manager.cc:1403] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.013s
I20260709 12:20:08.287935  5288 raft_consensus.cc:359] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.289011  5288 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:08.289691  5288 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.292286  5288 ts_tablet_manager.cc:1434] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:20:08.294276  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-01644bc7ce5c458c882adfcf42aa8d83 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:08.294672  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-01644bc7ce5c458c882adfcf42aa8d83 on tablet 01644bc7ce5c458c882adfcf42aa8d83 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:08.296873  5290 ts_tablet_manager.cc:933] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:08.298751  5290 tablet_copy_client.cc:323] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:08.300459  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 2f35b6d3672d440581ae00175c31e5b7 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:08.300969  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 2f35b6d3672d440581ae00175c31e5b7 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-2f35b6d3672d440581ae00175c31e5b7
I20260709 12:20:08.307479  4267 tablet_copy_source_session.cc:215] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:08.310374  5290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f35b6d3672d440581ae00175c31e5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:08.324299  5290 tablet_copy_client.cc:806] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:08.324860  5290 tablet_copy_client.cc:670] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:08.328713  5290 tablet_copy_client.cc:538] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:08.340945  5290 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:08.364764  5290 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:08.365671  5290 tablet_bootstrap.cc:492] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:08.366359  5290 ts_tablet_manager.cc:1403] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 12:20:08.369097  5290 raft_consensus.cc:359] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.369720  5290 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:08.370234  5290 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:08.372273  5290 ts_tablet_manager.cc:1434] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:20:08.374228  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-2f35b6d3672d440581ae00175c31e5b7 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:08.374629  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-2f35b6d3672d440581ae00175c31e5b7 on tablet 2f35b6d3672d440581ae00175c31e5b7 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:08.503701  4989 raft_consensus.cc:1217] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:08.610090  4989 raft_consensus.cc:1217] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:08.857255  4989 raft_consensus.cc:1217] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:20:09.224232  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 303977us
I20260709 12:20:09.267395  4989 raft_consensus.cc:1217] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:20:09.292061  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 369999us
I20260709 12:20:09.333791  5271 raft_consensus.cc:1064] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:09.335353  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46347us
I20260709 12:20:09.336177  5271 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.364712  4990 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.372967  4329 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.374729  5300 raft_consensus.cc:1064] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:09.374745  5271 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:09.377483  5300 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.392405  5309 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.392872  4405 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.396234  5309 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.402010  4329 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.403779  4984 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.406558  5300 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.403779  4252 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.413424  5302 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.415256  5300 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.428875  5313 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.432189  4252 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.441589  4990 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.446018  5309 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.455338  4989 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.457330  4329 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.459059  4149 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:09.468025  4405 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.476420  4329 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.496294  5218 raft_consensus.cc:1064] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:09.498629  5218 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.514060  4153 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.521718  5302 raft_consensus.cc:1064] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:09.524463  5302 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.545436  4329 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.545568  4989 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.547031  5313 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.548282  4252 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.550405  4405 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.554049  5303 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:09.558063  4989 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.558236  4254 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.561182  4326 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.563004  5302 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.564353  5300 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:09.564430  5303 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:09.578845  5313 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.582254  4990 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.582320  5300 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.594079  4254 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.594722  4326 raft_consensus.cc:2955] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.599275  4989 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.609323  4984 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.615449  5271 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.621816  4329 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.624826  4153 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.631975  4333 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.636590  4987 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.638748  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01644bc7ce5c458c882adfcf42aa8d83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:09.644555  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 01644bc7ce5c458c882adfcf42aa8d83 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:09.649866  4153 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.652065  5311 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:09.654784  5312 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.667804  5234 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:09.671944  4401 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.672962  4329 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:09.675282  5310 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.683894  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff19d9953d5b4cddb487ccf873740dee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:09.688201  5308 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.690267  4984 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.694785  4326 raft_consensus.cc:2955] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.737104  4405 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.753271  5332 tablet_replica.cc:333] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:09.769770  5332 raft_consensus.cc:2243] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.771731  5332 raft_consensus.cc:2272] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.777876  4249 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.780855  4984 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.787175  4153 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.791106  5332 ts_tablet_manager.cc:1916] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:09.800786  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet ff19d9953d5b4cddb487ccf873740dee with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:09.809873  5313 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.819029  5311 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.830523  4326 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.838980  4984 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.849885  5313 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.868645  5336 tablet_replica.cc:333] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:09.877972  5336 raft_consensus.cc:2243] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.882562  5336 raft_consensus.cc:2272] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.869626  4151 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.894369  5300 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.907259  5332 ts_tablet_manager.cc:1929] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:09.907955  5332 log.cc:1199] T 01644bc7ce5c458c882adfcf42aa8d83 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/01644bc7ce5c458c882adfcf42aa8d83
I20260709 12:20:09.910070  5336 ts_tablet_manager.cc:1916] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:09.910136  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 01644bc7ce5c458c882adfcf42aa8d83 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:09.914991  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f77d531cd9f54dcbb332d1ff622d8443 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:09.915917  4404 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.921236  4249 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:09.923523  4254 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.926532  4989 raft_consensus.cc:2955] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.928573  4326 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.929744  5309 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.930603  4984 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:09.931901  5312 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.939594  5336 ts_tablet_manager.cc:1929] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:09.940137  5336 log.cc:1199] T ff19d9953d5b4cddb487ccf873740dee P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/ff19d9953d5b4cddb487ccf873740dee
I20260709 12:20:09.939195  5312 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.941870  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet ff19d9953d5b4cddb487ccf873740dee (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:09.944512  4148 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.948177  4984 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.958019  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet f77d531cd9f54dcbb332d1ff622d8443 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:09.959136  4326 raft_consensus.cc:2955] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.972981  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f35b6d3672d440581ae00175c31e5b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:09.975008  5337 tablet_replica.cc:333] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:09.976115  5337 raft_consensus.cc:2243] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.976787  5337 raft_consensus.cc:2272] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.978818  4153 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:09.980616  5337 ts_tablet_manager.cc:1916] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:09.991214  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f35b6d3672d440581ae00175c31e5b7 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:09.992157  5336 tablet_replica.cc:333] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:09.993153  5336 raft_consensus.cc:2243] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:09.993942  5336 raft_consensus.cc:2272] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:09.998117  5337 ts_tablet_manager.cc:1929] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:09.998593  5337 log.cc:1199] T f77d531cd9f54dcbb332d1ff622d8443 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/f77d531cd9f54dcbb332d1ff622d8443
I20260709 12:20:09.999642  5336 ts_tablet_manager.cc:1916] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:10.000674  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet f77d531cd9f54dcbb332d1ff622d8443 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:10.013043  5336 ts_tablet_manager.cc:1929] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:10.013414  5336 log.cc:1199] T 2f35b6d3672d440581ae00175c31e5b7 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/2f35b6d3672d440581ae00175c31e5b7
I20260709 12:20:10.014716  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 2f35b6d3672d440581ae00175c31e5b7 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
W20260709 12:20:10.289573  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7ee0 after lost signal to thread 3105
W20260709 12:20:10.290653  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08002718e0 after lost signal to thread 4187
W20260709 12:20:10.291914  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08000a83e0 after lost signal to thread 4281
W20260709 12:20:10.292902  5013 debug-util.cc:398] Leaking SignalData structure 0x7b0800303d80 after lost signal to thread 4358
W20260709 12:20:10.294034  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc500 after lost signal to thread 4433
W20260709 12:20:10.295156  5013 debug-util.cc:398] Leaking SignalData structure 0x7b080031f200 after lost signal to thread 5016
I20260709 12:20:11.081861  4400 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:11.088879  4326 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.090915  5338 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:11.095108  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdb68505c01944fb98aa2334aa5c28e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.096388  4249 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.101215  5313 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:11.105103  5302 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.107831  4326 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.130944  4400 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:11.134303  4149 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.152786  4326 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.159065  5302 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:11.154965  4254 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:11.156960  4371 consensus_peers.cc:597] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 752b8a9170934f31b770429d237cdb43. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.170397  5313 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:11.175508  4249 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.199343  5302 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.201179  4252 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.203995  4333 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.216699  4400 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:11.245409  4151 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:11.253715  4371 consensus_peers.cc:597] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68963fca87f1465babfafe629c276422. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.255460  4326 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.265162  5347 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:11.272258  4252 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.273851  5338 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:11.296082  5338 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.298898  4333 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.314036  4252 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.317092  4400 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:11.325275  4333 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.325084  4149 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.328601  5302 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:11.326923  4371 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7935718b80b24232b822244ef31fa44b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:11.340205  4249 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:11.344187  5302 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:11.348382  5313 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.352895  4326 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.383556  4252 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:11.398221  4151 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.553601  5358 ts_tablet_manager.cc:933] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:11.568446  5358 tablet_copy_client.cc:323] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:11.571389  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet fdb68505c01944fb98aa2334aa5c28e9 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:11.571924  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet fdb68505c01944fb98aa2334aa5c28e9 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-fdb68505c01944fb98aa2334aa5c28e9
I20260709 12:20:11.579914  4419 tablet_copy_source_session.cc:215] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:11.583217  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb68505c01944fb98aa2334aa5c28e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.604846  5358 tablet_copy_client.cc:806] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:11.605589  5358 tablet_copy_client.cc:670] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:11.610076  5358 tablet_copy_client.cc:538] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:11.623147  5358 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:11.663249  5358 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:11.664222  5358 tablet_bootstrap.cc:492] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:11.664940  5358 ts_tablet_manager.cc:1403] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.014s
I20260709 12:20:11.668387  5358 raft_consensus.cc:359] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:11.669279  5358 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:11.669999  5358 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:11.680797  5358 ts_tablet_manager.cc:1434] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:20:11.682513  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-fdb68505c01944fb98aa2334aa5c28e9 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:11.682952  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-fdb68505c01944fb98aa2334aa5c28e9 on tablet fdb68505c01944fb98aa2334aa5c28e9 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:11.704363  5358 ts_tablet_manager.cc:933] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:11.750031  5358 tablet_copy_client.cc:323] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:11.751941  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 752b8a9170934f31b770429d237cdb43 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:11.752542  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 752b8a9170934f31b770429d237cdb43 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-752b8a9170934f31b770429d237cdb43
I20260709 12:20:11.761451  4419 tablet_copy_source_session.cc:215] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:11.766919  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752b8a9170934f31b770429d237cdb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.780208  5363 ts_tablet_manager.cc:933] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:11.799393  5363 tablet_copy_client.cc:323] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:11.800969  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 68963fca87f1465babfafe629c276422 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:11.801537  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 68963fca87f1465babfafe629c276422 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-68963fca87f1465babfafe629c276422
I20260709 12:20:11.809724  4419 tablet_copy_source_session.cc:215] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:11.800506  5358 tablet_copy_client.cc:806] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:11.812814  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68963fca87f1465babfafe629c276422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.827723  5358 tablet_copy_client.cc:670] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:11.832474  5358 tablet_copy_client.cc:538] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:11.853510  5363 tablet_copy_client.cc:806] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:11.854709  5363 tablet_copy_client.cc:670] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:11.858929  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 75639.2us
I20260709 12:20:11.864630  5363 tablet_copy_client.cc:538] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:11.875707  5358 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:11.885247  5363 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:11.993011  5358 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:20:12.026801  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 91453.6us
I20260709 12:20:12.027477  5358 tablet_bootstrap.cc:492] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
W20260709 12:20:12.031086  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51746.3us
I20260709 12:20:12.050519  4984 raft_consensus.cc:1217] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:12.092442  5382 ts_tablet_manager.cc:933] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:12.102236  5358 ts_tablet_manager.cc:1403] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.227s	user 0.023s	sys 0.007s
I20260709 12:20:12.164990  5358 raft_consensus.cc:359] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:12.172492  5358 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:12.174772  5382 tablet_copy_client.cc:323] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:12.198263  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 7935718b80b24232b822244ef31fa44b from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:12.198094  5358 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:12.199534  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 7935718b80b24232b822244ef31fa44b from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-7935718b80b24232b822244ef31fa44b
I20260709 12:20:12.163053  5363 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:12.212906  5363 tablet_bootstrap.cc:492] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:12.218513  4419 tablet_copy_source_session.cc:215] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:12.242403  4987 raft_consensus.cc:1217] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:12.243716  5382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7935718b80b24232b822244ef31fa44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:12.244266  5363 ts_tablet_manager.cc:1403] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.359s	user 0.039s	sys 0.001s
I20260709 12:20:12.259356  5363 raft_consensus.cc:359] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:12.260635  5363 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:12.270007  5358 ts_tablet_manager.cc:1434] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.158s	user 0.009s	sys 0.002s
I20260709 12:20:12.261698  5363 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:12.272130  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-752b8a9170934f31b770429d237cdb43 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:12.277163  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-752b8a9170934f31b770429d237cdb43 on tablet 752b8a9170934f31b770429d237cdb43 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:12.303434  5363 ts_tablet_manager.cc:1434] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.002s
I20260709 12:20:12.305780  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-68963fca87f1465babfafe629c276422 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:12.306219  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-68963fca87f1465babfafe629c276422 on tablet 68963fca87f1465babfafe629c276422 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:12.333741  4987 raft_consensus.cc:1217] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:12.347604  5382 tablet_copy_client.cc:806] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:12.348553  5382 tablet_copy_client.cc:670] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:12.353535  5382 tablet_copy_client.cc:538] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:12.374265  5382 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:12.403849  5382 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:12.404887  5382 tablet_bootstrap.cc:492] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:12.405664  5382 ts_tablet_manager.cc:1403] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.007s
I20260709 12:20:12.413093  5382 raft_consensus.cc:359] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:12.414050  5382 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:12.414765  5382 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:12.426906  5377 raft_consensus.cc:1064] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:12.427685  5382 ts_tablet_manager.cc:1434] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:20:12.429409  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-7935718b80b24232b822244ef31fa44b received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:12.429853  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-7935718b80b24232b822244ef31fa44b on tablet 7935718b80b24232b822244ef31fa44b with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:12.430526  5377 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:12.455842  4333 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.457726  4252 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.461767  5377 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:12.459429  4989 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.470378  5378 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:12.474085  5378 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:12.499637  4252 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.516712  4987 raft_consensus.cc:1217] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:12.514024  5377 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.548069  4333 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.576336  4148 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:12.538729  4989 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.654043  4407 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:12.683584  4989 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:12.693128  4252 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:12.696056  5378 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:12.699572  5378 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:12.707558  5377 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.714804  4989 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.720155  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fdb68505c01944fb98aa2334aa5c28e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:12.730489  4149 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:12.742599  4252 raft_consensus.cc:2955] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:12.752660  5379 raft_consensus.cc:1064] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:12.771982  5379 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:12.781383  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb68505c01944fb98aa2334aa5c28e9 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:12.790558  5393 tablet_replica.cc:333] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:12.800230  5393 raft_consensus.cc:2243] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:12.801153  5393 raft_consensus.cc:2272] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:12.804817  5393 ts_tablet_manager.cc:1916] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:12.818814  4989 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.820813  4331 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.823248  5378 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:12.829741  5378 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:12.830986  4254 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:12.836669  5377 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:12.881345  5393 ts_tablet_manager.cc:1929] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:12.881991  5393 log.cc:1199] T fdb68505c01944fb98aa2334aa5c28e9 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/fdb68505c01944fb98aa2334aa5c28e9
I20260709 12:20:12.884006  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet fdb68505c01944fb98aa2334aa5c28e9 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:12.911218  5378 raft_consensus.cc:1064] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:12.916898  5378 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:13.018200  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 94500.3us
I20260709 12:20:13.021371  5379 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.037029  4329 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.052168  4254 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.073312  4149 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.094940  5313 raft_consensus.cc:1064] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:13.097486  4987 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.098664  4408 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:13.106194  4326 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:13.108096  5347 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:13.097671  5313 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:13.124112  5377 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.138885  4989 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:13.142373  4326 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:13.143633  4329 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.153513  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 752b8a9170934f31b770429d237cdb43 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:13.147634  5379 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:13.151142  5347 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:13.183759  4254 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:13.183964  4987 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:20:13.188877  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 89790.8us
I20260709 12:20:13.198052  5377 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:13.200767  5377 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:13.201656  4987 raft_consensus.cc:2955] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.216336  4149 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.223610  4326 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:13.226457  5404 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:13.243659  4984 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:13.246600  4252 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:13.276624  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 752b8a9170934f31b770429d237cdb43 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:13.282280  5378 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:13.297574  5410 tablet_replica.cc:333] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:13.296437  5378 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.295565  5313 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:13.299094  5410 raft_consensus.cc:2243] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.303478  5410 raft_consensus.cc:2272] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.308463  5410 ts_tablet_manager.cc:1916] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:13.332567  4254 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.339852  5410 ts_tablet_manager.cc:1929] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:13.340472  5410 log.cc:1199] T 752b8a9170934f31b770429d237cdb43 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/752b8a9170934f31b770429d237cdb43
I20260709 12:20:13.342689  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 752b8a9170934f31b770429d237cdb43 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:13.354184  4326 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.361855  4149 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:13.364485  4987 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.370754  5377 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.376991  4252 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.406145  4404 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:13.413893  4326 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:13.416162  5404 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:13.427877  4989 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:20:13.432695  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51170us
I20260709 12:20:13.434568  5405 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.437121  4329 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.442546  5403 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:13.455075  4326 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.456748  4149 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.464726  4989 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.467689  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 68963fca87f1465babfafe629c276422 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:13.474472  5410 tablet_replica.cc:333] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:13.467036  4987 raft_consensus.cc:2955] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.475548  5410 raft_consensus.cc:2243] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.472783  4149 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.489042  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68963fca87f1465babfafe629c276422 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:13.492035  5410 raft_consensus.cc:2272] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.497108  5410 ts_tablet_manager.cc:1916] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:13.509030  4408 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:13.527436  4984 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:13.529639  5313 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:13.542351  5313 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.544063  4254 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:13.549132  5403 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:13.559253  5410 ts_tablet_manager.cc:1929] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:13.559811  5410 log.cc:1199] T 68963fca87f1465babfafe629c276422 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/68963fca87f1465babfafe629c276422
I20260709 12:20:13.558821  4252 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.561395  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 68963fca87f1465babfafe629c276422 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:13.564404  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7935718b80b24232b822244ef31fa44b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:13.568215  4987 raft_consensus.cc:2955] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:13.569463  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50299.7us
I20260709 12:20:13.585943  4149 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:13.610369  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 7935718b80b24232b822244ef31fa44b with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:13.634477  5414 tablet_replica.cc:333] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:13.636442  5414 raft_consensus.cc:2243] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.637409  5414 raft_consensus.cc:2272] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.641948  5414 ts_tablet_manager.cc:1916] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:13.662036  5414 ts_tablet_manager.cc:1929] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:13.662497  5414 log.cc:1199] T 7935718b80b24232b822244ef31fa44b P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/7935718b80b24232b822244ef31fa44b
I20260709 12:20:13.664208  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 7935718b80b24232b822244ef31fa44b (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:14.697383  4326 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:14.710930  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 987201f60eb64f869c89f0703e622738. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.711097  4401 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.712399  4254 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.713918  5250 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:14.715478  5395 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:14.728045  5250 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.729385  4401 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.750268  4153 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.772496  4326 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:14.781716  4254 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:14.791513  4296 consensus_peers.cc:597] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 795c79b77a3c478183b1eaf256f074d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.792423  4401 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.793066  4254 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.794229  5417 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:14.799338  5417 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:14.818748  5250 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.825043  4249 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.831456  4401 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.836091  4408 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:14.855649  4326 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.857321  4249 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.857194  5378 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:14.859701  4371 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53b63478950f49c4a21f85e72a0a2218. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.859054  4148 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.861203  5405 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:14.877151  5378 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.881327  4326 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.892156  4249 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.899673  4254 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:14.900005  4148 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:14.936959  4218 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7092b1e5ebf04097a82982b4008c4d7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.941361  4408 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.942442  4326 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:14.942598  5415 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:14.949218  5312 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:14.966434  5312 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.977146  4329 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.978713  4401 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:14.992555  4148 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.280886  5435 ts_tablet_manager.cc:933] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:15.283030  5435 tablet_copy_client.cc:323] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:15.284863  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 53b63478950f49c4a21f85e72a0a2218 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:15.285391  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 53b63478950f49c4a21f85e72a0a2218 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-53b63478950f49c4a21f85e72a0a2218
I20260709 12:20:15.291726  4419 tablet_copy_source_session.cc:215] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:15.294461  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b63478950f49c4a21f85e72a0a2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:15.310182  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.328236  5435 tablet_copy_client.cc:806] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:15.328958  5435 tablet_copy_client.cc:670] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:15.333997  5435 tablet_copy_client.cc:538] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:15.346959  5435 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:15.376818  5435 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:15.380473  5435 tablet_bootstrap.cc:492] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:15.381462  5435 ts_tablet_manager.cc:1403] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.010s
I20260709 12:20:15.384624  5435 raft_consensus.cc:359] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.385540  5435 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:15.386468  5435 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.398623  5435 ts_tablet_manager.cc:1434] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:20:15.400530  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-53b63478950f49c4a21f85e72a0a2218 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:15.400950  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-53b63478950f49c4a21f85e72a0a2218 on tablet 53b63478950f49c4a21f85e72a0a2218 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:15.403793  5435 ts_tablet_manager.cc:933] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:15.412230  5435 tablet_copy_client.cc:323] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:15.414417  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 987201f60eb64f869c89f0703e622738 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:15.414960  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 987201f60eb64f869c89f0703e622738 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-987201f60eb64f869c89f0703e622738
I20260709 12:20:15.424530  4344 tablet_copy_source_session.cc:215] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:15.428023  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987201f60eb64f869c89f0703e622738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:15.447952  5435 tablet_copy_client.cc:806] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:15.448611  5435 tablet_copy_client.cc:670] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:15.452665  5435 tablet_copy_client.cc:538] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:15.463034  5435 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:15.477459  5439 ts_tablet_manager.cc:933] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:15.494400  5435 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:15.495368  5435 tablet_bootstrap.cc:492] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:15.496026  5435 ts_tablet_manager.cc:1403] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.033s	user 0.029s	sys 0.001s
I20260709 12:20:15.498946  5435 raft_consensus.cc:359] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.500007  5435 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:15.501283  5435 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.504347  5435 ts_tablet_manager.cc:1434] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:15.506219  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-987201f60eb64f869c89f0703e622738 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:15.506641  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-987201f60eb64f869c89f0703e622738 on tablet 987201f60eb64f869c89f0703e622738 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:15.514657  5435 ts_tablet_manager.cc:933] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:15.518078  5439 tablet_copy_client.cc:323] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:15.521688  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 795c79b77a3c478183b1eaf256f074d5 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:15.522174  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 795c79b77a3c478183b1eaf256f074d5 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-795c79b77a3c478183b1eaf256f074d5
I20260709 12:20:15.529700  4344 tablet_copy_source_session.cc:215] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:15.534324  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795c79b77a3c478183b1eaf256f074d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:15.585745  5435 tablet_copy_client.cc:323] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:15.588884  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 7092b1e5ebf04097a82982b4008c4d7e from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:15.589481  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 7092b1e5ebf04097a82982b4008c4d7e from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-7092b1e5ebf04097a82982b4008c4d7e
I20260709 12:20:15.598057  4267 tablet_copy_source_session.cc:215] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:15.602010  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092b1e5ebf04097a82982b4008c4d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:15.627143  5435 tablet_copy_client.cc:806] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:15.627820  5435 tablet_copy_client.cc:670] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:15.631912  5435 tablet_copy_client.cc:538] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:15.643663  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:15.644376  4254 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:15.650252  5435 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:15.668761  5439 tablet_copy_client.cc:806] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:15.673921  5439 tablet_copy_client.cc:670] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:15.678905  5439 tablet_copy_client.cc:538] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:15.703203  5439 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:15.706998  4331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:15.707754  4331 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:15.712649  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:15.713238  4249 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:15.716022  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:15.716562  4249 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:15.719044  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:15.719727  4249 raft_consensus.cc:606] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:15.721503  4989 raft_consensus.cc:1217] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:15.739848  5417 raft_consensus.cc:993] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:15.740371  5417 raft_consensus.cc:1081] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:15.743280  4404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:15.743949  4404 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.744333  4404 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.747025  5435 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:15.760180  5435 tablet_bootstrap.cc:492] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:15.761000  5435 ts_tablet_manager.cc:1403] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.111s	user 0.024s	sys 0.017s
I20260709 12:20:15.755064  4404 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:15.763907  4401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:15.765019  4401 raft_consensus.cc:606] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:15.767946  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:15.768568  4249 raft_consensus.cc:606] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:15.769780  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:15.770418  5439 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:15.769897  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:15.770519  4254 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.770972  4331 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.771329  4331 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:15.771587  5439 tablet_bootstrap.cc:492] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:15.772413  5439 ts_tablet_manager.cc:1403] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.004s
I20260709 12:20:15.772059  4331 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:15.773175  4331 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.775570  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:20:15.775660  4404 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:15.777374  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:15.778357  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.778822  5435 raft_consensus.cc:359] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.779647  5435 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:15.781150  5435 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.780548  4254 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:15.782996  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:15.783883  5445 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.784430  5445 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:15.785316  5445 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:15.775561  5439 raft_consensus.cc:359] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.787156  5439 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:15.786679  5435 ts_tablet_manager.cc:1434] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:20:15.788569  5439 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:15.789692  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-7092b1e5ebf04097a82982b4008c4d7e received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:15.790202  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-7092b1e5ebf04097a82982b4008c4d7e on tablet 7092b1e5ebf04097a82982b4008c4d7e with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:15.806918  5439 ts_tablet_manager.cc:1434] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:20:15.808741  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-795c79b77a3c478183b1eaf256f074d5 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:15.809214  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-795c79b77a3c478183b1eaf256f074d5 on tablet 795c79b77a3c478183b1eaf256f074d5 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:15.784427  4331 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:15.836380  5405 raft_consensus.cc:993] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:15.836899  5405 raft_consensus.cc:1081] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:15.838918  4989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:20:15.839455  4989 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.839906  4989 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.851620  4987 raft_consensus.cc:1217] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:15.864295  4989 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:15.872396  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:15.873095  4401 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.873399  4401 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:15.874464  4401 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:15.875533  4401 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.878703  4149 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:15.888314  4987 raft_consensus.cc:1217] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:15.900604  4401 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:15.910225  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:15.911178  5441 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.901202  4989 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:15.901932  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:15.917696  4331 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.941655  5441 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:15.942807  5441 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:15.961747  5456 raft_consensus.cc:993] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:15.962746  5415 raft_consensus.cc:1081] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:15.965282  4401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:15.966041  4401 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.969378  4401 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.968632  4989 raft_consensus.cc:1217] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:15.979986  4331 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:15.978993  4401 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:15.989344  4401 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:15.989580  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:15.990172  4254 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.990218  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:15.990556  4254 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:15.990934  4329 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.991320  4254 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:15.992434  4254 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.998842  4254 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:15.998842  4329 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:15.999975  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:16.002992  5455 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.003546  5455 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:16.004415  5455 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.010263  4148 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:16.033617  4149 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:16.081806  5400 raft_consensus.cc:993] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:16.082625  5434 raft_consensus.cc:1081] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:16.085021  4329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:16.085564  4329 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:16.085886  4329 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.097635  5415 raft_consensus.cc:993] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:16.098170  5415 raft_consensus.cc:1081] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:16.102922  4401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:16.103483  4401 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:16.103865  5415 raft_consensus.cc:993] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:16.104372  5415 raft_consensus.cc:1081] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:16.103842  4401 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.112898  4401 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:16.115427  4329 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.116427  4326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:16.116976  4326 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:16.117314  4326 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.118343  4329 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:16.120708  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:16.121250  4405 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.122800  4401 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:16.127475  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:16.128075  4254 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.128460  4254 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:16.128113  4405 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:16.129418  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:16.129192  4254 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.130841  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:16.131402  4252 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.131702  4252 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:16.132450  4252 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:16.134012  4252 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.134667  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:16.136193  5250 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.136710  5250 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:16.137485  5250 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.130482  4254 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.150539  4252 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:16.157011  4326 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.159379  4326 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:16.160063  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:16.160710  4249 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.161011  4249 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:16.160344  4149 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:16.161667  4249 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.162681  4249 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.167366  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:16.168093  4405 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.172710  4249 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:16.160334  4329 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.174371  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:16.175060  5250 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.175457  5250 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:16.176172  5250 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.177451  5434 raft_consensus.cc:993] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:16.177958  5434 raft_consensus.cc:1081] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:16.179774  4333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:16.180275  4333 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:16.180639  4333 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.188889  4329 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:16.188705  4333 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.190289  4372 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:16.191045  5445 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.191852  4333 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:16.192484  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:16.193049  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:16.193204  4249 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:16.193651  4249 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:16.193670  4408 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.194329  4254 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:16.195083  4249 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.200138  4249 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:16.191593  5445 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:16.202589  5445 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:16.215462  4405 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:16.217978  4249 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:16.221089  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:16.222776  5457 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:16.223237  5457 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:16.226068  5457 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:16.229053  4408 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:16.258426  4149 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:16.272862  4408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:16.273509  4408 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership
I20260709 12:20:16.278112  4149 catalog_manager.cc:5697] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:16.280164  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:16.280761  4405 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership
W20260709 12:20:16.282084  4137 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 7092b1e5ebf04097a82982b4008c4d7e already in progress
I20260709 12:20:16.293428  5403 raft_consensus.cc:1064] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:16.295840  5403 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:16.300165  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:16.300869  4405 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership
I20260709 12:20:16.308277  4249 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:20:16.308483  4201 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:16.308960  4201 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7092b1e5ebf04097a82982b4008c4d7e already in progress
W20260709 12:20:16.309293  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7092b1e5ebf04097a82982b4008c4d7e already in progress
I20260709 12:20:16.308311  4987 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.313099  5445 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.314311  5403 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.313956  4149 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:16.311124  4333 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.316725  5403 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.348450  4405 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:16.350427  5441 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:16.352806  5378 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.354528  4989 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.375011  4149 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.377684  4326 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.379884  5445 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:20:16.386718  5250 raft_consensus.cc:1064] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:16.389716  4249 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.397140  5250 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:16.405237  4252 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.408143  5403 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.423252  4405 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:16.423898  4333 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.429672  4989 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:16.431166  4249 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:16.431035  5378 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:16.432901  5378 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:16.438499  5458 raft_consensus.cc:1064] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:16.440232  5475 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.441288  5458 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:16.441198  4989 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.460150  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53b63478950f49c4a21f85e72a0a2218 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:16.462893  4249 raft_consensus.cc:2955] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.472891  4329 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:16.474506  4254 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.474435  5441 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:16.475827  5475 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.496858  4331 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.498459  5475 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.537587  4249 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.537846  4987 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.538933  5417 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.540397  5417 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.550858  4408 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.553917  4248 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.554389  5458 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.558791  5449 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:16.574395  4151 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:16.597306  4253 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.598755  5449 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:16.645038  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 53b63478950f49c4a21f85e72a0a2218 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:16.651152  5495 tablet_replica.cc:333] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:16.654115  4987 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.654337  4989 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Advancing to term 2
I20260709 12:20:16.681176  5495 raft_consensus.cc:2243] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:16.681816  4989 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:16.682080  5495 raft_consensus.cc:2272] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:16.688705  4253 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.687116  5403 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:16.690682  4408 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:16.689450  5449 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.686961  4249 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.700980  5457 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.704895  5495 ts_tablet_manager.cc:1916] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:16.705608  5250 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:16.707809  5458 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.726897  4253 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:16.728583  5455 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:16.748066  4257 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.754194  4401 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.755985  4152 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:16.757826  4408 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.761952  4408 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.764597  4984 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.763020  4401 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:16.760835  5449 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:20:16.781612  5378 raft_consensus.cc:993] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:16.836959  5250 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:16.869467  4329 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:16.870563  5475 raft_consensus.cc:1081] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:16.880581  5403 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:20:16.880568  5497 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 12:20:16.936750  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 56349.2us
I20260709 12:20:16.951664  4253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:16.952260  4253 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:16.952633  4253 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:16.953420  5495 ts_tablet_manager.cc:1929] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:16.953895  5495 log.cc:1199] T 53b63478950f49c4a21f85e72a0a2218 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/53b63478950f49c4a21f85e72a0a2218
W20260709 12:20:16.963969  5500 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:20:16.967945  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 79390.1us
W20260709 12:20:16.955253  5499 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.090s	user 0.000s	sys 0.003s
I20260709 12:20:16.980386  5378 raft_consensus.cc:1064] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:16.980803  5378 raft_consensus.cc:1068] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:16.981611  5378 raft_consensus.cc:1064] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:16.981918  5378 raft_consensus.cc:1068] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:16.986052  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 53b63478950f49c4a21f85e72a0a2218 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:16.983776  4253 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:16.998720  4253 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:17.003093  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:17.003751  4408 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:17.004029  4408 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:17.004769  4408 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:17.006428  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:17.007386  4408 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:17.018456  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 188608us
I20260709 12:20:17.024904  5507 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:17.027464  4408 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:17.029066  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:17.030170  5415 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:17.030654  5415 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.031658  5415 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:17.037883  4333 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.091289  4148 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.105573  4405 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:17.103307  5502 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.112919  4990 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:17.111897  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:17.138939  5497 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:17.142998  4253 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.151427  4987 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.159467  5457 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:17.158972  4408 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.165663  4151 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.177989  5502 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.179725  4990 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.186309  4329 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.194065  4984 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:17.198235  5457 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:17.212590  5497 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.215513  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 795c79b77a3c478183b1eaf256f074d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:17.215890  4404 raft_consensus.cc:2955] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.239012  4148 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.245853  4253 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:17.248766  4990 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.303822  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 795c79b77a3c478183b1eaf256f074d5 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:17.308336  5513 tablet_replica.cc:333] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:17.308964  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 987201f60eb64f869c89f0703e622738 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:17.326197  5457 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:17.338991  5513 raft_consensus.cc:2243] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.340965  5513 raft_consensus.cc:2272] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.346256  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:17.346962  4253 raft_consensus.cc:606] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:17.356748  4249 raft_consensus.cc:2955] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:17.363561  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:17.364225  4253 raft_consensus.cc:606] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:17.370386  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68963fca87f1465babfafe629c276422"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:17.370990  4404 raft_consensus.cc:606] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
W20260709 12:20:17.371881  4138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62937.5us
I20260709 12:20:17.362113  5513 ts_tablet_manager.cc:1916] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:17.381812  4148 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.399008  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:17.399701  4249 raft_consensus.cc:606] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:17.407641  5513 ts_tablet_manager.cc:1929] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:17.408210  5513 log.cc:1199] T 795c79b77a3c478183b1eaf256f074d5 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/795c79b77a3c478183b1eaf256f074d5
I20260709 12:20:17.410550  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 795c79b77a3c478183b1eaf256f074d5 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:17.412161  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:17.412840  4249 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:17.413190  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 987201f60eb64f869c89f0703e622738 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:17.417368  4332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:17.418016  4332 raft_consensus.cc:606] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:17.421690  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:17.422174  4404 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:17.422282  4249 raft_consensus.cc:606] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:17.423633  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:20:17.424243  5434 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:17.425423  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:17.426262  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:17.430572  4329 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:17.446020  4990 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Advancing to term 3
I20260709 12:20:17.463976  4990 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:17.465955  5456 raft_consensus.cc:993] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:17.465827  5434 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:17.466470  5456 raft_consensus.cc:1081] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:17.471509  4408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:17.472152  4408 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.472589  4408 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.480134  5415 raft_consensus.cc:1064] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:17.480654  5415 raft_consensus.cc:1068] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:17.481541  4408 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:17.482499  5514 tablet_replica.cc:333] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:17.483608  5514 raft_consensus.cc:2243] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:17.484427  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:17.485046  4249 raft_consensus.cc:3055] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.485352  4249 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.486155  4249 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:17.486999  4329 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:17.487458  4408 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:17.487665  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:17.488236  4332 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.488633  5415 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:17.495987  4249 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.498452  5434 raft_consensus.cc:993] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:17.498972  5434 raft_consensus.cc:1081] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:17.501544  4333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:17.502116  4333 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.502552  4333 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:17.516593  4333 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:17.519948  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:17.520601  4248 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:17.520942  4248 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.521535  4333 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:17.521828  4248 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:17.523658  4248 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:17.529429  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:17.530046  4408 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:17.533285  4249 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:17.484459  5514 raft_consensus.cc:2272] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:17.559530  4408 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:17.527437  4332 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:17.562963  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:17.563629  5514 ts_tablet_manager.cc:1916] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:17.564182  5504 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.568435  5504 raft_consensus.cc:697] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:17.572016  5504 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:17.565503  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:17.574788  4248 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:17.581920  5457 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:17.595470  5457 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:17.596572  5457 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:17.614573  5505 raft_consensus.cc:993] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.615190  5505 raft_consensus.cc:1081] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.617851  4987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68963fca87f1465babfafe629c276422"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:20:17.618672  4987 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.619218  4987 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:17.644627  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45057.4us
I20260709 12:20:17.663357  5514 ts_tablet_manager.cc:1929] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:17.671111  5503 raft_consensus.cc:993] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.671337  5514 log.cc:1199] T 987201f60eb64f869c89f0703e622738 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/987201f60eb64f869c89f0703e622738
I20260709 12:20:17.671695  5503 raft_consensus.cc:1081] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.676113  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 987201f60eb64f869c89f0703e622738 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:17.677446  4989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:17.678020  4989 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.678377  4989 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.685621  4989 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.688706  4149 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.689296  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:17.689235  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:17.691270  4248 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.691715  4248 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.694272  4248 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.695868  4248 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.701437  4333 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.692593  4987 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.707960  4152 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:17.711221  4987 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:17.712340  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:17.712942  4405 raft_consensus.cc:3055] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.713234  4405 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:17.714159  4405 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.715222  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:17.718312  4332 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.722620  4333 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.724089  4405 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.724952  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:17.725739  4332 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.727679  5441 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.728245  5441 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:17.729156  5441 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.716389  4248 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.712181  4989 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:17.735605  4405 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.737035  4955 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:17.738128  5486 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.781041  4148 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.787335  5486 raft_consensus.cc:697] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:17.789594  5486 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.804868  4148 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.820504  5415 raft_consensus.cc:993] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.821027  5415 raft_consensus.cc:1081] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.822851  4989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:17.823441  4989 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.823802  4989 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.831208  4989 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.833715  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:17.833995  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:17.834378  4248 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.834524  4408 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.834775  4248 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.833137  4989 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:17.835670  4248 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.836922  4248 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.840196  4408 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.843279  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:17.844249  5486 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.844623  4248 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.844753  5486 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:17.845726  5486 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.863709  4148 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.917097  5503 raft_consensus.cc:993] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.917642  5434 raft_consensus.cc:1081] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:17.919205  4989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:17.919799  4989 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.920168  4989 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.927248  4989 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.929811  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:17.930425  4248 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.930784  4248 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.931599  4248 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.932785  4989 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:17.932821  4248 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.933776  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:17.934399  4408 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.942378  4248 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.943599  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:17.943724  5507 raft_consensus.cc:993] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:17.944334  5457 raft_consensus.cc:1081] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:17.944432  5486 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.945007  5486 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:17.945509  4408 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:17.945932  5486 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:17.947041  4248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41692
I20260709 12:20:17.947685  4248 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:17.948096  4248 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.954906  4148 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:17.956574  4248 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:17.960970  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:17.961609  4333 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:17.961935  4333 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:17.962699  4333 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:17.963621  4333 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.979583  4249 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:17.981433  5457 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:17.982538  4248 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:17.983083  4332 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:17.982949  4333 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:17.984655  5504 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:17.985431  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:17.985981  4405 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:17.987036  4219 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:17.990000  5503 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:17.990485  5503 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:17.991346  5503 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:18.016633  4249 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:18.017994  5504 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:20:18.029476  4405 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:18.050522  4989 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Advancing to term 4
I20260709 12:20:18.069738  4148 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.079599  4405 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:18.082988  5507 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.092041  4989 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:18.098085  5507 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:18.123504  5507 raft_consensus.cc:1064] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:18.126163  5507 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.134387  4989 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:18.135885  5497 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:18.147356  4408 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:18.147356  4249 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:18.161592  5457 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:18.162885  5502 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:18.202412  5502 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.209422  4405 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.242393  4248 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.252418  4332 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.254021  5486 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:18.260679  4405 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.262184  5486 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:18.251782  4149 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.283895  4253 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.285920  5517 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.307926  4257 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.309435  5517 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:18.319250  4404 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.322695  5517 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.317323  4989 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.340679  4332 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.359220  5517 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.364152  4400 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.377619  5517 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:18.382258  4332 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.392177  4400 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:18.393940  5456 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.437719  4326 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:18.439493  5456 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.462815  4987 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:18.465777  4249 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:18.493798  5532 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:18.496112  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 136556us
I20260709 12:20:18.496382  5532 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:18.510165  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 64176.5us
I20260709 12:20:18.512113  4249 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:18.529102  5517 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:18.534725  5502 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.552068  4253 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.569785  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7092b1e5ebf04097a82982b4008c4d7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:18.567809  4989 raft_consensus.cc:2955] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.606135  4148 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 6 to 7, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:18.607172  4332 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:18.608532  5544 log.cc:927] Time spent T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:20:18.625805  4249 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:18.625833  4404 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:18.627445  5530 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.629383  5532 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:18.634896  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b18524a049aa4e8687009c73a015e710. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.639259  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet 7092b1e5ebf04097a82982b4008c4d7e with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:18.641743  5549 tablet_replica.cc:333] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:18.642906  5549 raft_consensus.cc:2243] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:18.643946  5549 raft_consensus.cc:2272] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.642993  5532 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.646222  4249 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.651046  5549 ts_tablet_manager.cc:1916] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:18.655202  4404 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.670683  5549 ts_tablet_manager.cc:1929] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:20:18.671217  5549 log.cc:1199] T 7092b1e5ebf04097a82982b4008c4d7e P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/7092b1e5ebf04097a82982b4008c4d7e
I20260709 12:20:18.673671  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet 7092b1e5ebf04097a82982b4008c4d7e (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:18.678197  4405 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:18.678056  4152 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.679263  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:18.711061  4326 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:18.712364  4371 consensus_peers.cc:597] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75e006bba424d8b9ae7dfa589237877. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.712916  5405 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.716051  4249 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:18.719827  5504 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.725993  5405 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.737757  4326 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.748960  4152 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.759024  4249 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:18.771461  4257 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:18.774755  4218 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 853b8c508a614bb4b9fdc0c62fe13342. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.774902  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:18.775897  4405 raft_consensus.cc:606] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:18.779512  4326 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:18.780318  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:18.780875  4253 raft_consensus.cc:606] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:18.781023  5503 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.786592  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:18.787115  4405 raft_consensus.cc:606] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:18.789897  5456 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.793716  5505 raft_consensus.cc:993] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:18.794261  5504 raft_consensus.cc:1081] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:18.794364  4401 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:18.789845  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:18.796169  4326 raft_consensus.cc:606] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:18.803107  4401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:18.803789  4401 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:18.798732  4326 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.809194  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:18.809427  5456 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:18.809592  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:18.809892  4257 raft_consensus.cc:606] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:18.810220  4249 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.812903  4249 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.815989  4401 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.820295  4249 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.822307  4249 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:18.823463  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:18.825937  4987 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.828945  4253 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:18.831251  4987 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:18.832167  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:18.832785  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:18.833562  5456 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:18.833876  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:18.834177  5456 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:18.834654  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:18.835021  5456 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.839093  5415 raft_consensus.cc:993] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:18.839628  5415 raft_consensus.cc:1081] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:18.842959  5504 raft_consensus.cc:993] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:18.843492  5504 raft_consensus.cc:1081] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:18.845245  4989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:18.845875  4989 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.846330  4989 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.846830  4990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:20:18.847415  4990 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.847748  4990 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.849222  4149 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.855406  4990 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.843652  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:18.877501  4401 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:18.877900  4401 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:18.878772  4401 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.883677  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:18.884305  4405 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:18.884611  4405 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:18.884855  4401 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.885293  4405 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.886375  4405 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.886643  4990 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:18.888701  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:18.895660  4326 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.875455  4989 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.901018  4989 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:18.901993  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:18.902299  4333 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:18.902580  4253 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:18.902923  4253 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:18.903858  4253 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.904384  5415 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.905033  4253 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.905504  4405 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:18.913193  4955 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:18.913633  4326 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:18.916429  4149 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:18.917666  5517 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:18.922112  5517 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:18.923142  4253 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:18.922982  5517 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.924469  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:18.925364  4405 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.929065  5503 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.917971  4401 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
W20260709 12:20:18.917687  4218 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7d14a1bca614fe1af748ef119552803. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.932838  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:18.933817  5486 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:18.934293  5486 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:18.935118  5486 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:18.939608  4408 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:18.940053  4333 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.942229  4405 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:18.944613  5434 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.946242  4148 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.948632  5553 raft_consensus.cc:993] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:18.949136  5553 raft_consensus.cc:1081] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:18.962203  4253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:18.962817  4253 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.962939  5530 raft_consensus.cc:993] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:18.963236  4253 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:18.963531  5502 raft_consensus.cc:1081] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:18.971050  4148 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:18.970439  4253 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:18.977236  4253 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:18.977943  4400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:18.979760  4400 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:18.980093  4400 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:18.986699  4400 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:18.988585  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:18.989401  4333 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.002460  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:19.003118  4401 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.009409  4401 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:19.010941  4400 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:19.010339  4401 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:19.012023  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:19.012606  4326 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:19.012892  4326 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:19.013612  4326 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:19.014602  4326 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.014707  5415 raft_consensus.cc:993] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:19.015409  5503 raft_consensus.cc:1081] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:19.017314  4990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:19.017840  4990 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.018208  4990 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.017480  4405 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:19.020440  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:19.020974  4253 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:19.011508  4149 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.026729  4253 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:19.028580  4333 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:19.029650  4219 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:19.027098  4990 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:19.030869  5434 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.031369  5434 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:19.031452  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:19.032689  5405 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:19.032284  5434 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:19.033121  5405 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:19.033869  5405 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:19.039413  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:19.040541  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:19.050983  4253 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.042285  4990 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:19.043221  4326 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:19.012893  4401 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.068527  4149 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.059180  4253 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:19.076956  4253 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:19.076735  4148 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.078387  4253 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.056499  4333 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.089967  4401 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:19.093432  4253 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:19.094834  4333 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:19.095582  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:19.100682  5562 ts_tablet_manager.cc:933] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:19.100814  5486 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.101653  5486 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:19.102926  5486 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:19.124490  5563 ts_tablet_manager.cc:933] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:19.126786  5562 tablet_copy_client.cc:323] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:19.129220  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet b18524a049aa4e8687009c73a015e710 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:19.129801  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet b18524a049aa4e8687009c73a015e710 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-b18524a049aa4e8687009c73a015e710
I20260709 12:20:19.140843  4344 tablet_copy_source_session.cc:215] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:19.144619  5562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18524a049aa4e8687009c73a015e710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.149663  4149 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.161687  5563 tablet_copy_client.cc:323] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:19.163655  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet c75e006bba424d8b9ae7dfa589237877 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:19.164216  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet c75e006bba424d8b9ae7dfa589237877 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-c75e006bba424d8b9ae7dfa589237877
I20260709 12:20:19.164227  5562 tablet_copy_client.cc:806] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:19.167974  5562 tablet_copy_client.cc:670] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:19.171878  4419 tablet_copy_source_session.cc:215] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:19.172268  5562 tablet_copy_client.cc:538] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:19.175360  5563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e006bba424d8b9ae7dfa589237877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.183928  5562 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:19.193500  5563 tablet_copy_client.cc:806] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:19.194129  5563 tablet_copy_client.cc:670] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:19.197897  5563 tablet_copy_client.cc:538] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:19.204031  5562 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:19.205017  5562 tablet_bootstrap.cc:492] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:19.205694  5562 ts_tablet_manager.cc:1403] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 12:20:19.209187  5563 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:19.208740  5562 raft_consensus.cc:359] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.209607  5562 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:19.210284  5562 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.213320  5562 ts_tablet_manager.cc:1434] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:19.215214  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-b18524a049aa4e8687009c73a015e710 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:19.215638  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-b18524a049aa4e8687009c73a015e710 on tablet b18524a049aa4e8687009c73a015e710 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:19.243532  5563 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:19.244398  5563 tablet_bootstrap.cc:492] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:19.245076  5563 ts_tablet_manager.cc:1403] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.007s
I20260709 12:20:19.247502  5563 raft_consensus.cc:359] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.248152  5563 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:19.248661  5563 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.251078  5563 ts_tablet_manager.cc:1434] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:20:19.253083  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-c75e006bba424d8b9ae7dfa589237877 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:19.253502  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-c75e006bba424d8b9ae7dfa589237877 on tablet c75e006bba424d8b9ae7dfa589237877 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:19.287410  5563 ts_tablet_manager.cc:933] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:19.288998  5563 tablet_copy_client.cc:323] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:19.290587  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 853b8c508a614bb4b9fdc0c62fe13342 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:19.291044  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 853b8c508a614bb4b9fdc0c62fe13342 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-853b8c508a614bb4b9fdc0c62fe13342
I20260709 12:20:19.299674  4267 tablet_copy_source_session.cc:215] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:19.302090  4401 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.303141  5563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853b8c508a614bb4b9fdc0c62fe13342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.304064  5503 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.312155  5562 ts_tablet_manager.cc:933] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:19.314766  5562 tablet_copy_client.cc:323] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:19.318400  4333 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.320092  5517 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.321543  5563 tablet_copy_client.cc:806] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:19.322089  5563 tablet_copy_client.cc:670] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:19.323508  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet a7d14a1bca614fe1af748ef119552803 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:19.324061  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet a7d14a1bca614fe1af748ef119552803 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-a7d14a1bca614fe1af748ef119552803
I20260709 12:20:19.334018  4267 tablet_copy_source_session.cc:215] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:19.334419  5563 tablet_copy_client.cc:538] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:19.346663  5563 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:19.366319  5562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d14a1bca614fe1af748ef119552803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:19.384359  5563 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:19.387815  5563 tablet_bootstrap.cc:492] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:19.388510  5563 ts_tablet_manager.cc:1403] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.014s
I20260709 12:20:19.410403  5563 raft_consensus.cc:359] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.411329  5563 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:19.411963  5563 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.414337  5563 ts_tablet_manager.cc:1434] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:20:19.421736  4990 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.424034  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-853b8c508a614bb4b9fdc0c62fe13342 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:19.424517  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-853b8c508a614bb4b9fdc0c62fe13342 on tablet 853b8c508a614bb4b9fdc0c62fe13342 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:19.424266  5434 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.425899  5562 tablet_copy_client.cc:806] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:19.426537  5562 tablet_copy_client.cc:670] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:19.435979  4405 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.438988  5517 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.439648  4332 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:19.442612  5505 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:19.451588  4253 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.453888  5517 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:19.467717  5562 tablet_copy_client.cc:538] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:19.484614  5562 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:19.500065  4401 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.507771  5486 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.512318  4326 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:19.516376  5503 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:19.532151  5562 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:19.533187  5562 tablet_bootstrap.cc:492] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:19.534044  5562 ts_tablet_manager.cc:1403] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.012s
I20260709 12:20:19.537384  5562 raft_consensus.cc:359] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.538229  5562 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:19.538965  5562 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:19.542171  5562 ts_tablet_manager.cc:1434] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:19.543831  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-a7d14a1bca614fe1af748ef119552803 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:19.544242  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-a7d14a1bca614fe1af748ef119552803 on tablet a7d14a1bca614fe1af748ef119552803 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:19.558990  4253 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:19.559031  4257 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.561446  5486 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.570587  4990 raft_consensus.cc:1217] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:19.573120  4405 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:19.590618  4332 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:19.592154  5486 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:19.602706  5456 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:19.613551  5553 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:19.697674  4990 raft_consensus.cc:1217] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:19.822491  4990 raft_consensus.cc:1217] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:19.845911  4990 raft_consensus.cc:1217] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:20:20.025666  5502 raft_consensus.cc:1064] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:20.028385  5502 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.036031  4987 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.036247  4400 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.036474  4253 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.037829  5507 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.038748  5502 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.041420  5457 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.053937  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:20.078334  5507 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.092010  4257 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.109452  4987 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.117656  4400 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.136868  4149 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.161288  4326 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.169826  4987 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:20.171121  5507 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.175460  4400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:20.176234  4400 raft_consensus.cc:606] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:20.417187  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 56219.3us
I20260709 12:20:20.424485  4253 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:20.427384  5602 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.448995  5553 raft_consensus.cc:1064] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:20.475502  5598 raft_consensus.cc:1064] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:20.479154  5598 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.489341  5507 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.496940  5599 raft_consensus.cc:993] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:20.506435  5505 raft_consensus.cc:1081] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:20.508934  4253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:20.510887  4253 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.499168  5553 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.511381  4253 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.512284  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:20.512892  4405 raft_consensus.cc:606] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:20.522658  4253 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:20.531529  4253 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:20.537508  5601 raft_consensus.cc:1064] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:20.538674  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:20.539285  4333 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.541018  5601 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.549512  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b18524a049aa4e8687009c73a015e710 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:20.565604  4987 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.571630  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:20.572273  4405 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:20.572593  4405 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:20.573308  4405 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:20.575649  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:20.576961  4253 raft_consensus.cc:2955] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.583639  4333 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:20.584388  4329 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.585817  5605 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.587736  4405 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.594765  4333 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.595803  4990 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.597630  4219 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:20.598456  5434 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:20.598904  5434 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:20.599251  5503 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.599745  5434 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:20.607599  4148 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.613217  4254 raft_consensus.cc:606] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:20.618204  4405 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:20.621488  4329 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:20.624675  4401 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.626811  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet b18524a049aa4e8687009c73a015e710 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:20.627230  4333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:20.627879  4333 raft_consensus.cc:606] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:20.626077  5603 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.630131  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:20.632243  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:20.633028  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:20.634805  4990 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.644526  4990 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:20.640650  4153 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.648736  5613 tablet_replica.cc:333] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:20.650266  5434 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.650321  5601 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:20.649772  5613 raft_consensus.cc:2243] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:20.652696  4401 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:20.666209  5613 raft_consensus.cc:2272] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.677924  5603 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:20.653728  5605 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:20:20.653550  4253 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:20.681622  5613 ts_tablet_manager.cc:1916] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:20.682374  5603 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.684864  5605 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:20.705444  5601 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.713250  5613 ts_tablet_manager.cc:1929] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:20.713824  5613 log.cc:1199] T b18524a049aa4e8687009c73a015e710 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/b18524a049aa4e8687009c73a015e710
I20260709 12:20:20.715610  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet b18524a049aa4e8687009c73a015e710 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:20.722527  4989 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.727231  5598 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.731163  5600 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.736032  4253 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.740681  4990 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.748521  4405 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.756494  4333 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.762239  4987 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.775095  4152 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.786877  4408 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.790103  5601 raft_consensus.cc:993] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:20.799811  4333 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.800673  4405 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.807385  4329 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.815831  4152 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.819151  4326 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:20.821482  5605 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:20.830467  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 48217.6us
I20260709 12:20:20.831684  5603 raft_consensus.cc:1081] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:20.833143  5405 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.843071  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c75e006bba424d8b9ae7dfa589237877 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:20.845537  4153 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.846498  4333 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.850646  4987 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:20.853533  5405 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.861920  4405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:20.862474  4405 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:20.862807  4405 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.891144  4405 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.893500  4405 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:20.868825  4989 raft_consensus.cc:2955] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.893916  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:20.894497  4254 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:20.894830  4254 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:20.895166  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:20.895717  4329 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.895587  4254 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.896909  4254 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.901115  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:20.901635  4987 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:20.908533  4329 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:20.913405  4249 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:20.912550  4149 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.915594  4254 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:20.918911  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:20.920312  5405 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:20.920823  5405 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:20.921635  5405 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:20.922083  4137 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 853b8c508a614bb4b9fdc0c62fe13342 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0aa405b398df42edbf74ee643aeb18dc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.922636  4987 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:20.925819  4329 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:20.927500  5603 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.931453  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet c75e006bba424d8b9ae7dfa589237877 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:20.936861  4990 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:20.951938  5598 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:20.981595  5598 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:20.985759  5621 tablet_replica.cc:333] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:21.002410  5599 raft_consensus.cc:993] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:21.002887  5599 raft_consensus.cc:1081] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:21.010289  4152 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.012459  4990 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:21.023546  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7d14a1bca614fe1af748ef119552803 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:21.029758  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:21.030328  4249 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.030686  4249 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.035632  4329 raft_consensus.cc:2955] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:21.037626  4149 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:21.058156  4401 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.069021  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet a7d14a1bca614fe1af748ef119552803 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:21.069948  5613 tablet_replica.cc:333] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:21.074203  5621 raft_consensus.cc:2243] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:21.078785  5621 raft_consensus.cc:2272] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:21.085060  5621 ts_tablet_manager.cc:1916] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:21.090679  5601 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.096796  5604 raft_consensus.cc:993] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:21.097255  5604 raft_consensus.cc:1081] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:21.098845  5613 raft_consensus.cc:2243] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:21.099591  5613 raft_consensus.cc:2272] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:21.102378  4408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:21.102921  4408 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.103251  4408 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.113289  4249 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.117151  4249 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:21.119179  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:21.102934  5613 ts_tablet_manager.cc:1916] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:21.119771  4405 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.123031  4405 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:21.121321  5621 ts_tablet_manager.cc:1929] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:21.123562  5621 log.cc:1199] T c75e006bba424d8b9ae7dfa589237877 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/c75e006bba424d8b9ae7dfa589237877
I20260709 12:20:21.123813  4405 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.125145  4405 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.125257  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet c75e006bba424d8b9ae7dfa589237877 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:21.132633  4408 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.134553  4408 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:21.135742  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:21.136291  4332 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.136574  4332 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:21.137248  4332 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.138226  4332 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.139442  4405 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
W20260709 12:20:21.144390  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 65426us
I20260709 12:20:21.150071  4332 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:21.151239  4372 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:21.152274  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:21.152668  5405 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.152889  4249 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.153149  5405 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:21.154021  5405 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.155613  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:21.156342  5434 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.156754  5434 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:21.157471  5434 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.162166  4249 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:21.167747  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:21.168361  4326 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.177059  4326 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:21.179709  4332 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.188284  5601 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.189592  4153 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.179734  5613 ts_tablet_manager.cc:1929] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:21.192202  5613 log.cc:1199] T a7d14a1bca614fe1af748ef119552803 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/a7d14a1bca614fe1af748ef119552803
I20260709 12:20:21.193925  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet a7d14a1bca614fe1af748ef119552803 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:21.194375  4149 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.400548  4249 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:21.402367  5605 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:21.420336  4990 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:21.421770  5605 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:21.445698  4326 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:21.447149  5405 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:20:21.455566  5013 debug-util.cc:398] Leaking SignalData structure 0x7b080030c2a0 after lost signal to thread 3105
W20260709 12:20:21.456888  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08002353c0 after lost signal to thread 4187
W20260709 12:20:21.458683  5013 debug-util.cc:398] Leaking SignalData structure 0x7b0800218480 after lost signal to thread 4281
W20260709 12:20:21.460029  5013 debug-util.cc:398] Leaking SignalData structure 0x7b0800286e60 after lost signal to thread 4358
W20260709 12:20:21.461292  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5120 after lost signal to thread 4433
W20260709 12:20:21.462481  5013 debug-util.cc:398] Leaking SignalData structure 0x7b0800335960 after lost signal to thread 5016
I20260709 12:20:21.591204  4326 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.602388  5434 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.617420  4405 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.619175  5622 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.652499  4405 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:21.658533  4990 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:21.663628  5630 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:21.672070  4257 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:21.673529  5630 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:21.674813  5405 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:21.677780  4257 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:21.687057  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 853b8c508a614bb4b9fdc0c62fe13342 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 12:20:21.695580  4149 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 4 to 6, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:21.713181  4990 raft_consensus.cc:2955] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:21.723488  4326 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.725251  5405 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:21.753696  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 853b8c508a614bb4b9fdc0c62fe13342 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:21.766642  5638 tablet_replica.cc:333] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:21.767746  5638 raft_consensus.cc:2243] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:21.768364  5638 raft_consensus.cc:2272] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:21.771178  4257 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:21.773209  5632 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:21.776948  5638 ts_tablet_manager.cc:1916] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:21.781005  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.821624  5638 ts_tablet_manager.cc:1929] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:20:21.822242  5638 log.cc:1199] T 853b8c508a614bb4b9fdc0c62fe13342 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/853b8c508a614bb4b9fdc0c62fe13342
I20260709 12:20:21.826087  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 853b8c508a614bb4b9fdc0c62fe13342 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:21.863240  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:21.863889  4405 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:21.866786  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:21.867446  4326 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:21.870337  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:21.870875  4257 raft_consensus.cc:606] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:21.873734  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:21.874202  4257 raft_consensus.cc:606] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:21.876685  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5f00fff96847178a1970711feff2f0"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:21.877235  4257 raft_consensus.cc:606] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:21.880607  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:21.881160  4405 raft_consensus.cc:606] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:21.882704  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:21.884253  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:21.885335  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.906206  5434 raft_consensus.cc:993] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:21.906782  5434 raft_consensus.cc:1081] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:21.908473  4326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:21.908921  4326 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.909220  4326 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.913882  4326 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.916241  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:21.916363  4326 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:21.916821  4257 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:21.917112  4257 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:21.917405  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:21.918016  4405 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.917791  4257 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.921226  4257 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:21.926422  4405 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:21.930362  4257 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:21.931200  5599 raft_consensus.cc:993] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:21.934136  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:21.937906  5599 raft_consensus.cc:1081] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:21.939569  5640 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:21.940075  5640 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:21.940836  5640 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.941219  4257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:21.943011  4257 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:21.943588  4257 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.959090  4257 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.962811  4257 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:21.964162  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:21.964829  4405 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:21.965137  4405 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:21.965929  4405 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.967051  4405 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.966269  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:21.968338  4326 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:21.971328  4152 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:21.974706  4405 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:21.977842  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:21.979091  5434 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:21.979583  5434 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:21.980381  5434 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:21.991379  4326 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:22.004972  4152 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.118912  5601 raft_consensus.cc:993] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:22.120048  5601 raft_consensus.cc:1081] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:22.125023  4990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:22.126389  4990 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.127053  4990 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.147221  5622 raft_consensus.cc:993] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:22.148324  5598 raft_consensus.cc:1081] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:22.156397  4329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be5f00fff96847178a1970711feff2f0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:22.157063  4329 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.157436  4329 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.161299  4990 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:22.177369  4990 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:22.180655  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:22.181761  4326 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.189107  4329 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.191577  4329 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:22.196362  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:22.196935  4254 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.197242  4254 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:22.198197  4254 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.199407  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:22.200018  4249 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:22.200316  4249 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:22.202764  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:22.203568  4401 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.203604  4254 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.201756  4249 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:22.206701  4249 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:22.207157  4326 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:22.213918  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:22.214972  5541 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:22.215508  5541 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:22.216531  5541 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:22.222316  4254 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:22.237366  5605 raft_consensus.cc:993] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:22.238595  5605 raft_consensus.cc:1081] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:22.238996  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:22.241740  4254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:22.241936  5640 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:22.242473  4254 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.242532  5640 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:22.243031  4254 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.247102  5640 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.250908  5507 raft_consensus.cc:993] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:22.251500  5507 raft_consensus.cc:1081] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:22.253230  4405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:22.253821  4405 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.254186  4405 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.237288  4249 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:22.258337  4254 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.258879  4401 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:22.261860  4254 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:22.265479  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:22.258363  4152 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:22.266095  4401 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:22.267113  4401 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:22.269924  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:22.271991  4326 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.282344  4401 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.314440  4326 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:22.316299  4219 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:22.317456  5622 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:22.317957  5622 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:22.319027  5622 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.314713  4401 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.329484  4405 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.345008  4152 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.346567  4149 catalog_manager.cc:5697] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.360852  4401 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:22.362100  4249 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.377347  4329 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:22.378789  5622 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:22.385584  4405 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:22.393877  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:22.394156  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 65984.6us
I20260709 12:20:22.394639  4254 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.396097  5507 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.406184  4405 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.408895  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:22.409636  4329 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:22.411171  4329 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:22.412129  4329 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.413641  4254 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:22.434127  4404 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:22.436092  5507 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.451972  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:22.453007  5599 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:22.453572  5599 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:22.454561  5599 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:22.460448  4329 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:22.475025  4329 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:22.475474  5644 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:22.516629  4152 catalog_manager.cc:5697] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:22.634919  4332 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:22.636445  5648 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:22.656128  4249 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:22.664024  5541 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:22.742740  4404 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.743952  4254 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:22.745455  5507 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.746058  5640 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:22.877882  4404 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:22.879361  5598 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:22.895933  4332 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:22.897338  5622 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:22.913951  4405 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:22.922667  4329 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:22.924281  5630 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:22.926379  4371 consensus_peers.cc:597] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2742c399a2d4e5dae60161a45cce316. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:22.927870  4257 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:22.938198  5630 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:22.940706  4257 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:22.944203  5630 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:22.949265  5632 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:22.951808  4329 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:22.956228  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:22.976436  4254 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.017163  4326 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.018632  5598 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:23.030619  4332 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.032349  5599 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:20:23.038398  4218 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c970994e11f4080b5624db5219101b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:23.053877  4405 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.069169  4153 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.106565  5622 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:23.121536  5601 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.127714  4332 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.170841  4257 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.181357  4152 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:23.182634  4254 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:23.199805  4218 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d4dedbb3ee0412db92c974e0c25a776. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:23.203387  4332 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:23.205534  5598 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:23.214107  5601 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.215646  4333 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.231086  4404 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.241463  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:23.242208  4254 raft_consensus.cc:606] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:23.248390  4329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:23.248951  4329 raft_consensus.cc:606] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:23.249636  4405 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:23.253415  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:23.253932  4405 raft_consensus.cc:606] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:23.257568  4329 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.260648  5598 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:23.263264  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:23.265064  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:23.266033  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:23.272125  4404 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.251014  4149 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:23.322449  4296 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b22e067af7004ed88fb3125c7ac731ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:23.326013  4404 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:23.327623  5640 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.336583  4257 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:23.338294  5640 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:23.355809  5645 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.370010  4257 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.416226  4149 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.418056  4404 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:23.465258  5683 ts_tablet_manager.cc:933] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:23.474938  5644 raft_consensus.cc:993] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:23.475579  5644 raft_consensus.cc:1081] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:23.477413  4408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:23.477999  4408 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.478786  4408 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.480116  5683 tablet_copy_client.cc:323] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:23.487967  4408 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:23.490324  4408 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:23.491219  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:23.491567  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:23.492333  4333 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.491816  4257 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:23.493793  4257 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:23.496871  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet e2742c399a2d4e5dae60161a45cce316 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:23.496877  4257 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:23.497553  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet e2742c399a2d4e5dae60161a45cce316 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-e2742c399a2d4e5dae60161a45cce316
I20260709 12:20:23.498128  4257 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.503975  5684 ts_tablet_manager.cc:933] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:23.513157  4419 tablet_copy_source_session.cc:215] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:23.519001  5683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2742c399a2d4e5dae60161a45cce316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.519443  5684 tablet_copy_client.cc:323] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:23.521620  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 1c970994e11f4080b5624db5219101b4 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:23.522193  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 1c970994e11f4080b5624db5219101b4 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-1c970994e11f4080b5624db5219101b4
I20260709 12:20:23.523083  4257 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:23.524612  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:23.525509  5673 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:23.525998  5673 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:23.526901  5673 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:23.536240  4267 tablet_copy_source_session.cc:215] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:23.539391  4333 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:23.540555  5684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c970994e11f4080b5624db5219101b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.549196  4152 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.553084  5683 tablet_copy_client.cc:806] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:23.553786  5683 tablet_copy_client.cc:670] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:23.558691  5683 tablet_copy_client.cc:538] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:23.568421  5683 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:23.590621  5645 raft_consensus.cc:993] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:23.591207  5645 raft_consensus.cc:1081] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:23.592994  4989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:20:23.593528  4989 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.593894  4989 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.602170  4989 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:23.604717  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:23.605015  4989 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:23.605293  4257 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.606405  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:23.611691  4333 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.612015  4333 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:23.612814  4333 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:23.614132  4333 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.619161  5683 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:23.620165  5683 tablet_bootstrap.cc:492] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:23.620908  5683 ts_tablet_manager.cc:1403] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.053s	user 0.026s	sys 0.004s
I20260709 12:20:23.624343  5683 raft_consensus.cc:359] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.625134  5683 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:23.626302  4257 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:23.627265  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:23.627056  5683 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.628113  5661 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.628613  5661 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:23.629467  5661 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:23.660713  5683 ts_tablet_manager.cc:1434] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.004s
I20260709 12:20:23.663949  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-e2742c399a2d4e5dae60161a45cce316 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:23.664435  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-e2742c399a2d4e5dae60161a45cce316 on tablet e2742c399a2d4e5dae60161a45cce316 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:23.669914  5683 ts_tablet_manager.cc:933] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:23.650828  4333 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:23.671741  5684 tablet_copy_client.cc:806] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:23.672390  5684 tablet_copy_client.cc:670] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:23.677067  4152 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.679661  5683 tablet_copy_client.cc:323] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:23.681187  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 4d4dedbb3ee0412db92c974e0c25a776 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:23.681622  5684 tablet_copy_client.cc:538] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:23.681660  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 4d4dedbb3ee0412db92c974e0c25a776 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-4d4dedbb3ee0412db92c974e0c25a776
I20260709 12:20:23.694815  5684 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:23.697723  4267 tablet_copy_source_session.cc:215] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:23.701171  5683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4dedbb3ee0412db92c974e0c25a776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.740475  5683 tablet_copy_client.cc:806] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:23.741074  5683 tablet_copy_client.cc:670] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:23.747814  5683 tablet_copy_client.cc:538] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:23.759737  5630 raft_consensus.cc:993] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:23.760232  5630 raft_consensus.cc:1081] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:23.765300  5684 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:23.767896  4257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:23.772380  4257 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.772850  4257 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.779909  4257 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:23.772842  5684 tablet_bootstrap.cc:492] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:23.782020  5684 ts_tablet_manager.cc:1403] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.011s
I20260709 12:20:23.785116  5684 raft_consensus.cc:359] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.785887  5684 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:23.786545  5684 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.788995  5683 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:23.790421  4257 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:23.792611  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:23.793210  4408 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.793512  4408 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:23.794350  4408 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:23.804656  4408 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.816828  4408 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:23.827885  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:23.828506  4990 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.834470  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:23.835783  5644 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.836407  5644 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:23.837451  5644 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:23.866189  5684 ts_tablet_manager.cc:1434] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.084s	user 0.003s	sys 0.003s
I20260709 12:20:23.867194  4990 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:23.899207  4152 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:23.904305  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 71096.2us
I20260709 12:20:23.906484  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-1c970994e11f4080b5624db5219101b4 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:23.906992  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-1c970994e11f4080b5624db5219101b4 on tablet 1c970994e11f4080b5624db5219101b4 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:23.928179  5690 ts_tablet_manager.cc:933] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:23.940522  4990 raft_consensus.cc:1217] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:20:23.946911  5690 tablet_copy_client.cc:323] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:23.951936  5683 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:23.953011  5683 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:23.953802  5683 ts_tablet_manager.cc:1403] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.165s	user 0.029s	sys 0.004s
I20260709 12:20:23.955624  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet b22e067af7004ed88fb3125c7ac731ad from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:23.956260  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet b22e067af7004ed88fb3125c7ac731ad from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-b22e067af7004ed88fb3125c7ac731ad
I20260709 12:20:23.957255  5683 raft_consensus.cc:359] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.958197  5683 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:23.958926  5683 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:23.961843  5683 ts_tablet_manager.cc:1434] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:23.966190  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-4d4dedbb3ee0412db92c974e0c25a776 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:23.966652  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-4d4dedbb3ee0412db92c974e0c25a776 on tablet 4d4dedbb3ee0412db92c974e0c25a776 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:23.977250  4344 tablet_copy_source_session.cc:215] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:23.980988  5690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b22e067af7004ed88fb3125c7ac731ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:24.001957  5690 tablet_copy_client.cc:806] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:24.002683  5690 tablet_copy_client.cc:670] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:24.011687  5690 tablet_copy_client.cc:538] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:24.078552  5690 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:24.124214  4333 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:24.126178  5703 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:24.138379  4257 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:24.138586  4992 raft_consensus.cc:1217] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 12:20:24.140457  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 54751.5us
W20260709 12:20:24.181092  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59518.5us
I20260709 12:20:24.182317  5703 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:24.216431  4992 raft_consensus.cc:1217] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:20:24.225095  4257 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:24.227329  5693 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:24.246531  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 65635.3us
I20260709 12:20:24.250981  4329 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:24.258889  5694 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:24.266464  4990 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:24.275440  5698 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:24.349812  4404 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:24.375507  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:24.452920  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 80510.5us
I20260709 12:20:24.522559  4333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:24.523343  4333 raft_consensus.cc:606] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:24.535691  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 144085us
W20260709 12:20:24.590541  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 74713.8us
W20260709 12:20:24.668398  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 91559.5us
W20260709 12:20:24.593209  5713 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:24.715610  5721 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:20:24.761952  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 91647.3us
I20260709 12:20:24.797194  5690 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:24.798235  5690 tablet_bootstrap.cc:492] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:24.801916  5690 ts_tablet_manager.cc:1403] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.724s	user 0.038s	sys 0.033s
I20260709 12:20:24.814252  4252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:24.815016  4252 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:24.832862  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59431.3us
W20260709 12:20:24.840759  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 86951.8us
I20260709 12:20:24.865314  5690 raft_consensus.cc:359] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:24.873003  5690 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:24.873723  5690 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:24.876284  5690 ts_tablet_manager.cc:1434] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 12:20:24.879779  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-b22e067af7004ed88fb3125c7ac731ad received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:24.880285  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-b22e067af7004ed88fb3125c7ac731ad on tablet b22e067af7004ed88fb3125c7ac731ad with peer 0952d204644f41a88e5e463e697dcc27
W20260709 12:20:24.993376  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 282521us
I20260709 12:20:24.996347  5732 raft_consensus.cc:1064] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:25.003863  5712 raft_consensus.cc:993] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:25.004472  5712 raft_consensus.cc:1081] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:25.022457  4987 raft_consensus.cc:1217] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:20:25.035907  5740 raft_consensus.cc:1064] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:25.039535  5740 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.044852  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:25.045509  4405 raft_consensus.cc:606] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:25.049714  5742 raft_consensus.cc:1064] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:25.050249  5742 raft_consensus.cc:1068] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:25.057114  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:25.059500  4254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41692
I20260709 12:20:25.060230  4254 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.060643  4254 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.058909  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:25.065310  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:25.022554  5732 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.072846  5756 raft_consensus.cc:993] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:25.075956  5729 raft_consensus.cc:1081] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:25.079635  4254 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.085388  4332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:25.086054  4332 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.086417  4332 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.104598  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:25.105254  4987 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.105794  4332 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:25.108140  4332 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:25.103231  4254 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:25.119496  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:25.120128  4329 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.120435  4329 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:25.121181  4329 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.122277  4329 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.124503  4987 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:25.125813  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:25.126698  5729 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.127161  5729 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:25.128001  5729 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.140970  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:25.150671  4404 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.152321  4331 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:25.150019  4992 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:25.154909  4329 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:25.162048  4405 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:25.155153  5730 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:25.163281  5715 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:25.164565  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:25.165297  4254 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:25.165668  4254 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:25.166641  4254 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:25.169469  4254 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:25.156765  4252 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:25.159518  4332 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:25.160846  4992 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:25.177774  5756 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:25.177948  5715 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:25.183676  5730 raft_consensus.cc:993] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:25.184688  5714 raft_consensus.cc:1081] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:25.187608  5756 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:25.190963  5756 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:25.197310  4253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:25.197943  4253 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.198290  4253 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.205108  4253 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.207132  4253 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:25.209594  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:25.210237  4989 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.216589  4989 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:25.217263  4148 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.221599  4404 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:25.266732  4990 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:25.231037  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:25.234058  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:25.267812  4405 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.268101  4405 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:25.268832  4405 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.266973  5730 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.271678  4254 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:25.279266  4296 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:25.280097  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 49156.9us
I20260709 12:20:25.289449  4332 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.291692  5732 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.291716  5640 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:25.294512  5732 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:25.294675  5640 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:25.295852  5732 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:25.299247  5640 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:25.270570  4252 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:25.417754  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 65887.4us
W20260709 12:20:25.269601  5715 consensus_queue.cc:1175] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0952d204644f41a88e5e463e697dcc27" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:25.451093  4405 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.462584  4990 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.474191  4407 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.430572  5724 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:25.564123  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 54780.8us
I20260709 12:20:25.590063  4405 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:25.620610  4992 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:25.649472  5598 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:20:25.657104  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 189187us
I20260709 12:20:25.714495  4253 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:25.746560  4329 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.754622  4332 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:20:25.784540  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 175632us
I20260709 12:20:25.806098  5599 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:25.806726  5599 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:25.809121  5599 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:25.813949  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:25.848924  4992 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.854066  4989 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:25.858871  5732 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.863914  5601 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:25.865707  4153 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.872164  4152 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:25.882128  4405 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:25.883283  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:25.905519  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 80281.9us
W20260709 12:20:25.920389  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 134130us
I20260709 12:20:25.924961  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:25.926360  5630 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:25.939716  5751 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:25.941102  5732 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:25.952322  4987 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Advancing to term 4
I20260709 12:20:25.966559  4401 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:26.002599  4987 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:20:26.070748  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 47092.3us
I20260709 12:20:26.073515  5782 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:26.085434  5704 raft_consensus.cc:1064] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:26.087998  5704 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:26.091130  5679 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:26.100044  4151 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.093915  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:26.102965  4326 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:20:26.102514  4151 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.127669  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:26.128330  4326 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Received request to transfer leadership
W20260709 12:20:26.138844  4138 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 4d4dedbb3ee0412db92c974e0c25a776 already in progress
I20260709 12:20:26.154933  5791 raft_consensus.cc:993] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:26.167158  5791 raft_consensus.cc:1081] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:26.170972  4252 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:26.181272  4400 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:26.186980  4404 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:26.182320  4332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:26.182758  5791 raft_consensus.cc:1064] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:26.184749  4992 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:26.187747  4332 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:20:26.192029  4254 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:20:26.231107  4201 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:26.241881  4201 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 4d4dedbb3ee0412db92c974e0c25a776 already in progress
I20260709 12:20:26.213394  4257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41692
W20260709 12:20:26.228924  5791 raft_consensus.cc:1068] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:26.224709  4404 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:26.243176  4257 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.230400  4326 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:26.243611  4257 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:26.211700  4985 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:26.252266  5601 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:26.242223  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 4d4dedbb3ee0412db92c974e0c25a776 already in progress
I20260709 12:20:26.266455  5730 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:20:26.272585  5622 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:26.281692  5601 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.288950  5730 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.295867  5780 raft_consensus.cc:1064] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:26.296324  5780 raft_consensus.cc:1068] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:26.298921  4992 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:26.299587  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c970994e11f4080b5624db5219101b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:26.253113  5774 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:20:26.300392  5701 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:26.297848  4985 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.321924  4990 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.329502  4405 raft_consensus.cc:2955] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.324611  4329 raft_consensus.cc:2955] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.334021  4257 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:26.347637  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63088.3us
I20260709 12:20:26.367430  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e2742c399a2d4e5dae60161a45cce316 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:26.369838  4149 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.390053  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c970994e11f4080b5624db5219101b4 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:26.396369  5679 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:20:26.398597  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45600.9us
I20260709 12:20:26.368541  4152 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 4 to 5, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.403139  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:26.403741  4326 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:26.404021  4326 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:26.404765  4326 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:26.405956  4326 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:26.408013  4257 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:26.412391  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:26.412990  4404 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:26.414940  5799 tablet_replica.cc:333] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:26.402990  5679 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:26.423902  5799 raft_consensus.cc:2243] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.424873  5799 raft_consensus.cc:2272] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.428454  5799 ts_tablet_manager.cc:1916] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:26.429389  4404 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:26.441927  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet e2742c399a2d4e5dae60161a45cce316 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:26.445549  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:26.446334  5601 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:26.448614  5601 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:26.449846  5601 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:26.452606  4326 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:26.479823  4152 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 5, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.489566  5801 tablet_replica.cc:333] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:26.496670  5801 raft_consensus.cc:2243] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.497488  5801 raft_consensus.cc:2272] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.502597  5801 ts_tablet_manager.cc:1916] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:26.517071  5799 ts_tablet_manager.cc:1929] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:20:26.517589  5799 log.cc:1199] T 1c970994e11f4080b5624db5219101b4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/1c970994e11f4080b5624db5219101b4
I20260709 12:20:26.519400  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 1c970994e11f4080b5624db5219101b4 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:26.518510  5772 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.539486  4257 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.543465  4404 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.566680  4990 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.573328  5801 ts_tablet_manager.cc:1929] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:20:26.573887  5801 log.cc:1199] T e2742c399a2d4e5dae60161a45cce316 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/e2742c399a2d4e5dae60161a45cce316
I20260709 12:20:26.575686  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet e2742c399a2d4e5dae60161a45cce316 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:26.590665  4151 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.609644  4326 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:26.623937  4990 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:26.625370  5772 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:26.629376  4257 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:26.630962  5772 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:26.634421  5679 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.641531  4985 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.647884  4257 raft_consensus.cc:2955] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.699496  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b22e067af7004ed88fb3125c7ac731ad with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:26.716869  4152 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.747809  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet b22e067af7004ed88fb3125c7ac731ad with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:26.755757  5804 tablet_replica.cc:333] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:26.756935  5804 raft_consensus.cc:2243] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.757803  5804 raft_consensus.cc:2272] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.764345  5804 ts_tablet_manager.cc:1916] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:26.778555  5804 ts_tablet_manager.cc:1929] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:20:26.779251  5804 log.cc:1199] T b22e067af7004ed88fb3125c7ac731ad P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/b22e067af7004ed88fb3125c7ac731ad
I20260709 12:20:26.781698  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet b22e067af7004ed88fb3125c7ac731ad (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:26.836553  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:26.847467  4400 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:26.848989  5622 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:26.888653  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:26.889246  4257 raft_consensus.cc:606] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:26.892374  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:26.892982  4257 raft_consensus.cc:606] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:26.893735  4990 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Advancing to term 5
I20260709 12:20:26.896474  4334 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:26.898030  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:26.898675  4257 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:26.900564  5622 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:26.902711  4990 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:26.906353  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:26.907493  4257 raft_consensus.cc:606] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:26.909648  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:20:26.913713  5622 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:26.914361  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:26.915735  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:26.931818  5622 raft_consensus.cc:1064] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:26.934381  5622 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:26.945160  4400 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:26.945449  4990 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:26.946816  5744 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:26.947626  5622 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:26.951057  4334 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:26.953238  5622 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:26.961905  5744 raft_consensus.cc:993] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:26.962433  5744 raft_consensus.cc:1081] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:26.964557  5601 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.967582  4985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:26.968204  4985 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.968688  4985 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:26.968142  4334 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.967893  4400 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.990053  4152 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 4 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.994498  5810 raft_consensus.cc:993] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:26.995012  5810 raft_consensus.cc:1081] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:26.997203  4326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:26.997766  4326 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:26.998121  4326 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:26.993924  4990 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:26.998832  4985 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:27.002776  4985 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:27.004748  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:27.006418  4329 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:27.011744  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:27.018348  4257 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:27.018431  5810 raft_consensus.cc:993] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:27.021078  4257 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:27.020828  4326 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.021399  5810 raft_consensus.cc:1081] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:27.021963  4257 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:27.022855  4326 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:27.020599  4329 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:27.023671  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:27.024199  4400 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:27.024350  4332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:27.024855  4332 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:27.025177  4332 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.029790  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:27.030371  4249 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:27.030718  4249 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:27.031435  4249 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.031952  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:27.032356  4400 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:27.032514  4249 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:27.032846  5807 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:27.033316  5807 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:27.034155  5807 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:27.040444  4249 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:27.042541  4332 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.043219  4257 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:27.045804  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:27.048090  5679 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:27.047369  4332 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:27.051100  5679 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:27.053085  5679 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.059062  4257 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:27.070158  5810 raft_consensus.cc:993] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:27.070756  5601 raft_consensus.cc:1081] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:27.073513  4400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:27.074028  4400 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:27.074369  4400 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.077090  4149 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 3 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.080238  4400 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.083082  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:27.083401  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:27.083724  4329 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.083959  4257 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:27.084292  4257 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:27.086496  4257 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.088333  4257 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.090763  4329 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:27.090094  4254 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:27.092819  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:27.093751  4249 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:27.093891  4400 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:27.094193  4249 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:27.095173  4257 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:27.095629  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:27.096496  5783 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:27.097014  5783 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:27.097929  5783 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.102375  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:27.102954  4404 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.109565  4149 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.112927  4152 catalog_manager.cc:5697] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.111615  4249 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.116501  4249 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:27.120057  4404 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:27.123062  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:27.124509  5772 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:27.125068  5772 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:27.125754  4249 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:27.126051  5772 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:27.136044  4404 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:20:27.137789  5810 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:27.140168  4985 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:20:27.141670  5810 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:27.151242  5601 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:27.158708  4990 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:27.164434  4405 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:27.167405  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d4dedbb3ee0412db92c974e0c25a776 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:27.175101  4152 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.182955  4151 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 7 to 8, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:27.194200  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d4dedbb3ee0412db92c974e0c25a776 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:27.195991  5816 tablet_replica.cc:333] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:27.197503  5816 raft_consensus.cc:2243] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.198239  5816 raft_consensus.cc:2272] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.201733  5816 ts_tablet_manager.cc:1916] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:27.216300  5816 ts_tablet_manager.cc:1929] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 12:20:27.216657  5816 log.cc:1199] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/4d4dedbb3ee0412db92c974e0c25a776
I20260709 12:20:27.218331  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 4d4dedbb3ee0412db92c974e0c25a776 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:27.436492  4249 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:27.437855  5772 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:27.453290  4405 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:27.456809  5812 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:27.500147  4249 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:27.501487  5694 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:27.513533  4329 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:27.514973  5694 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:27.553850  4249 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.555084  5701 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.567323  4329 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.572081  5783 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:20:27.595188  4405 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.598348  5772 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.615532  4254 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:27.617022  5780 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.815541  4405 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:27.821933  4371 consensus_peers.cc:597] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 393ed0f79d194bc1a6199031055676bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:27.822362  4332 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:27.823550  4254 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:27.823851  5827 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:27.824755  5783 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:27.831681  5826 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.833972  4249 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.843112  4332 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.848320  4254 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:27.852494  4149 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:27.866741  4218 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6aa28105446e4c7c9261f9a99c5dc017. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:27.868108  4332 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:27.869117  4405 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:27.871551  5810 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:27.873256  5601 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:27.890242  5810 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.893296  4405 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.900875  4326 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.913129  4334 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:27.907823  4151 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:27.919507  4254 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:20:27.919589  4296 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d97e8a8c644540508f2457db68e20be8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:27.920907  5780 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:27.922106  4405 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:27.927686  5780 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:27.932051  5812 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.934628  4254 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.941182  4405 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.959738  4151 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:27.962462  4405 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:27.988766  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:27.989880  4326 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:27.992026  5783 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:20:27.995066  4371 consensus_peers.cc:597] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf5e08eda6fd4363b1af431c73621515. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.001538  4254 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:28.003165  5826 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:28.019551  5701 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:28.024435  4326 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:28.044487  4254 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:28.049415  4149 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:28.074039  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:28.074676  4404 raft_consensus.cc:606] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:28.078606  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:28.079218  4326 raft_consensus.cc:606] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:28.082188  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5f00fff96847178a1970711feff2f0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:28.082791  4326 raft_consensus.cc:606] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:28.085289  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:28.086966  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:28.087764  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:28.125910  5827 raft_consensus.cc:993] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:28.126466  5827 raft_consensus.cc:1081] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:28.131842  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:28.132478  4249 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.132893  4249 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.141381  4249 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:28.144793  4249 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:28.150038  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:28.150640  4326 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.151746  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:28.152370  4404 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:28.152715  4404 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:28.153474  4404 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:28.155045  4404 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.158476  4326 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:28.160058  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:28.160844  5810 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:28.161293  5810 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:28.161870  4404 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:28.162110  5810 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:28.175436  4149 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.231456  5772 raft_consensus.cc:993] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:28.232002  5772 raft_consensus.cc:1081] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:28.236049  4405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:28.236609  4405 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.236985  4405 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.244064  5848 ts_tablet_manager.cc:933] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:28.244084  4405 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:28.248997  4405 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:28.250007  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:28.250641  4990 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.251173  5848 tablet_copy_client.cc:323] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:28.252224  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:28.252882  4326 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:28.254177  4326 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:28.256744  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 6aa28105446e4c7c9261f9a99c5dc017 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:28.257285  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 6aa28105446e4c7c9261f9a99c5dc017 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-6aa28105446e4c7c9261f9a99c5dc017
I20260709 12:20:28.265905  4267 tablet_copy_source_session.cc:215] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:28.267509  4326 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:28.268870  4326 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.277048  4326 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:28.270164  5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa28105446e4c7c9261f9a99c5dc017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.278323  5850 ts_tablet_manager.cc:933] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:28.281395  4990 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:28.283388  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:28.284241  5827 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:28.284719  5827 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:28.285557  5827 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:28.296511  5848 tablet_copy_client.cc:806] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:28.297266  5848 tablet_copy_client.cc:670] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:28.302717  5848 tablet_copy_client.cc:538] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:28.307958  5850 tablet_copy_client.cc:323] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:28.310698  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 393ed0f79d194bc1a6199031055676bf from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:28.311211  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 393ed0f79d194bc1a6199031055676bf from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-393ed0f79d194bc1a6199031055676bf
I20260709 12:20:28.314796  4149 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.320461  4419 tablet_copy_source_session.cc:215] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:28.327847  5848 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:28.329718  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393ed0f79d194bc1a6199031055676bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.358776  5848 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:28.359894  5848 tablet_bootstrap.cc:492] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:28.360795  5848 ts_tablet_manager.cc:1403] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.016s
I20260709 12:20:28.365993  5848 raft_consensus.cc:359] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.367005  5848 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:28.367868  5848 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.369860  5850 tablet_copy_client.cc:806] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:28.370466  5848 ts_tablet_manager.cc:1434] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:28.370515  5850 tablet_copy_client.cc:670] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:28.374400  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-6aa28105446e4c7c9261f9a99c5dc017 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:28.374858  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-6aa28105446e4c7c9261f9a99c5dc017 on tablet 6aa28105446e4c7c9261f9a99c5dc017 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:28.378742  5850 tablet_copy_client.cc:538] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:28.387647  5780 raft_consensus.cc:993] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:28.388849  5772 raft_consensus.cc:1081] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:28.391765  4405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be5f00fff96847178a1970711feff2f0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:28.392315  4405 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.392670  4405 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.396543  5850 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:28.399385  4405 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:28.401768  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:28.402381  4249 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.408089  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:28.408679  4326 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:28.408953  4326 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:28.409647  4326 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:28.410683  4326 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.418689  4249 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:28.419816  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:28.420667  5827 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:28.421187  5827 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:28.421999  5827 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:28.423589  4405 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:28.424084  4326 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:28.433923  5850 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:28.434875  5850 tablet_bootstrap.cc:492] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:28.435576  5850 ts_tablet_manager.cc:1403] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.029s
I20260709 12:20:28.438522  5850 raft_consensus.cc:359] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.439399  5850 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:28.440071  5850 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.440059  4149 catalog_manager.cc:5697] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:28.446131  5850 ts_tablet_manager.cc:1434] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:20:28.448076  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-393ed0f79d194bc1a6199031055676bf received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:28.448487  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-393ed0f79d194bc1a6199031055676bf on tablet 393ed0f79d194bc1a6199031055676bf with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:28.506809  5850 ts_tablet_manager.cc:933] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:28.508606  5850 tablet_copy_client.cc:323] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:28.511070  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet bf5e08eda6fd4363b1af431c73621515 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:28.511612  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet bf5e08eda6fd4363b1af431c73621515 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-bf5e08eda6fd4363b1af431c73621515
I20260709 12:20:28.516476  5848 ts_tablet_manager.cc:933] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:28.520133  5848 tablet_copy_client.cc:323] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:28.521232  4419 tablet_copy_source_session.cc:215] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:28.522221  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet d97e8a8c644540508f2457db68e20be8 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:28.522846  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet d97e8a8c644540508f2457db68e20be8 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-d97e8a8c644540508f2457db68e20be8
I20260709 12:20:28.524416  5850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5e08eda6fd4363b1af431c73621515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.530519  4344 tablet_copy_source_session.cc:215] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:28.534440  5848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e8a8c644540508f2457db68e20be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:28.540729  5850 tablet_copy_client.cc:806] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:28.541378  5850 tablet_copy_client.cc:670] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:28.550453  5850 tablet_copy_client.cc:538] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:28.558960  5848 tablet_copy_client.cc:806] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:28.559688  5848 tablet_copy_client.cc:670] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:28.562980  5850 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:28.566538  5848 tablet_copy_client.cc:538] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:28.581784  5848 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:28.596500  5850 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:28.597620  5850 tablet_bootstrap.cc:492] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:28.598397  5850 ts_tablet_manager.cc:1403] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.001s
I20260709 12:20:28.608405  5850 raft_consensus.cc:359] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.609369  5850 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:28.610335  5850 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.613271  5850 ts_tablet_manager.cc:1434] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:20:28.621225  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-bf5e08eda6fd4363b1af431c73621515 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:28.621718  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-bf5e08eda6fd4363b1af431c73621515 on tablet bf5e08eda6fd4363b1af431c73621515 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:28.625352  4326 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.627177  5837 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:28.632133  5848 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:28.633133  5848 tablet_bootstrap.cc:492] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:28.633883  5848 ts_tablet_manager.cc:1403] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.009s
I20260709 12:20:28.637543  5848 raft_consensus.cc:359] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.639505  5848 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:28.640205  5848 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:28.652488  5848 ts_tablet_manager.cc:1434] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:20:28.654605  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-d97e8a8c644540508f2457db68e20be8 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:28.655028  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-d97e8a8c644540508f2457db68e20be8 on tablet d97e8a8c644540508f2457db68e20be8 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:28.671281  4405 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.677273  5810 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:28.687932  4326 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:28.689469  5827 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:20:28.803508  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 83697.6us
I20260709 12:20:28.848096  4985 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:28.851362  4985 raft_consensus.cc:1217] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:28.854036  5701 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:28.859596  4985 raft_consensus.cc:1217] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:20:28.910431  4254 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.912030  5866 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:28.917486  4985 raft_consensus.cc:1217] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:20:28.936785  4329 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:28.938329  5867 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:29.020018  4985 raft_consensus.cc:1217] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:20:29.154352  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.213086  4400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:29.213685  4400 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:29.216295  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:29.216760  4257 raft_consensus.cc:606] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:29.220348  4400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:29.221220  4400 raft_consensus.cc:606] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:29.224496  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:29.227421  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:29.228229  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.235251  5869 raft_consensus.cc:1064] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:29.237866  5869 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.257390  4985 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:29.258658  4400 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:29.259905  5810 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:29.261675  5871 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:29.267076  4329 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:29.271524  5837 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:29.338588  5869 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.348145  5679 raft_consensus.cc:1064] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:29.347244  4329 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.359776  4153 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.361227  5679 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.370718  5866 raft_consensus.cc:1064] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:29.375622  5866 raft_consensus.cc:1068] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:29.376009  4985 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.368140  4400 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.426649  4990 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:29.439095  4257 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:29.440109  4400 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:20:29.441227  5679 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:29.442536  5780 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:29.444384  5772 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:29.451853  4254 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.476920  4985 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:29.480433  5871 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:29.484427  4405 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:29.493044  5871 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:29.496011  5837 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.498850  4985 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.508534  4405 raft_consensus.cc:2955] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.522672  5866 raft_consensus.cc:1064] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:29.525408  5866 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.550781  4151 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.596302  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6aa28105446e4c7c9261f9a99c5dc017 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:29.602317  4326 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:29.604897  5867 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.621300  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 6aa28105446e4c7c9261f9a99c5dc017 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
W20260709 12:20:29.632515  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 62786.4us
I20260709 12:20:29.644008  4990 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:29.655176  5897 tablet_replica.cc:333] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:29.655771  5810 raft_consensus.cc:993] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:29.656399  5810 raft_consensus.cc:1081] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:29.659763  5772 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.661590  4329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:29.662187  4329 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.662550  4329 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.665422  4990 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.673131  4329 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:29.675626  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:29.676162  4257 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.676451  4257 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:29.677116  4257 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:29.678140  4257 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.678351  5891 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.688042  4257 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:29.689667  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:29.690526  5885 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:29.689764  4405 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.690985  5885 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:29.691888  5885 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:29.697791  5894 raft_consensus.cc:993] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:29.698318  5894 raft_consensus.cc:1081] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:29.700178  4254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:29.700685  4254 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.701026  4254 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.704054  5897 raft_consensus.cc:2243] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:29.704862  5897 raft_consensus.cc:2272] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:29.708962  5897 ts_tablet_manager.cc:1916] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:29.717098  4329 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:29.721050  5893 raft_consensus.cc:993] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:29.721576  5893 raft_consensus.cc:1081] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:29.724710  4329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:20:29.725162  4257 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:29.725278  4329 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:29.726665  4329 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.730836  4151 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.734138  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:29.734851  4400 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.737337  5894 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.740540  4254 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:29.742419  4257 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.755569  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:29.756222  4326 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.760598  4400 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:29.763123  4329 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.764045  4326 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:29.769984  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:29.770619  4329 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:29.773528  4990 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.772332  4254 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:29.783980  4990 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:29.784220  4219 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:29.785034  5837 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:29.785256  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:29.785535  5837 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:29.786381  5885 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:29.786994  5885 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:29.787809  5885 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.786417  5837 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:29.793699  5897 ts_tablet_manager.cc:1929] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:29.794710  5897 log.cc:1199] T 6aa28105446e4c7c9261f9a99c5dc017 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/6aa28105446e4c7c9261f9a99c5dc017
I20260709 12:20:29.797472  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 6aa28105446e4c7c9261f9a99c5dc017 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:29.806764  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:29.807427  4401 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.807768  4401 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:29.808631  4401 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:29.809975  4401 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.814332  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:29.813319  5866 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.814880  4404 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:29.815204  4404 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:29.815891  4404 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.817073  4404 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:29.817400  4401 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:29.828457  4985 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.846736  4329 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.850224  4149 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.863282  4151 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.872318  4153 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.872524  4254 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.886974  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:29.887580  4257 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:29.889319  4404 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:29.903399  4404 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.904628  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:29.909305  4329 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:29.909570  4990 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:29.909441  4254 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:29.910666  5894 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:29.913036  5893 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:29.913087  4152 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.923586  5894 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.927721  4985 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.931576  4329 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:29.931921  4334 raft_consensus.cc:2955] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.937888  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf5e08eda6fd4363b1af431c73621515 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:29.938591  4249 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:29.941190  5885 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.944214  4989 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:29.949177  4152 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 5 to 6, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.952003  5780 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.954998  4249 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.959959  5772 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:29.960976  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:29.962052  4254 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:29.977691  4989 raft_consensus.cc:2955] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:29.981400  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet bf5e08eda6fd4363b1af431c73621515 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:29.989060  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d97e8a8c644540508f2457db68e20be8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:29.990127  4201 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:29.990664  4201 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 393ed0f79d194bc1a6199031055676bf already in progress
W20260709 12:20:29.991199  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 393ed0f79d194bc1a6199031055676bf already in progress
I20260709 12:20:29.995549  5904 tablet_replica.cc:333] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:29.997794  5904 raft_consensus.cc:2243] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:29.998826  5904 raft_consensus.cc:2272] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:30.004824  5904 ts_tablet_manager.cc:1916] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:30.016813  4151 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 4 to 5, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 2 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:30.026499  5904 ts_tablet_manager.cc:1929] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:20:30.027046  5904 log.cc:1199] T bf5e08eda6fd4363b1af431c73621515 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/bf5e08eda6fd4363b1af431c73621515
I20260709 12:20:30.029193  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet bf5e08eda6fd4363b1af431c73621515 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:30.033200  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet d97e8a8c644540508f2457db68e20be8 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:30.036185  5905 tablet_replica.cc:333] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:30.037354  5905 raft_consensus.cc:2243] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:30.038267  5905 raft_consensus.cc:2272] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:30.041065  5905 ts_tablet_manager.cc:1916] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:30.056452  5905 ts_tablet_manager.cc:1929] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:20:30.056811  5905 log.cc:1199] T d97e8a8c644540508f2457db68e20be8 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/d97e8a8c644540508f2457db68e20be8
I20260709 12:20:30.058377  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet d97e8a8c644540508f2457db68e20be8 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:30.156225  4254 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:30.157567  5679 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:30.167220  4400 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:30.168689  5679 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:30.188436  4989 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Advancing to term 3
I20260709 12:20:30.195484  4989 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:30.196825  5837 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:30.205253  5871 raft_consensus.cc:1064] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:30.205695  5871 raft_consensus.cc:1068] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:30.207362  4404 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:30.208561  5780 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:30.223079  4989 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:30.227540  5885 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:30.270905  4326 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:30.272446  5871 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:30.278440  5896 raft_consensus.cc:993] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:30.279054  5892 raft_consensus.cc:1081] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:30.281004  4334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:20:30.281476  4334 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.281803  4334 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:30.283408  4404 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:30.284861  5837 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:30.291589  4334 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:30.292927  4326 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:30.301844  4334 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:30.301774  5837 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:30.305121  5869 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:30.305549  5869 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:30.306443  5869 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:30.307766  5869 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:30.308782  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.313545  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:30.321872  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:30.337906  4249 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:30.341509  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:30.342383  5885 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:30.342922  5885 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:30.343921  5885 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:30.357612  4152 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.369721  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:30.370333  4249 raft_consensus.cc:606] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:30.373315  4334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:30.373901  4334 raft_consensus.cc:606] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:30.376214  4334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:30.376721  4334 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:30.377671  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:30.378816  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:30.379496  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.427268  5679 raft_consensus.cc:993] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:30.427888  5885 raft_consensus.cc:1081] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:30.429437  4400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:20:30.429987  4400 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.430359  4400 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:30.437652  4400 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:30.439635  4400 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:30.440500  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:30.440300  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:30.441244  4334 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:30.441337  4249 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:30.441570  4334 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:30.442339  4334 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:30.443380  4334 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:30.446868  4249 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:30.448416  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:30.448912  4334 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:30.449105  5867 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:30.449682  5867 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:30.450790  5867 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:30.460938  4152 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 3 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.468859  5885 raft_consensus.cc:993] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:30.469611  5885 raft_consensus.cc:1081] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:30.471119  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41692
I20260709 12:20:30.471748  4249 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.472147  4249 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.478828  4249 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:30.481053  4249 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:30.481725  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:30.482086  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:30.482372  4334 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.482627  4400 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.482710  4334 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:30.483637  4334 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:30.484757  4334 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.490782  4400 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:30.491183  4334 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:30.492159  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:30.492925  5869 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.493451  5869 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:30.494278  5869 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:30.505915  4152 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.712992  5871 raft_consensus.cc:993] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:30.713541  5869 raft_consensus.cc:1081] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:30.715523  4985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52880
I20260709 12:20:30.716092  4985 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:30.716460  4985 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.721738  4985 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:30.723197  4985 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:30.723932  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:30.724092  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:30.724551  4249 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:30.724633  4326 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.724871  4249 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:30.725564  4249 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:30.726426  4249 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:30.731447  4326 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:30.732604  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:30.733348  5694 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:30.733775  5694 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:30.734754  5694 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:30.742959  4985 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Advancing to term 4
I20260709 12:20:30.746382  4249 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:30.749742  4985 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:30.751204  5885 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:30.756578  5679 raft_consensus.cc:1064] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:30.757026  5679 raft_consensus.cc:1068] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:30.759008  4152 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 2 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.770763  4400 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:30.777581  4400 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:30.778852  5772 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:30.802476  4254 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:30.804173  5923 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:30.808841  5679 raft_consensus.cc:1064] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:30.811429  5679 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:30.822860  4985 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:30.822965  4404 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:30.826784  5885 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:30.828088  5679 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:30.830124  4249 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:30.841512  5772 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:30.845472  5885 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:30.858137  4329 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:30.857215  4985 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:30.866484  5867 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:30.872115  4249 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:30.877332  4401 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:30.898736  4151 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.905933  4249 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:30.908756  5894 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:30.922720  4326 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:30.941043  4985 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:30.944752  5885 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:30.946864  4326 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.960860  5871 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:30.959796  5679 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:30.984885  4404 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:30.987232  5869 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:30.989054  4985 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:31.020182  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 118810us
I20260709 12:20:31.024114  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 393ed0f79d194bc1a6199031055676bf with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:31.113095  4400 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:31.117301  5780 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:31.117158  4153 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 6 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:31.125085  4401 raft_consensus.cc:2955] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:31.133992  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 393ed0f79d194bc1a6199031055676bf with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:31.135780  4326 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.138094  5845 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:31.147970  5932 tablet_replica.cc:333] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:31.149225  5932 raft_consensus.cc:2243] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:31.150183  5932 raft_consensus.cc:2272] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:31.153766  5932 ts_tablet_manager.cc:1916] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:31.173694  4254 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:31.175453  5920 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:31.185639  5932 ts_tablet_manager.cc:1929] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:20:31.186285  5932 log.cc:1199] T 393ed0f79d194bc1a6199031055676bf P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/393ed0f79d194bc1a6199031055676bf
I20260709 12:20:31.194005  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 393ed0f79d194bc1a6199031055676bf (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:31.228629  4329 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:31.235224  4401 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.235461  4254 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:31.235702  4296 consensus_peers.cc:597] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90175b58ea034e69b889717ca0ad0333. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.236591  5885 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.237501  5679 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.245465  5679 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.247097  4254 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.255061  4401 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.262012  4254 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:31.270218  4152 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.290311  4326 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.291621  4400 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.292035  5837 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:31.293501  4218 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2c18c2d1c094cb9a849a72508c8962f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.296033  5837 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.316468  5837 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.318058  4400 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.317939  4329 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.334606  4152 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.345328  4249 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:31.371006  4329 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:31.373695  4218 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bac26358ed7f4644aa3f5b040afcdca4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.374027  5837 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:31.376087  4400 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:31.379386  5871 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:31.392311  5871 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.393396  4329 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.397411  4400 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.414837  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:31.414747  4152 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.418928  4400 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:31.427170  4371 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c18183fd904d43f68b0e600ddb8ae249. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:31.431972  4249 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:31.427084  4326 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:31.433772  5927 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:31.435108  5867 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:31.450304  5894 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.456389  4326 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.457537  4257 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:31.478267  4151 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 5, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:31.523768  4329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:31.524703  4329 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:31.529137  4401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:31.529733  4401 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:31.533934  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:31.535620  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:31.536394  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:31.756827  5946 ts_tablet_manager.cc:933] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:31.763532  5946 tablet_copy_client.cc:323] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:31.766554  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet a2c18c2d1c094cb9a849a72508c8962f from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:31.767192  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet a2c18c2d1c094cb9a849a72508c8962f from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-a2c18c2d1c094cb9a849a72508c8962f
I20260709 12:20:31.775493  4267 tablet_copy_source_session.cc:215] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:31.779146  5946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c18c2d1c094cb9a849a72508c8962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:31.794651  5946 tablet_copy_client.cc:806] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:31.795630  5946 tablet_copy_client.cc:670] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:31.800243  5946 tablet_copy_client.cc:538] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:31.812402  5948 ts_tablet_manager.cc:933] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:31.814723  5946 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:31.883075  5928 raft_consensus.cc:993] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:31.883919  5928 raft_consensus.cc:1081] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:31.886039  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:31.886749  4249 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.887197  4249 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:31.933142  5948 tablet_copy_client.cc:323] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:31.935808  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 90175b58ea034e69b889717ca0ad0333 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:31.936388  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 90175b58ea034e69b889717ca0ad0333 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-90175b58ea034e69b889717ca0ad0333
I20260709 12:20:31.938397  5772 raft_consensus.cc:993] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:31.938869  5772 raft_consensus.cc:1081] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:31.943873  4985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52862
I20260709 12:20:31.944449  4985 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.944804  4985 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:31.952057  4985 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:31.956321  4985 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:31.931106  4249 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:31.958746  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:31.959821  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:31.960724  4257 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:31.961903  4249 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:31.964605  4332 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:31.966801  4332 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:31.967948  4332 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:31.969275  4332 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:31.979456  4344 tablet_copy_source_session.cc:215] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:31.987215  4257 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:31.983530  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:31.988184  4401 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:31.988971  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:31.988705  4401 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:31.990940  5920 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:31.991956  5920 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:31.992367  4401 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:31.993108  5920 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:31.994972  4401 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:32.000928  5948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90175b58ea034e69b889717ca0ad0333. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:32.008440  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 77070.9us
I20260709 12:20:32.017411  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:32.018400  4329 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:32.026718  4329 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:32.036046  4332 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:32.063863  4219 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:32.064720  5951 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:32.065279  5951 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:32.066414  5951 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.072544  5954 ts_tablet_manager.cc:933] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:20:32.083062  4152 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 5, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.095978  5954 tablet_copy_client.cc:323] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:32.097734  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet bac26358ed7f4644aa3f5b040afcdca4 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:32.098466  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet bac26358ed7f4644aa3f5b040afcdca4 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-bac26358ed7f4644aa3f5b040afcdca4
I20260709 12:20:32.112389  4267 tablet_copy_source_session.cc:215] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:32.134037  4401 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:32.135028  5946 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:32.136077  4151 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 4 to 5, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 5 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.136134  5946 tablet_bootstrap.cc:492] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:32.139928  5946 ts_tablet_manager.cc:1403] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.326s	user 0.117s	sys 0.133s
I20260709 12:20:32.143366  5946 raft_consensus.cc:359] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.144958  5946 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:32.145852  5946 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.153271  5954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac26358ed7f4644aa3f5b040afcdca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:32.153004  5946 ts_tablet_manager.cc:1434] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:20:32.158190  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-a2c18c2d1c094cb9a849a72508c8962f received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:32.158617  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-a2c18c2d1c094cb9a849a72508c8962f on tablet a2c18c2d1c094cb9a849a72508c8962f with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:32.161561  5948 tablet_copy_client.cc:806] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:32.162448  5948 tablet_copy_client.cc:670] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:32.171944  5948 tablet_copy_client.cc:538] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:32.184827  5948 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:32.185425  5954 tablet_copy_client.cc:806] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:32.186051  5954 tablet_copy_client.cc:670] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:32.269641  4985 raft_consensus.cc:1217] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:32.272653  5948 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:32.274196  5948 tablet_bootstrap.cc:492] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:32.276743  5948 ts_tablet_manager.cc:1403] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.092s	user 0.029s	sys 0.004s
I20260709 12:20:32.265260  5954 tablet_copy_client.cc:538] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:32.287444  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:32.288573  4254 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Received request to transfer leadership
I20260709 12:20:32.296732  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:32.297420  4257 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Received request to transfer leadership
W20260709 12:20:32.299573  4137 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c18183fd904d43f68b0e600ddb8ae249 already in progress [suppressed 1 similar messages]
I20260709 12:20:32.304191  5948 raft_consensus.cc:359] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.313439  4257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:32.313591  5948 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:32.314227  4257 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Received request to transfer leadership
I20260709 12:20:32.319087  5948 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:32.320307  4201 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:20:32.320811  4201 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c18183fd904d43f68b0e600ddb8ae249 already in progress
W20260709 12:20:32.321132  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c18183fd904d43f68b0e600ddb8ae249 already in progress
I20260709 12:20:32.336587  5948 ts_tablet_manager.cc:1434] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.008s
I20260709 12:20:32.342198  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-90175b58ea034e69b889717ca0ad0333 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:32.343026  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-90175b58ea034e69b889717ca0ad0333 on tablet 90175b58ea034e69b889717ca0ad0333 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:32.361457  4985 raft_consensus.cc:1217] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:32.402573  5954 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:32.407140  4257 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:20:32.411506  5694 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:20:32.460031  5954 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:32.461151  5954 tablet_bootstrap.cc:492] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:32.508515  5954 ts_tablet_manager.cc:1403] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.116s	user 0.024s	sys 0.009s
I20260709 12:20:32.512377  4329 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:20:32.514151  5945 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:32.510299  4405 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:32.524897  5954 raft_consensus.cc:359] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.526393  5954 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:32.527192  5954 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.535286  5954 ts_tablet_manager.cc:1434] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:20:32.538465  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-bac26358ed7f4644aa3f5b040afcdca4 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:32.538991  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-bac26358ed7f4644aa3f5b040afcdca4 on tablet bac26358ed7f4644aa3f5b040afcdca4 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:32.524982  5837 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:20:32.583642  5869 raft_consensus.cc:993] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:32.584285  5869 raft_consensus.cc:1081] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:32.590453  4329 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:20:32.598954  5869 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:32.599871  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:32.611246  4218 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c18183fd904d43f68b0e600ddb8ae249. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:32.621428  4400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:32.640575  4400 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:32.641058  4400 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.665570  5871 raft_consensus.cc:1064] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:32.672363  5871 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:32.657074  4400 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.687028  4985 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.690659  5837 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.691138  4400 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:32.691222  4329 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.699095  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:32.699738  4334 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.701159  5951 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.719164  4405 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.720217  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:32.720857  4249 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:32.721151  4249 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:32.721948  4249 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.723652  4249 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:32.735622  5837 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.742340  4249 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:20:32.745605  4329 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.752754  5679 raft_consensus.cc:1064] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:32.756032  5679 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:32.757189  4985 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.766558  4151 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.772480  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:32.773159  4249 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:32.774369  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:32.776134  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:32.777554  4334 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:20:32.778963  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:32.779099  5837 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.779976  5894 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:32.780496  5894 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:32.780908  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:32.781421  5894 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:32.797857  4149 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 5 to 6, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:32.801540  4254 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.801690  4985 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.803972  5885 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.806550  5950 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:32.808645  4400 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.829592  5950 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.841109  4985 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.847435  4404 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:32.853714  4249 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.876112  5885 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:32.890612  4152 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:32.900534  4404 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:32.954558  4990 raft_consensus.cc:1217] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:33.055238  5869 raft_consensus.cc:993] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:33.055737  5869 raft_consensus.cc:1081] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:33.057644  4404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:33.058192  4404 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.058485  4404 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.066511  4404 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:33.068635  4404 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:33.074993  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:33.076287  4254 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:33.076640  4254 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:33.077504  4254 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:33.078827  4254 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.083490  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:33.084192  4334 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:33.099861  4334 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:33.101235  4372 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:33.102396  5867 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:33.102875  5867 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:33.103981  5867 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:33.105155  4254 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:33.116832  4151 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.220048  4254 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:33.225446  4985 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.226294  4404 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.226819  5837 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.227679  5871 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.235026  5837 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.239099  4404 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:33.243158  4371 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c18183fd904d43f68b0e600ddb8ae249. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.252648  4990 raft_consensus.cc:2955] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.259522  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2c18c2d1c094cb9a849a72508c8962f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.262351  4151 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.273960  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet a2c18c2d1c094cb9a849a72508c8962f with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:33.278244  5987 tablet_replica.cc:333] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:20:33.279716  5987 raft_consensus.cc:2243] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.280454  5987 raft_consensus.cc:2272] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.284446  5987 ts_tablet_manager.cc:1916] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.303428  4254 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:33.303659  5987 ts_tablet_manager.cc:1929] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.304298  5987 log.cc:1199] T a2c18c2d1c094cb9a849a72508c8962f P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/a2c18c2d1c094cb9a849a72508c8962f
I20260709 12:20:33.304817  5867 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:33.306211  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet a2c18c2d1c094cb9a849a72508c8962f (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:33.333818  4334 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:20:33.336555  5928 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:33.347817  5869 raft_consensus.cc:1064] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:33.350378  5869 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:33.367733  4985 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.368302  4404 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.370745  4334 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:33.372872  5871 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.373975  5951 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.376814  5869 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:33.402956  5951 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.404811  4400 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.431756  4152 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.441450  4332 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:33.452380  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52054.8us
I20260709 12:20:33.463130  4334 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:33.491940  4329 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.493673  5867 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:33.488801  4990 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.504298  4249 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:33.514288  4985 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:20:33.514941  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 56296us
I20260709 12:20:33.524613  4400 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.531378  5994 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.533212  4985 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.537678  5951 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.547345  5885 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.550207  4332 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:33.556811  5996 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:33.559327  4138 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90175b58ea034e69b889717ca0ad0333 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.560971  4404 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.562875  4990 raft_consensus.cc:2955] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.564952  5837 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:33.568171  5837 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.581084  4153 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:33.589507  4990 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.590299  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bac26358ed7f4644aa3f5b040afcdca4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:33.590334  4331 raft_consensus.cc:2955] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:33.600167  4151 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 3 to 4, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 1 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.614842  4254 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:33.616432  5894 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:33.623016  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 90175b58ea034e69b889717ca0ad0333 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:33.646903  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet bac26358ed7f4644aa3f5b040afcdca4 with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:33.669021  6001 ts_tablet_manager.cc:933] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:33.676808  6000 tablet_replica.cc:333] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:20:33.678225  5998 tablet_replica.cc:333] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:33.690699  5998 raft_consensus.cc:2243] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.692510  6001 tablet_copy_client.cc:323] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:33.692905  5998 raft_consensus.cc:2272] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.694021  6000 raft_consensus.cc:2243] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.694893  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet c18183fd904d43f68b0e600ddb8ae249 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:33.695029  6000 raft_consensus.cc:2272] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.695554  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet c18183fd904d43f68b0e600ddb8ae249 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-c18183fd904d43f68b0e600ddb8ae249
I20260709 12:20:33.698514  5998 ts_tablet_manager.cc:1916] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.699079  6000 ts_tablet_manager.cc:1916] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:33.708930  4419 tablet_copy_source_session.cc:215] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:33.715068  5998 ts_tablet_manager.cc:1929] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.715683  5998 log.cc:1199] T 90175b58ea034e69b889717ca0ad0333 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/90175b58ea034e69b889717ca0ad0333
I20260709 12:20:33.716750  6001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18183fd904d43f68b0e600ddb8ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:33.717609  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 90175b58ea034e69b889717ca0ad0333 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:33.728991  6000 ts_tablet_manager.cc:1929] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:33.729517  6000 log.cc:1199] T bac26358ed7f4644aa3f5b040afcdca4 P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/bac26358ed7f4644aa3f5b040afcdca4
I20260709 12:20:33.731197  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet bac26358ed7f4644aa3f5b040afcdca4 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:33.732911  6001 tablet_copy_client.cc:806] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:33.733455  6001 tablet_copy_client.cc:670] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:33.737154  6001 tablet_copy_client.cc:538] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:33.745083  6001 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:33.770354  6001 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:33.771323  6001 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:33.772037  6001 ts_tablet_manager.cc:1403] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.003s
I20260709 12:20:33.774894  6001 raft_consensus.cc:359] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:33.775718  6001 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:33.776350  6001 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:33.779023  6001 ts_tablet_manager.cc:1434] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:33.783735  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-c18183fd904d43f68b0e600ddb8ae249 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:33.784154  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-c18183fd904d43f68b0e600ddb8ae249 on tablet c18183fd904d43f68b0e600ddb8ae249 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:33.955902  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.006659  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:34.007186  4405 raft_consensus.cc:606] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:34.010084  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:34.010663  4405 raft_consensus.cc:606] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:34.012064  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:34.013782  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:34.014498  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.063620  5894 raft_consensus.cc:993] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:34.064194  5962 raft_consensus.cc:1081] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:34.066030  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:34.066547  4249 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.066844  4249 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.073434  4249 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:34.075099  4249 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:34.075942  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:34.076172  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:34.076560  4329 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.076674  4405 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:34.077026  4405 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:34.077864  4405 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:34.079043  4405 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:34.083818  4329 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:34.085242  4219 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:34.086040  5837 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:34.086171  4405 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:34.086548  5837 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:34.087428  5837 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:34.095927  4152 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.210914  4990 raft_consensus.cc:1217] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:20:34.450938  5867 raft_consensus.cc:993] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:34.451395  6006 raft_consensus.cc:1081] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:20:34.452728  4254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:20:34.453123  4254 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:34.453356  4254 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.458539  4254 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:34.459928  4254 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:34.460798  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:34.460901  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:34.461309  4332 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.461477  4404 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:34.461867  4404 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:34.462603  4404 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:34.463845  4404 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:34.466624  4332 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:34.467585  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:34.468297  5837 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:34.468732  5837 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:34.468786  4404 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:34.469498  5837 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:34.479355  4152 catalog_manager.cc:5697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.512672  4405 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:34.513902  6005 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.523645  4332 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:34.524852  6005 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.752511  4254 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:34.763108  4331 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:20:34.763793  4218 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd41dc8658414bcfb8662c0efe3caffc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.763909  4404 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.764851  5837 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.765691  6005 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:34.775025  5837 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.776780  4331 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.777783  4404 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.789465  4405 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:34.793802  4153 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
W20260709 12:20:34.806164  4371 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78ee025f73f248629704f4ff6eaad5a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.806344  4254 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:34.807853  5867 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:34.811488  4332 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:20:34.813702  5867 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:34.824767  5867 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.832481  4332 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.843113  4405 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:34.846952  6006 raft_consensus.cc:1064] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:34.850230  4149 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.855494  4254 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.850920  6006 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:34.872323  4332 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:20:34.872812  4371 consensus_peers.cc:597] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8afcac1f47834987ac3889edd37f61a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.874295  6021 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.881212  4990 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:34.883697  4249 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:34.887015  6023 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:34.887406  4331 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:34.880460  4254 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:20:34.888125  6022 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:34.890653  6023 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:34.891996  6022 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:34.896485  6021 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.905674  4332 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:34.911335  4405 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:34.912875  6005 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:34.916599  4329 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:20:34.930852  4296 consensus_peers.cc:597] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4079a3fa5d6b4cafa2f9b17573d0e1b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:34.932910  4404 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.933275  4149 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.934237  4257 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:34.934566  5994 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:34.941715  5996 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:35.053387  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:35.113703  4332 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:20:35.121147  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 172810us
I20260709 12:20:35.134498  6021 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.152151  5837 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:35.156662  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 59610.6us
I20260709 12:20:35.159278  4249 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:35.157716  4252 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.184757  4329 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.206720  4990 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 5 to 8, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.227126  4153 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 5 to 8, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.250573  4252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:20:35.251499  4252 raft_consensus.cc:606] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:35.278466  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:35.280397  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:35.282732  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:35.284525  6047 ts_tablet_manager.cc:933] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:35.292709  6046 ts_tablet_manager.cc:933] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
W20260709 12:20:35.298265  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 97055.6us
I20260709 12:20:35.300045  4405 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:35.321229  4334 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:20:35.321930  4985 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:20:35.323009  6022 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:20:35.325253  6023 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:35.331712  5994 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:35.357709  6006 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Committing config change with OpId 6.9: config changed from index 8 to 9, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.377837  4985 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Committing config change with OpId 6.9: config changed from index 8 to 9, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.387696  4334 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Committing config change with OpId 6.9: config changed from index 8 to 9, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:35.391863  6046 tablet_copy_client.cc:323] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
I20260709 12:20:35.392819  6047 tablet_copy_client.cc:323] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:35.395421  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 78ee025f73f248629704f4ff6eaad5a0 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:35.395926  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 78ee025f73f248629704f4ff6eaad5a0 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-78ee025f73f248629704f4ff6eaad5a0
I20260709 12:20:35.400079  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c18183fd904d43f68b0e600ddb8ae249 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:35.403226  4419 tablet_copy_source_session.cc:215] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.399281  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet fd41dc8658414bcfb8662c0efe3caffc from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:20:35.404165  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet fd41dc8658414bcfb8662c0efe3caffc from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-fd41dc8658414bcfb8662c0efe3caffc
W20260709 12:20:35.412732  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 84981.3us
I20260709 12:20:35.421553  4267 tablet_copy_source_session.cc:215] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.423362  6047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ee025f73f248629704f4ff6eaad5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.444404  4407 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:35.447212  6046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd41dc8658414bcfb8662c0efe3caffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.429198  4149 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 8 to 9, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.484280  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet c18183fd904d43f68b0e600ddb8ae249 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:35.490736  6055 ts_tablet_manager.cc:933] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:35.500171  6040 raft_consensus.cc:993] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:20:35.500769  6040 raft_consensus.cc:1081] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
W20260709 12:20:35.504413  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 55328.1us
I20260709 12:20:35.503778  4153 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:35.506464  6056 ts_tablet_manager.cc:933] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:35.507786  4407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60144
I20260709 12:20:35.517313  4407 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.519187  4407 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.561749  6057 tablet_replica.cc:333] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:20:35.564275  6057 raft_consensus.cc:2243] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:35.565063  6057 raft_consensus.cc:2272] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:35.568995  4407 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:35.570941  4253 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:20:35.571080  4407 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:35.585431  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:35.590850  4254 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:35.591180  4254 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:20:35.591566  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 69145.1us
I20260709 12:20:35.592036  4254 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:35.593497  4254 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.602063  4254 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:35.603359  6055 tablet_copy_client.cc:323] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.130:42725
I20260709 12:20:35.582864  6057 ts_tablet_manager.cc:1916] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:35.605588  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:35.605691  4344 tablet_copy_service.cc:140] P b3efae3bdfff46bb9bbff1ed1ea70a90: Received BeginTabletCopySession request for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:40644)
I20260709 12:20:35.606297  4344 tablet_copy_service.cc:161] P b3efae3bdfff46bb9bbff1ed1ea70a90: Beginning new tablet copy session on tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:40644: session id = 0952d204644f41a88e5e463e697dcc27-4079a3fa5d6b4cafa2f9b17573d0e1b0
I20260709 12:20:35.608600  6006 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:35.609180  6006 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:35.610126  6006 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:35.620678  6046 tablet_copy_client.cc:806] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.621376  6046 tablet_copy_client.cc:670] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.626660  6047 tablet_copy_client.cc:806] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.627871  6047 tablet_copy_client.cc:670] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.633980  6047 tablet_copy_client.cc:538] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.641258  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:35.641927  4989 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:35.646245  6046 tablet_copy_client.cc:538] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.659430  6057 ts_tablet_manager.cc:1929] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.8
I20260709 12:20:35.659929  6057 log.cc:1199] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/c18183fd904d43f68b0e600ddb8ae249
I20260709 12:20:35.661877  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet c18183fd904d43f68b0e600ddb8ae249 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:35.673451  4989 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:35.676930  6046 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:35.728128  4344 tablet_copy_source_session.cc:215] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:35.737903  6055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.774869  6056 tablet_copy_client.cc:323] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.131:36481
I20260709 12:20:35.776988  4419 tablet_copy_service.cc:140] P 899897e6794541b5ab538af361fc9e6c: Received BeginTabletCopySession request for tablet 8afcac1f47834987ac3889edd37f61a3 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:35534)
I20260709 12:20:35.777470  4419 tablet_copy_service.cc:161] P 899897e6794541b5ab538af361fc9e6c: Beginning new tablet copy session on tablet 8afcac1f47834987ac3889edd37f61a3 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:35534: session id = 0952d204644f41a88e5e463e697dcc27-8afcac1f47834987ac3889edd37f61a3
I20260709 12:20:35.790416  4419 tablet_copy_source_session.cc:215] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:20:35.792228  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 73922.1us
I20260709 12:20:35.804946  6047 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:35.805744  6056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcac1f47834987ac3889edd37f61a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:35.809365  4151 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.832633  6055 tablet_copy_client.cc:806] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.839851  6055 tablet_copy_client.cc:670] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.846042  6055 tablet_copy_client.cc:538] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.882756  6055 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:35.914323  6047 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:35.920571  6056 tablet_copy_client.cc:806] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:35.921351  6056 tablet_copy_client.cc:670] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:35.928211  6047 tablet_bootstrap.cc:492] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:35.929050  6047 ts_tablet_manager.cc:1403] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.019s
I20260709 12:20:35.934278  6056 tablet_copy_client.cc:538] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:35.935422  6047 raft_consensus.cc:359] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:35.939755  6047 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:35.940478  6047 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:35.942314  6047 ts_tablet_manager.cc:1434] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:20:35.963168  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-78ee025f73f248629704f4ff6eaad5a0 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:35.973495  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-78ee025f73f248629704f4ff6eaad5a0 on tablet 78ee025f73f248629704f4ff6eaad5a0 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:35.999482  6046 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:36.000551  6046 tablet_bootstrap.cc:492] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:36.001302  6046 ts_tablet_manager.cc:1403] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.325s	user 0.031s	sys 0.000s
I20260709 12:20:36.004307  6046 raft_consensus.cc:359] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:36.005292  6046 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:36.005995  6046 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:36.008236  6046 ts_tablet_manager.cc:1434] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:36.013053  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-fd41dc8658414bcfb8662c0efe3caffc received from {username='slave'} at 127.0.0.1:57876
I20260709 12:20:36.013470  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-fd41dc8658414bcfb8662c0efe3caffc on tablet fd41dc8658414bcfb8662c0efe3caffc with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:36.014649  6056 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:20:36.017669  4254 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:36.066856  6056 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:36.067821  6056 tablet_bootstrap.cc:492] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:36.068470  6056 ts_tablet_manager.cc:1403] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.002s
I20260709 12:20:36.075690  6006 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:36.084352  6056 raft_consensus.cc:359] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:36.085472  6056 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:36.086119  6056 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:36.095815  6056 ts_tablet_manager.cc:1434] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:20:36.097962  6055 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:36.098878  6055 tablet_bootstrap.cc:492] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:20:36.099701  6055 ts_tablet_manager.cc:1403] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 0.217s	user 0.027s	sys 0.029s
I20260709 12:20:36.101632  4419 tablet_copy_service.cc:342] P 899897e6794541b5ab538af361fc9e6c: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-8afcac1f47834987ac3889edd37f61a3 received from {username='slave'} at 127.0.0.1:35534
I20260709 12:20:36.102056  4419 tablet_copy_service.cc:434] P 899897e6794541b5ab538af361fc9e6c: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-8afcac1f47834987ac3889edd37f61a3 on tablet 8afcac1f47834987ac3889edd37f61a3 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:36.102613  6055 raft_consensus.cc:359] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:36.103693  6055 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:20:36.104341  6055 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:36.107272  6055 ts_tablet_manager.cc:1434] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:36.108879  4344 tablet_copy_service.cc:342] P b3efae3bdfff46bb9bbff1ed1ea70a90: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-4079a3fa5d6b4cafa2f9b17573d0e1b0 received from {username='slave'} at 127.0.0.1:40644
I20260709 12:20:36.109300  4344 tablet_copy_service.cc:434] P b3efae3bdfff46bb9bbff1ed1ea70a90: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-4079a3fa5d6b4cafa2f9b17573d0e1b0 on tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:36.120033  4985 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:36.132402  6023 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:36.211722  4985 raft_consensus.cc:1217] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:20:36.328966  4985 raft_consensus.cc:1217] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:20:36.387269  4985 raft_consensus.cc:1217] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:20:36.447548  4985 raft_consensus.cc:1217] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:20:36.625633  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.685212  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:36.685736  4407 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:36.687042  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:36.688809  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:36.689576  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.836831  6038 raft_consensus.cc:1064] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:36.840087  6038 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:36.848683  4329 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:36.848796  4407 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:36.850703  6040 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.851392  4985 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:36.852072  6038 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.854915  6038 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:36.926829  6060 raft_consensus.cc:1064] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:36.927619  5837 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:36.929855  6060 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:36.933809  6022 raft_consensus.cc:1064] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:36.934325  6022 raft_consensus.cc:1068] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Service unavailable: leader transfer in progress
I20260709 12:20:36.972182  4989 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:36.978348  6079 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:36.980319  4407 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:37.024140  4332 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:37.033360  4407 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:20:37.038904  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48281us
I20260709 12:20:37.043942  4153 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:37.043445  4989 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:37.080000  6022 raft_consensus.cc:1064] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:20:37.082839  6022 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:37.090646  6006 raft_consensus.cc:993] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:37.091274  6023 raft_consensus.cc:1081] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:37.112731  4332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:20:37.113329  4332 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:37.113687  4332 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.124531  4332 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:37.125617  4334 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:37.126135  4332 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:37.131512  4254 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:37.149850  6060 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:37.140677  6022 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:20:37.155640  6060 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:37.161162  4249 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:37.161290  4985 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 LEARNER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:20:37.168442  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:37.169029  4407 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:37.169312  4407 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:37.170077  4407 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:37.175235  4407 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.176432  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:37.176962  4254 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:37.191996  6022 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:20:37.199075  4254 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:37.211272  4407 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:37.214123  6094 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:20:37.774323  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:38.818326  4153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 385) took 1801 ms. Trace:
W20260709 12:20:38.928755  4184 debug-util.cc:398] Leaking SignalData structure 0x7b080003c040 after lost signal to thread 3105
I20260709 12:20:38.825004  4153 rpcz_store.cc:276] 0709 12:20:37.017142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.017307 (+   165us) service_pool.cc:224] Handling call
0709 12:20:38.818219 (+1800912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:37.099445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:37.099992 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:37.100024 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:20:37.100041 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:37.100364 (+   323us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:37.100438 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:37.100469 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:37.100649 (+   180us) tablet.cc:701] Row locks acquired
0709 12:20:37.100667 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:37.100832 (+   165us) write_op.cc:270] Start()
0709 12:20:37.100966 (+   134us) write_op.cc:276] Timestamp: P: 1783599637100782 usec, L: 0
0709 12:20:37.100998 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:20:37.101828 (+   830us) log.cc:844] Serialized 591 byte log entry
0709 12:20:37.165828 (+ 64000us) op_driver.cc:464] REPLICATION: finished
0709 12:20:37.927684 (+761856us) write_op.cc:301] APPLY: starting
0709 12:20:37.928370 (+   686us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:37.928496 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:37.928681 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:37.928970 (+   289us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:37.929192 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:37.929258 (+    66us) write_op.cc:312] APPLY: finished
0709 12:20:37.929501 (+   243us) log.cc:844] Serialized 23 byte log entry
0709 12:20:37.929709 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:37.929812 (+   103us) write_op.cc:454] Released schema lock
0709 12:20:37.929863 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:37.930281 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:37.930324 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":173,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":80355,"apply.run_cpu_time_us":2092,"apply.run_wall_time_us":664666,"num_ops":1,"prepare.queue_time_us":50759,"prepare.run_cpu_time_us":13378,"prepare.run_wall_time_us":65324,"raft.queue_time_us":12146,"raft.run_cpu_time_us":17379,"raft.run_wall_time_us":80544,"replication_time_us":64695,"thread_start_us":187828,"threads_started":4,"wal-append.queue_time_us":39503}]]}
I20260709 12:20:39.153973  4152 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 377) took 2093 ms. Trace:
I20260709 12:20:39.154749  4152 rpcz_store.cc:276] 0709 12:20:37.060369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.060517 (+   148us) service_pool.cc:224] Handling call
0709 12:20:37.075869 (+ 15352us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:39.153880 (+2078011us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":16446336}
W20260709 12:20:39.686864  4218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.005s
W20260709 12:20:39.687569  4218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.004s	sys 0.005s
W20260709 12:20:39.694545  4372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.009s
W20260709 12:20:39.695102  4372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.003s	sys 0.009s
W20260709 12:20:39.725338  4221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.005s
W20260709 12:20:39.725854  4221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.000s	sys 0.006s
I20260709 12:20:39.785859  5837 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.786568  5837 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.792160  6023 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.792994  5837 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.802615  5837 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.792847  6023 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.800062  6132 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.818480  5837 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.837452  5837 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.837232  6023 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.841538  6115 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.841863  6118 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.842667  6111 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.842506  6118 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:39.843189  6111 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.844954  6110 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.845889  6127 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.845044  6118 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.847070  5837 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.848028  5837 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.845176  6111 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.842267  6115 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.846773  6109 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.846273  6110 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.859613  5837 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.862380  5837 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.865047  5837 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.846513  6127 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.879830  6115 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.860116  6111 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.880981  6111 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:39.882917  4992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.649s	user 0.014s	sys 0.026s
I20260709 12:20:39.884799  6138 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.886068  5837 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.889341  6127 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:39.886843  4992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.653s	user 0.017s	sys 0.026s
I20260709 12:20:39.895469  6110 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.896085  6111 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.885486  6138 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.824748  6132 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.895897  6123 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.902827  6107 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.904372  6122 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:39.906828  6131 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:39.907375  6131 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.912647  6138 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:39.904985  6122 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.915133  6122 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.904414  6107 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.915136  6132 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.923972  6129 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.870332  6109 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.911233  6131 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:39.928012  6137 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.922717  6111 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.929297  6126 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:39.908164  6123 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.922247  6110 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.929106  6137 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.932228  6111 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:39.924510  6129 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.934612  6125 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.938243  6135 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:39.938319  6124 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.940140  5837 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.940780  5837 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.936230  6128 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.936753  6119 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.938308  6121 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.939043  6124 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.951149  6111 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.951328  6141 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.951278  5837 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.937913  6110 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.963413  6114 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.964022  6144 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.953210  6118 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.964078  6106 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.958890  6127 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:39.960947  6138 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:39.964745  6107 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.965003  6124 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.938896  6135 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.968600  6132 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:39.935791  6126 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.970881  6129 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.952404  6128 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.975924  6137 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.949087  6125 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.990226  6110 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:39.972710  6118 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.981761  6117 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:39.952047  6141 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.973503  6127 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.974709  6138 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.971781  6144 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.951175  6119 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.991125  6136 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.001863  6109 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.962559  6121 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.975757  6106 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:39.997798  6123 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:39.985255  6132 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.998458  6113 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.002676  6134 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.002224  6136 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:39.975636  6114 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.018258  6128 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.006860  6117 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.011093  6109 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.021376  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.021906  6132 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.025738  6145 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.026081  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:40.023182  6105 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:20:40.061551  6143 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.022262  6149 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.024016  6133 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.024003  6116 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.059525  6142 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.059152  6127 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.043226  6129 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.059410  6147 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.072505  6135 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.072674  6144 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.078991  6136 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.084102  6119 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.064968  6132 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.069319  6126 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.056231  6148 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.078979  6131 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.073843  6121 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.024863  6109 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.048682  6141 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.064514  4250 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:40.080037  6127 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.080935  6144 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.024128  6134 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.073686  6138 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.079108  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.057286  6145 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.097692  6117 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.103103  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.081521  6118 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.097899  6151 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.084864  6132 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.024225  6113 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.027772  6106 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.080511  6129 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.115242  4257 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:40.079057  6116 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.108520  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 695) took 2867 ms. Trace:
I20260709 12:20:40.078014  6143 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.111768  6152 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.108603  6131 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.120421  4249 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.082978  6133 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.114944  4255 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:40.110947  6144 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.122355  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.073904  6149 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.117996  6150 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.124223  6141 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.114223  6138 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.096414  6147 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.110744  6127 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.122805  6125 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.122809  6136 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.130519  6116 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.109694  6148 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.131048  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.082226  6142 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.139147  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1658) took 2975 ms. Trace:
I20260709 12:20:40.124903  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.139021  6141 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.141757  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.130398  6109 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.148172  4984 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:40.149080  4332 rpcz_store.cc:276] 0709 12:20:37.162806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.163141 (+   335us) service_pool.cc:224] Handling call
0709 12:20:37.163653 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:37.163979 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:37.164013 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.164884 (+   871us) log.cc:844] Serialized 548 byte log entry
0709 12:20:37.212499 (+ 47615us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:37.212536 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.212610 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.137589 (+2924979us) raft_consensus.cc:1685] finished
0709 12:20:40.137619 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.137784 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":47332,"threads_started":1,"wal-append.queue_time_us":2694004}
I20260709 12:20:40.127694  6153 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.131246  6152 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.140151  6138 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.150254  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.153941  6154 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.148770  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.120226  6151 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.159163  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.121488  4992 rpcz_store.cc:276] 0709 12:20:37.230767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.230962 (+   195us) service_pool.cc:224] Handling call
0709 12:20:37.231760 (+   798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:37.232239 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:37.232290 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.233630 (+  1340us) log.cc:844] Serialized 548 byte log entry
0709 12:20:39.903850 (+2670220us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:39.905013 (+  1163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.905125 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.082321 (+177196us) raft_consensus.cc:1685] finished
0709 12:20:40.082346 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.098464 (+ 16118us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2666128,"threads_started":1,"wal-append.queue_time_us":2668062}
I20260709 12:20:40.148028  6136 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.164428  6133 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.164647  6135 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.157493  6142 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.167600  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.162675  4255 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:40.169039  6129 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.155339  4247 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:40.142005  6150 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.165692  6143 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.168970  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.167971  6135 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.179080  4987 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:40.172525  6132 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.178218  6145 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.180114  6138 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.172524  6134 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.178157  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.184453  6131 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.178181  6148 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.174537  6141 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.184309  6152 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.186985  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.187501  6113 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.177090  6144 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.158286  6153 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.189306  6127 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.194866  6151 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.184320  6147 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.197338  6136 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.197875  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.206579  4989 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:40.209662  6126 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.210279  6126 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.166127  6154 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.220333  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.229482  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.230232  4984 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.220161  6135 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.218634  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.222182  6150 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.219732  6141 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.220468  6152 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.230902  6131 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.244335  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.244931  4405 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:40.238124  6135 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.246079  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.246330  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.248436  6131 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.249871  4401 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:40.251840  6131 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.241309  4992 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.252806  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.252889  6155 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.247666  6152 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.243114  6141 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:40.256927  4253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.091s	user 0.026s	sys 0.019s
I20260709 12:20:40.257203  6126 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.257375  6154 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:40.258651  4253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.093s	user 0.027s	sys 0.019s
I20260709 12:20:40.257720  6155 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.261641  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.263382  6160 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.263953  6160 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.261437  6107 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.255995  6135 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:40.270417  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.266562  6152 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.314456  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.315490  6159 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.267803  6131 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.310108  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.342348  4401 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
W20260709 12:20:40.370227  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.371400  6135 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.371925  6141 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.372521  6131 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.307473  6155 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.378103  6131 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.307258  6157 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.379411  6157 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.412621  4405 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:40.316311  6159 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.422967  6157 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.424220  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.430677  6160 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.307730  6107 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.434623  6159 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.435761  6160 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.436724  4401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7935718b80b24232b822244ef31fa44b"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:40.436600  6160 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.437475  4401 raft_consensus.cc:606] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:40.439610  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.441771  6159 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.442468  6159 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.444166  6131 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.444823  6131 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.456096  6160 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.458642  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.459956  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.460340  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.460739  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.459976  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.461318  4402 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:40.461309  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.462625  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:40.465246  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.466351  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.466885  4407 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:40.476451  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.477921  6158 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.478273  4403 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:40.447227  6131 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.494673  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.478540  6158 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.499742  6158 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.501585  6159 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.510469  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.511564  6141 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:40.511989  6141 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:20:40.512172  6102 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.671s	user 0.010s	sys 0.000s
I20260709 12:20:40.512401  6141 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:40.512502  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.513309  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1586) took 3349 ms. Trace:
I20260709 12:20:40.513664  4253 rpcz_store.cc:276] 0709 12:20:37.163421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.163528 (+   107us) service_pool.cc:224] Handling call
0709 12:20:37.164010 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:37.164351 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:37.164376 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.165181 (+   805us) log.cc:844] Serialized 548 byte log entry
0709 12:20:40.260890 (+3095709us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:40.260928 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.261001 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.511458 (+250457us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:20:40.513005 (+  1547us) raft_consensus.cc:1685] finished
0709 12:20:40.513028 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.513233 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13386496,"thread_start_us":3095408,"threads_started":1,"wal-append.queue_time_us":2675928}
I20260709 12:20:40.519948  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.520632  4989 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.522763  6141 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.524886  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.526413  6152 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.526918  6152 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.527467  6152 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.535708  6141 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.535651  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.535082  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.542479  4256 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:20:40.543589  4184 debug-util.cc:398] Leaking SignalData structure 0x7b0800042dc0 after lost signal to thread 4187
I20260709 12:20:40.543519  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.544245  4989 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:40.540145  6152 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.548363  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.549134  4983 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.549319  6152 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:40.551045  4184 debug-util.cc:398] Leaking SignalData structure 0x7b0800348a00 after lost signal to thread 4281
I20260709 12:20:40.551424  6122 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.551990  6122 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.554085  6083 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.554783  6083 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.554144  6122 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.555665  6162 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.555912  6122 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.556186  6162 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.556422  6122 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.557335  6083 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.558254  6162 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.561162  6090 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.562849  6050 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.563561  6050 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.566094  6050 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.562534  6090 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.569078  6122 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.570801  6090 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.571552  6157 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.572108  6157 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.574059  6157 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.574563  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:40.574760  6122 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.575651  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:40.575310  6122 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:40.577492  6122 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.574559  6157 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.578418  6157 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.578651  6090 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.579368  6090 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.581944  6090 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.583693  6050 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.583815  6083 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.584319  6050 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.585390  6091 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.585525  6097 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.584332  6083 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.585948  6091 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.586205  6097 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.587662  6083 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.587956  6091 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.588184  6083 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.588423  6060 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.588807  6157 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.588673  6083 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.589120  6060 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.590020  6050 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.590600  6050 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.590799  6090 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.591169  6050 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.591581  6092 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.592145  6092 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:40.592747  6168 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.593253  6168 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.593988  4371 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.594455  6092 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.594980  6092 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.591315  6090 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.595808  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.599671  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.599999  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:40.600761  4256 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:40.616516  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:40.595330  6114 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.619481  6167 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.619784  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:40.588459  6091 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.591289  6060 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.621251  4151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 364) took 3477 ms. Trace:
W20260709 12:20:40.610221  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5678344620000644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:20:40.622825  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5678344620000644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:20:40.620464  6050 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.623445  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:40.610375  6083 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.617381  6119 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.582206  6107 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.617923  6023 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.621671  6162 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:40.610093  6092 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.626283  6097 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.622223  6091 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.641146  6162 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:40.620015  6167 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.660900  6167 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.621436  6090 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.661326  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.626299  6119 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.617338  6168 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.629815  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.630352  6083 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:40.662184  6119 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.663085  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.664436  4991 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:40.643687  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.644567  6092 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.646302  6091 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.666719  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.624100  6122 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.667857  6122 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.668283  6122 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.647644  6158 raft_consensus.cc:993] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:40.670727  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.648079  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.648487  6153 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.651324  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.625334  4151 rpcz_store.cc:276] 0709 12:20:37.123070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.123403 (+   333us) service_pool.cc:224] Handling call
0709 12:20:39.839579 (+2716176us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:40.600774 (+761195us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":4667845504}
I20260709 12:20:40.653494  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:40.653683  4184 debug-util.cc:398] Leaking SignalData structure 0x7b0800346c80 after lost signal to thread 4358
W20260709 12:20:40.673269  4184 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2ca0 after lost signal to thread 4359
W20260709 12:20:40.674365  4184 debug-util.cc:398] Leaking SignalData structure 0x7b0800336ca0 after lost signal to thread 4433
I20260709 12:20:40.674314  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.655498  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.675603  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.675827  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.655599  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.676281  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.676558  6153 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:40.656721  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.676877  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.659268  6149 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.658422  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.661947  4986 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:20:40.683873  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.684207  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.684535  6157 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.684932  6157 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.685279  6157 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.685791  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.670746  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.654165  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.675483  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.692898  4406 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:40.681869  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.676923  6153 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.670782  6158 raft_consensus.cc:1081] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:20:40.682601  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.680346  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.687213  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.686429  4402 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:40.694954  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.696435  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.695204  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.691902  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:40.677549  4184 debug-util.cc:398] Leaking SignalData structure 0x7b080025f160 after lost signal to thread 5016
I20260709 12:20:40.697377  4403 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:40.698333  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.698611  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.700966  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.699961  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:40.701421  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.700142  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.701539  4990 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:40.701428  4253 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:40.701458  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.703187  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.703778  4990 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:40.704464  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.708866  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.711609  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:40.671258  6119 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.712996  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.700655  6153 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.699751  6097 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.715155  5694 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:40.722577  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.722748  5694 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.723143  5694 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.714337  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.715456  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.718098  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.718377  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.719017  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.699714  6163 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.724794  4252 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:40.730001  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:40.730249  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.715764  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:40.712337  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.699671  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.731887  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.732177  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:40.732663  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.733062  6118 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.733422  6118 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.733824  6118 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.733860  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.712424  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.725944  6097 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.726380  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.730571  4406 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:40.728504  6083 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:40.743849  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.744020  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.744451  4407 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:40.728613  4983 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:40.721053  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.736219  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.745127  4404 raft_consensus.cc:2393] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:40.736286  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.730859  4257 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.727149  6163 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.740257  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.735042  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.726794  6166 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.746953  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:40.747268  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.745837  4985 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:40.748905  6152 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.753746  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.753908  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.754370  4407 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:40.754570  4400 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:40.749768  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.749495  6083 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:40.750939  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:40.752509  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.757649  6167 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.757742  6090 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.758231  6167 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.758672  6165 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.758380  6090 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.757227  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.762490  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.750864  6163 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:40.774201  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.785591  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.786477  4400 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:40.789613  6090 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.790138  6119 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.759217  6165 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.794355  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.754231  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:40.792541  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45655.1us
I20260709 12:20:40.799973  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:40.794173  6097 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.751590  6166 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.804342  6165 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.805389  6166 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.759178  6050 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.756462  6152 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.755869  6151 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:40.767791  6092 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.763679  6060 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.810405  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:40.808322  4248 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:20:40.811610  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.811333  6091 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.814896  6097 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:40.815140  6167 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:40.816315  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.808434  6050 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.828006  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:40.765751  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 62499.5us
I20260709 12:20:40.871558  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.828068  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.873312  4405 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:40.870620  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.878338  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:40.751823  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:40.811573  6152 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.809337  6149 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:40.879570  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 166635us
I20260709 12:20:40.877676  4408 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:40.880247  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.829653  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.808094  5694 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.888245  4331 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:20:40.897842  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 87494.6us
I20260709 12:20:40.898229  6173 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.898818  6173 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.899355  6173 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.815318  6092 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:40.905769  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.923416  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.929394  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.888469  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:40.932543  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 54984.3us
W20260709 12:20:40.933172  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 44766.2us
I20260709 12:20:40.934605  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.936105  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:40.937613  6114 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.938117  6114 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.938597  6114 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.823287  6166 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.942732  5694 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:40.816506  6171 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.944013  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.831909  6167 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:40.948755  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:40.946724  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47764.4us
I20260709 12:20:40.889791  6149 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:40.828518  6091 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.951900  4333 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.949467  4331 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:40.970857  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:40.827618  6060 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.972584  5694 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:40.972946  5694 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:40.945827  6107 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:40.973286  5694 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.974664  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:40.978487  4404 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:40.975692  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:41.020287  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 45498.8us
I20260709 12:20:41.050067  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.050976  4983 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:40.950019  6171 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.054104  6092 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:41.054818  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.056133  6050 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:41.057555  6122 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.060657  5694 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.060863  6091 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:40.958367  6149 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:40.957105  6167 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.947345  6166 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.067589  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.068843  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:41.067807  6174 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:41.071570  4334 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:41.074321  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.074620  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.075927  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:41.077167  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 131097us
I20260709 12:20:41.129166  6113 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.078926  6060 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.078238  6152 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.081842  6157 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:40.979188  6107 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:41.157263  6107 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:40.829074  6097 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.111495  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.158123  4329 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:41.107554  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.127573  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.159332  6171 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.160055  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.161142  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.162070  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.103883  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.140374  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.140959  5694 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:41.138160  4406 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:20:41.140374  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.076666  6164 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:41.144443  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:41.147606  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.147056  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:41.155107  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.186937  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:41.191915  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.192584  4407 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:41.186913  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.196730  5694 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:41.196204  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49221.4us
I20260709 12:20:41.197296  5694 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:41.197779  5694 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.139281  6163 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:41.199608  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55232.3us
I20260709 12:20:41.199805  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.200565  6163 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.201020  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.201335  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:41.202302  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.203912  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:41.204824  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.205258  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.205502  4330 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:41.206494  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.208148  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.208701  6166 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.209453  6166 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:41.209847  6166 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:41.210230  6166 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.153904  6113 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:41.203954  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.214711  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.216897  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.198227  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:41.212283  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:41.211373  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 275345us
I20260709 12:20:41.217726  4329 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:41.226364  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.218300  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.214721  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.227660  4400 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:41.221066  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.244880  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.227037  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.146425  6174 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:41.222107  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.228157  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.223290  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:41.234403  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.225013  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.250895  5694 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.218020  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.313720  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.216670  6157 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.321696  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.323262  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.227797  6141 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:41.241338  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.251773  4402 raft_consensus.cc:2393] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:41.336161  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.326864  6180 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:41.241266  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.241343  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.245973  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.333163  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.363097  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:41.333797  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 65352.1us
I20260709 12:20:41.334417  4331 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:41.364105  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.364388  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.223632  6173 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.276965  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:41.365195  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.340324  5694 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:41.365653  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 88780.5us
I20260709 12:20:41.330078  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.219322  6097 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.354648  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.215883  6113 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:41.356690  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.343464  6141 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:41.353058  6180 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:41.357456  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.359052  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:41.359995  6183 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:20:41.360554  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.361629  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.251992  6122 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.384739  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:41.384974  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.367846  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:41.368069  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 144853us
I20260709 12:20:41.386008  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:41.371622  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.372849  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.387998  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.389338  4991 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:41.357461  4250 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:41.380749  4248 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:41.390491  6060 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:41.372943  5694 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:41.373453  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.372972  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:41.392596  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.393189  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.382222  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.393651  5694 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:41.394232  5694 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:41.394680  5694 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.366854  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.398154  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.394804  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.405792  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:41.410622  6137 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:41.411048  6137 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:41.411486  6137 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.397270  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:41.383349  6180 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.413967  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:41.447000  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 53907us
I20260709 12:20:41.446774  4400 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:41.460955  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.371037  6182 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:41.389338  6119 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:41.471776  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 87100.7us
I20260709 12:20:41.381122  6141 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.446466  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:41.412823  6153 consensus_meta.cc:287] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.690s	user 0.015s	sys 0.000s
I20260709 12:20:41.383525  6167 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.467942  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.486896  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:41.473603  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 76395.6us
I20260709 12:20:41.488482  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:41.439504  5694 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.475059  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.411998  6178 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:41.473713  6119 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:20:41.472647  6114 consensus_meta.cc:287] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.005s
I20260709 12:20:41.491008  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.486919  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:41.499913  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.474949  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:41.548276  5694 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:41.474115  6154 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.579921  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.485649  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:41.477442  6175 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:41.580921  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 92463.4us
I20260709 12:20:41.588132  5694 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:41.590278  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.590422  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.591581  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.490597  6152 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:41.596915  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.470209  6182 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:41.556077  6119 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:41.593436  4219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.130:42725 timed out after 1.512s (SENT)
I20260709 12:20:41.611738  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:41.599279  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 112431us
I20260709 12:20:41.594148  6114 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:41.622503  4257 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:41.588120  6170 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:41.624200  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:41.627379  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.627797  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.490511  6153 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.630945  6153 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:41.547564  6186 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.631924  4405 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:41.632730  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:41.634335  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:41.635517  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.641522  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:41.667516  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 74099.3us
I20260709 12:20:41.666867  6137 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.608477  6158 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:41.614337  6182 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:41.717674  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.719525  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.723124  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.719736  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:41.726070  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.676939  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:41.729264  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52451.2us
I20260709 12:20:41.726264  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:41.722599  6178 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:41.737130  6178 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.716943  6187 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.747757  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.732882  6158 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:41.749768  6158 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:41.750064  6190 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:20:41.654968  6167 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.724999  6173 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:41.756513  4331 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:41.734192  6122 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.674026  6060 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:41.766746  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.775801  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 290060us
I20260709 12:20:41.777207  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:20:41.778179  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47995.6us
I20260709 12:20:41.777674  4990 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:41.778810  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.748011  6187 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:41.767496  6022 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:41.767936  6060 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:41.767635  6163 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:41.781620  6186 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.771852  6113 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.788244  6187 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.793723  6060 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:41.808893  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 347981us
I20260709 12:20:41.800438  6163 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:41.797442  6022 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:41.842355  6114 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:41.796154  6137 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.850584  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:41.850752  6107 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.005s
I20260709 12:20:41.870488  6107 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:41.871537  6163 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:41.872501  6107 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:41.872637  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:41.785967  6157 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:41.821820  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:41.801542  6186 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:41.865923  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:41.869060  6118 consensus_meta.cc:287] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 1.135s	user 0.012s	sys 0.011s
W20260709 12:20:41.868222  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 85413.3us
I20260709 12:20:41.849992  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:41.781261  4328 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:41.880856  4956 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.866570  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:41.883077  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 61345.5us
I20260709 12:20:41.893419  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.894387  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.896406  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.898415  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.885361  6202 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:41.901959  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:41.912055  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.881382  6186 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.886006  6192 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.916004  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.916970  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.940335  4253 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:41.916298  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.956871  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.921331  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.914690  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:41.903367  6177 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:41.886349  6118 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:41.961504  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45796.4us
I20260709 12:20:41.961817  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:41.912724  6149 consensus_meta.cc:287] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.001s
I20260709 12:20:41.901120  6202 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:41.901019  6137 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:20:41.999569  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:41.960971  6118 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:41.958961  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44355.3us
I20260709 12:20:41.910863  6154 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.038089  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:42.012213  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:41.977099  6200 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:42.053705  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 91554.4us
I20260709 12:20:42.060868  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:41.999382  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:42.075356  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:42.077191  6174 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:42.078056  6022 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:41.913033  6173 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.070545  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.071992  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:42.094372  6165 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.094825  6165 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:42.082985  6119 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:42.096266  6165 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.097290  6165 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.056285  6113 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:42.100469  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:42.100117  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.103623  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:42.104043  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.069361  6200 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:42.056807  6202 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.109369  4371 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.086910  6186 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.131808  4253 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:42.124150  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 125288us
I20260709 12:20:42.128425  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:42.087594  4248 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:42.134894  4252 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:42.135885  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:42.136294  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.128816  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:42.138200  4257 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
W20260709 12:20:42.110742  6164 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.004s
I20260709 12:20:42.141216  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.097940  6119 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:42.106841  6204 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:42.107635  6189 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.116464  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:42.126240  4250 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.145880  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:42.110527  6180 consensus_meta.cc:287] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.001s
I20260709 12:20:42.161157  6180 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.161958  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:42.145423  6204 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:42.111263  6022 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:42.062613  6149 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.146718  6163 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:42.150116  4252 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:42.146636  6159 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.168545  4990 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:42.146580  6166 consensus_meta.cc:287] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.936s	user 0.013s	sys 0.003s
I20260709 12:20:42.143064  6203 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:42.112345  6200 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.164603  6022 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:42.112226  6187 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:42.166997  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:42.197775  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.148490  6158 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:42.263324  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:42.222707  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:42.258203  4252 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:42.258627  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:42.291953  4256 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:20:42.253757  6182 consensus_meta.cc:287] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.003s
I20260709 12:20:42.165419  6204 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:42.300375  4990 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:42.305863  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:42.210635  6163 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:42.307808  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:42.309391  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.256582  6186 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:42.256018  6180 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:42.309981  6182 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.271541  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:43.400569  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.408915  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 396) took 1152 ms. Trace:
I20260709 12:20:43.367141  4151 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 4 to 5, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:43.409631  4253 rpcz_store.cc:276] 0709 12:20:42.256555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.257211 (+   656us) service_pool.cc:224] Handling call
0709 12:20:43.408631 (+1151420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:42.311491  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:43.411665  4248 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.432622  4248 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:43.433403  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 392) took 1232 ms. Trace:
I20260709 12:20:43.433861  4248 rpcz_store.cc:276] 0709 12:20:42.200937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.224875 (+ 23938us) service_pool.cc:224] Handling call
0709 12:20:43.433319 (+1208444us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:42.426548  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.455917  4991 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 2: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:42.733325  6204 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.456992  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 535) took 1168 ms. Trace:
I20260709 12:20:42.255133  6154 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:43.457595  4991 rpcz_store.cc:276] 0709 12:20:42.288049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.291747 (+  3698us) service_pool.cc:224] Handling call
0709 12:20:43.456776 (+1165029us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:42.712510  6202 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.003s
I20260709 12:20:43.460420  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.461328  6202 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.257146  6060 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:42.418471  6187 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:42.284760  6022 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.463987  6187 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:43.465193  6187 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:42.183025  6162 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:42.436172  6149 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:42.721596  6200 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.469875  6182 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:43.471663  6163 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.472445  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 2075) took 1307 ms. Trace:
I20260709 12:20:43.472941  4327 rpcz_store.cc:276] 0709 12:20:42.165289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.187526 (+ 22237us) service_pool.cc:224] Handling call
0709 12:20:43.472063 (+1284537us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:42.292577  6206 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:20:43.475657  4983 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:43.476765  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 536) took 1188 ms. Trace:
I20260709 12:20:43.476924  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 554) took 1219 ms. Trace:
I20260709 12:20:43.477362  4990 rpcz_store.cc:276] 0709 12:20:42.257638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.257980 (+   342us) service_pool.cc:224] Handling call
0709 12:20:42.300212 (+ 42232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.311390 (+ 11178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.476632 (+1165242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:43.479933  4986 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:42.739864  6151 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:43.481736  6187 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:43.482074  6151 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.477241  4983 rpcz_store.cc:276] 0709 12:20:42.288527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.292344 (+  3817us) service_pool.cc:224] Handling call
0709 12:20:43.475027 (+1182683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.476271 (+  1244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.476627 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:43.486639  6204 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.486974  6202 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.489930  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.491657  6158 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:42.227492  6166 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:42.444041  6141 consensus_meta.cc:287] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.895s	user 0.009s	sys 0.003s
W20260709 12:20:42.705731  6165 consensus_meta.cc:287] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.002s
I20260709 12:20:43.497959  4333 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.499399  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:42.373088  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1401) took 1442 ms. Trace:
I20260709 12:20:43.504693  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 389) took 1207 ms. Trace:
I20260709 12:20:43.505342  4325 rpcz_store.cc:276] 0709 12:20:42.280703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.280843 (+   140us) service_pool.cc:224] Handling call
0709 12:20:43.486404 (+1205561us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:43.486762 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.487124 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.487164 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.487247 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:43.487336 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.487420 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.487621 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72658688}
I20260709 12:20:43.487939  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 555) took 1131 ms. Trace:
I20260709 12:20:43.507459  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 390) took 1041 ms. Trace:
I20260709 12:20:43.508023  4328 rpcz_store.cc:276] 0709 12:20:42.438994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.439173 (+   179us) service_pool.cc:224] Handling call
0709 12:20:43.479819 (+1040646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.480296 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.480329 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.480400 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:43.480431 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.480522 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.480688 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:43.514894  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.500032  6166 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:42.613026  6197 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:43.506942  4986 rpcz_store.cc:276] 0709 12:20:42.356782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.478532 (+1121750us) service_pool.cc:224] Handling call
0709 12:20:43.479143 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.480454 (+  1311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.485311 (+  4857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:43.530665  6200 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:43.530143  6141 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.532691  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 392) took 1012 ms. Trace:
I20260709 12:20:43.534484  4991 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEARNER]: Advancing to term 3
I20260709 12:20:43.535772  4326 rpcz_store.cc:276] 0709 12:20:42.519754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.520001 (+   247us) service_pool.cc:224] Handling call
0709 12:20:43.520314 (+1000313us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:43.522979 (+  2665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.531888 (+  8909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.531911 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.531940 (+    29us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:43.532246 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.532337 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.532492 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101169536}
I20260709 12:20:43.527235  6179 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.540668  6179 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.541000  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:43.527325  4405 rpcz_store.cc:276] 0709 12:20:40.930814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.931137 (+   323us) service_pool.cc:224] Handling call
0709 12:20:41.631735 (+700598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.632413 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.372841 (+740428us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54002a85d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:42.372989 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610483328}
I20260709 12:20:43.542577  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.539073  6158 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:43.541714  4406 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:20:43.545397  4987 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.547765  6158 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.549986  6158 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:43.550637  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 51578.4us
I20260709 12:20:43.556895  6151 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:43.559495  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 74520.3us
I20260709 12:20:43.530211  6197 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:43.560667  4334 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:43.561420  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 391) took 1103 ms. Trace:
I20260709 12:20:43.561777  4334 rpcz_store.cc:276] 0709 12:20:42.458381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.458564 (+   183us) service_pool.cc:224] Handling call
0709 12:20:43.557767 (+1099203us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:43.560220 (+  2453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.561156 (+   936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.561360 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101331840}
I20260709 12:20:43.563738  4990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7935718b80b24232b822244ef31fa44b"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:20:43.565938  4990 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.566465  4990 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.567731  4986 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:43.581910  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.582091  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.582535  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.582937  4328 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.583314  4986 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:43.584424  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1321247949999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 12:20:43.584923  6197 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:43.594760  4989 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.596583  4985 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:43.580101  6141 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:43.597440  4984 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.597501  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:43.598623  4329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 2072) took 1852 ms (client timeout 2215 ms). Trace:
W20260709 12:20:43.599064  4329 rpcz_store.cc:269] 0709 12:20:41.746400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.746973 (+   573us) service_pool.cc:224] Handling call
0709 12:20:42.521086 (+774113us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:43.596114 (+1075028us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59e9c 00007fdbadc59a5b 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:43.598559 (+  2445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101101824}
I20260709 12:20:43.602957  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.603847  4325 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.608273  6022 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:43.609164  4987 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:43.610999  6022 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:43.611642  4983 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.620007  4987 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.623355  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:43.624327  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 376) took 2561 ms. Trace:
I20260709 12:20:43.624756  4333 rpcz_store.cc:276] 0709 12:20:41.062794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.215585 (+152791us) service_pool.cc:224] Handling call
0709 12:20:41.241694 (+ 26109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.521302 (+2279608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.624015 (+102713us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b540013d154. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:43.624230 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5179809536}
I20260709 12:20:43.630023  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.621542  4990 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.638607  6180 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:43.639191  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0430247950002922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:20:43.639936  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0178247950002515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
I20260709 12:20:43.640247  6180 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.640941  6180 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:20:43.642343  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.643851  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.643672  6141 consensus_queue.cc:1059] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:43.653622  6141 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.654088  6141 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:43.645120  6060 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.645877  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.651129  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:43.656621  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61639.1us
I20260709 12:20:43.657918  4983 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:43.642498  6180 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.661305  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.661849  6180 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.661613  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:43.664456  6186 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.664783  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.666227  4219 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:43.668697  6060 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.669349  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:43.676653  4988 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:43.679759  6060 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:43.681288  6179 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.681490  6166 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.682076  6166 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.683715  6166 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.690050  6200 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:43.709570  4990 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:43.614833  6158 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:43.716781  6166 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.718133  4986 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:43.719769  6141 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.721396  6141 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.724493  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.725437  4248 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:43.711813  6186 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.746649  6060 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:43.712003  6163 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:43.740339  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:43.748436  4403 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.748071  6060 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.749738  6163 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:43.742887  4983 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:43.750487  6060 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.739773  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:43.752036  4409 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:43.739100  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:43.754941  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:43.761094  6158 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:43.760910  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:43.761970  6060 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.762161  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:43.766018  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0626809199998206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:20:43.766472  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0392809199997828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:20:43.768716  6200 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:43.769078  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:43.769804  4409 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.770149  4409 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:43.770340  6200 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.770789  6200 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:43.739614  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:43.762267  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 58541.6us
I20260709 12:20:43.740769  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:43.771174  4409 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.774001  4402 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:43.774809  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.773507  6163 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:43.777259  4325 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:43.774255  4409 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:20:43.779976  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 132857us
W20260709 12:20:43.780498  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 101871us
I20260709 12:20:43.731276  4328 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:43.777994  6204 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:43.782881  6163 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.788956  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:43.789698  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:43.790459  6204 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.792127  6197 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:43.792689  6197 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:43.793735  6197 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:43.796788  6204 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.799309  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:43.800527  6163 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:43.803404  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:43.775192  6200 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.809813  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.811055  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:43.811795  4991 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:43.812296  6163 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:43.824874  6163 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:43.822822  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:43.827442  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:43.828786  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.829491  4256 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.829768  4990 raft_consensus.cc:2393] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 2: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:43.834936  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:43.836341  4254 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:43.840953  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:43.841745  4990 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.841048  4402 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:43.826591  6163 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:43.845412  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.846204  4256 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
W20260709 12:20:43.846743  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.850060  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:43.852957  6200 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.861260  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:43.877300  6060 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:43.877691  6179 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:43.879081  6179 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:43.879308  6083 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.879947  6083 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.880530  6214 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:43.880934  6214 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.881129  6083 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.881968  6214 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.882864  6083 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.883625  6165 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:43.883729  6214 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:43.886549  6165 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.887928  6165 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.884487  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:43.889385  6165 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:43.893869  6182 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:43.884610  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:43.896525  4256 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:43.885246  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:43.885756  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:43.898082  4252 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.898748  4253 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
W20260709 12:20:43.900060  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 48074.4us
I20260709 12:20:43.900921  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:43.897643  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:43.902014  6220 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:43.902647  6182 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:43.902588  4219 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:43.905478  4409 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:43.909783  4990 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:43.915699  6180 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:43.921540  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.923882  4403 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
W20260709 12:20:43.925140  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 47713.3us
I20260709 12:20:43.926251  6166 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:43.926599  6179 consensus_queue.cc:1059] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:43.927721  6166 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.928206  6166 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.928457  6170 raft_consensus.cc:3055] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.928954  6170 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.928725  6097 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:43.931272  4252 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:43.929435  6166 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.940678  6170 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:43.941967  6170 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.942222  6091 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:43.941946  6166 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:43.929517  6060 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:20:43.954051  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:43.956893  4990 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:43.958350  4992 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:43.959847  6091 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:43.960258  6091 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:43.961081  6091 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:43.961663  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 59184.4us
W20260709 12:20:43.979507  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.982249  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:43.992086  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.991423  6091 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.014650  6154 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:44.018985  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 102241us
W20260709 12:20:44.019462  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.992213  6180 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:44.021940  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.024022  6151 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:44.031827  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 49742.8us
I20260709 12:20:44.035058  4219 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.037055  6180 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.038511  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:44.039474  4992 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.039103  6220 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:44.041128  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:44.049062  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.048717  6141 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:44.049892  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.050390  6200 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:44.050952  6200 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:44.058370  6200 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.072602  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:44.079816  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 150290us
I20260709 12:20:44.081127  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.074536  6154 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.085059  6180 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.158005  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.160738  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:44.162021  4219 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:44.162868  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90448.7us
I20260709 12:20:44.163385  6163 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:44.164204  6200 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.166126  6179 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:44.169914  4992 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:44.190177  6228 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:44.174659  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.190713  6228 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:44.191195  6228 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.192239  4219 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.186415  6179 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:44.193933  6179 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.195379  6219 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:44.195644  4371 connection.cc:256] RPC call timeout handler was delayed by -1.3887703430000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 12:20:44.196218  4371 connection.cc:256] RPC call timeout handler was delayed by -1.3392703429999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 12:20:44.187243  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:44.197340  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:44.187815  6163 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.174355  6162 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:20:44.196641  4371 connection.cc:256] RPC call timeout handler was delayed by -1.3149703429999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 12:20:44.197863  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.187490  6141 consensus_queue.cc:1059] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:20:44.198742  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:44.200201  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.184231  6204 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:44.204419  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:44.204968  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.197916  6179 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:44.202276  4371 connection.cc:256] RPC call timeout handler was delayed by -1.2366703430002417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 12:20:44.235493  4371 connection.cc:256] RPC call timeout handler was delayed by -1.1736703430001398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 12:20:44.235877  4371 connection.cc:256] RPC call timeout handler was delayed by -1.1556703430001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:20:44.236191  4371 connection.cc:256] RPC call timeout handler was delayed by -1.0881703430000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:20:44.236495  4371 connection.cc:256] RPC call timeout handler was delayed by -1.03147034299991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 12:20:44.236719  6228 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.238123  4371 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.238968  6197 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.240931  4250 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.241307  4988 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:44.241695  6228 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:44.213263  6154 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:44.242559  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.243968  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:44.244884  4250 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:44.202622  6151 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:44.210855  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.211367  6163 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:44.211930  6162 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:44.212563  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:44.214250  4151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 381) took 2097 ms. Trace:
I20260709 12:20:44.212577  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.202113  6202 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:44.217978  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:44.219008  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:44.220496  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:44.221568  6097 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:44.222219  6060 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:44.222286  6204 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.224028  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:44.224296  6230 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:20:44.224694  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62560.5us
I20260709 12:20:44.225458  4992 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.227214  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.221346  4152 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 2 to 3, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:44.227694  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:44.229003  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:44.229662  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.230376  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:44.230434  4403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
W20260709 12:20:44.208863  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 53196.7us
I20260709 12:20:44.245415  6197 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.332405  4325 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:44.270928  4256 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 3. Ops: []
I20260709 12:20:44.248771  4254 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:44.328676  6182 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:44.345037  6182 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:44.346263  6182 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.273253  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.348738  4250 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 2: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:44.348830  6182 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.246309  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:44.350873  6162 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:44.339551  4403 raft_consensus.cc:606] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.359841  6060 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:44.360370  4257 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.360342  6060 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:44.332651  4152 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:44.379231  4990 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:44.362756  4991 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:44.380546  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.384773  6060 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:44.342437  4151 rpcz_store.cc:276] 0709 12:20:42.116824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.123569 (+  6745us) service_pool.cc:224] Handling call
0709 12:20:44.214143 (+2090574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:43.699062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:43.699789 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:43.699838 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:20:43.699947 (+   109us) tablet.cc:662] Decoding operations
0709 12:20:43.700354 (+   407us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:43.700432 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:43.700471 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:43.700802 (+   331us) tablet.cc:701] Row locks acquired
0709 12:20:43.700850 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:20:43.701000 (+   150us) write_op.cc:270] Start()
0709 12:20:43.701140 (+   140us) write_op.cc:276] Timestamp: P: 1783599643700944 usec, L: 0
0709 12:20:43.701162 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:43.701913 (+   751us) log.cc:844] Serialized 591 byte log entry
0709 12:20:43.993944 (+292031us) op_driver.cc:464] REPLICATION: finished
0709 12:20:44.196156 (+202212us) write_op.cc:301] APPLY: starting
0709 12:20:44.196267 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:44.196381 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:44.196525 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:44.196817 (+   292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:44.197115 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:44.197159 (+    44us) write_op.cc:312] APPLY: finished
0709 12:20:44.197438 (+   279us) log.cc:844] Serialized 23 byte log entry
0709 12:20:44.197606 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:44.197684 (+    78us) write_op.cc:454] Released schema lock
0709 12:20:44.197730 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:44.199818 (+  2088us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:44.199853 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":188978,"apply.run_cpu_time_us":2175,"apply.run_wall_time_us":16088,"num_ops":1,"prepare.queue_time_us":285181,"prepare.run_cpu_time_us":12291,"prepare.run_wall_time_us":100450,"raft.queue_time_us":122219,"raft.run_cpu_time_us":73741,"raft.run_wall_time_us":161990,"replication_time_us":292579,"spinlock_wait_cycles":31104,"thread_start_us":531601,"threads_started":4,"wal-append.queue_time_us":166945}]]}
I20260709 12:20:44.386125  6060 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.367177  6141 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.276244  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:44.389591  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.390087  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:44.389811  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 146490us
W20260709 12:20:44.398168  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 185714us
I20260709 12:20:44.382498  6162 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.401831  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:44.403350  4248 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.391125  4255 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:44.407980  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 161764us
I20260709 12:20:44.408663  4330 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:44.410485  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:44.416882  4252 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.424280  6219 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:44.427814  4325 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
W20260709 12:20:44.432404  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.410247  6220 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:44.431722  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.435060  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.433655  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:44.443356  4248 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
W20260709 12:20:44.445384  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.446853  4252 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:44.441596  4328 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:20:44.455787  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.457528  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46309.9us
I20260709 12:20:44.458945  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:44.459554  6220 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:44.448776  6154 raft_consensus.cc:2764] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:20:44.463016  4330 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.469867  4255 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:44.474545  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:44.474679  6235 raft_consensus.cc:993] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:44.475239  6235 raft_consensus.cc:1081] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:44.476428  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.466063  6200 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:44.477065  6200 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:44.477546  6200 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.477651  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.461136  6158 raft_consensus.cc:2764] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:20:44.483322  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 74672.8us
I20260709 12:20:44.484262  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.485105  6158 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.485538  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:44.486339  6158 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.489737  4326 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:44.486780  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:44.501046  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.472018  6204 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:44.505625  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 71174.9us
W20260709 12:20:44.506693  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47920.5us
I20260709 12:20:44.507476  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:44.503029  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.512706  6182 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:44.510658  6163 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.513319  6182 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:44.514379  6182 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.465893  6180 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:20:44.523721  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 111152us
I20260709 12:20:44.524418  6202 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:44.527262  6238 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:44.527369  6219 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:44.531507  6180 consensus_queue.cc:1243] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:44.534142  6180 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:44.534564  6180 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:44.536332  6240 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:44.536751  6240 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:44.537644  6240 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:44.538484  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.540370  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 53683.5us
I20260709 12:20:44.542105  4219 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.549574  4330 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.550210  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:44.551769  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:44.539151  6240 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:44.568958  6141 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:20:44.573171  6163 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.574941  6241 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:44.578233  4371 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.578814  6163 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:44.579422  6220 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.580031  6163 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:44.580704  6163 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:44.581544  6163 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.582836  6163 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.580024  6237 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:44.570421  6180 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.583595  6237 raft_consensus.cc:697] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:44.584576  6237 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.587350  6197 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:44.590667  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:44.597157  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 72104.1us
I20260709 12:20:44.599574  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.601421  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:44.605531  6162 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:44.613170  4326 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:44.636081  4330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:20:44.636703  4330 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:44.637075  4330 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.639758  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.605423  6141 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:44.597906  6202 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:44.598565  6158 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:44.607733  4153 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 5 to 6, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:44.651278  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 79855.5us
W20260709 12:20:44.657147  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48809.1us
I20260709 12:20:44.607894  6232 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:44.635713  6154 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:44.673525  6141 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:44.674142  6141 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:20:44.679718  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 81274.7us
W20260709 12:20:44.675081  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 76587.1us
I20260709 12:20:44.687446  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:44.662997  6158 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:44.670528  6232 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:44.669155  6151 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:44.694401  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:44.717401  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 45364.5us
I20260709 12:20:44.690122  4330 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:44.670271  6182 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.696754  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:44.718434  4326 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:44.700143  6202 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.686764  6141 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.709000  4325 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.669900  6154 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:44.725262  4330 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:44.720898  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 121420us
I20260709 12:20:44.727900  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:44.729838  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 49251.8us
I20260709 12:20:44.719784  6238 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:44.716435  6232 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:44.735368  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 68257.6us
I20260709 12:20:44.669731  6246 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:20:44.741279  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.726533  6163 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:44.757355  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 69424.8us
I20260709 12:20:44.729034  6220 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:20:44.726068  6182 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.728188  6151 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.726948  6241 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:20:44.773598  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:44.775583  4326 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:44.780905  6180 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.762295  6250 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:44.781981  6250 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:44.782828  6250 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.775636  6163 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:20:44.789529  4405 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.795333  4409 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:44.818816  4406 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:44.817008  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 89195.4us
I20260709 12:20:44.825817  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:44.827638  4256 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:44.814188  6256 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:44.832005  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.834075  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.845985  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:44.863258  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.861455  4257 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.862591  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:44.865496  4406 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.862911  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.868075  4256 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:44.867898  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.869040  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.829581  6238 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:44.873687  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:44.879148  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 53413.5us
I20260709 12:20:44.887346  4403 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:44.883981  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:44.798861  6154 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.891206  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:44.895887  4248 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:44.899683  4400 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:44.812394  6158 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:44.904791  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:44.880321  6258 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:44.888960  6256 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:20:44.933707  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 63779.1us
I20260709 12:20:44.938500  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:44.939867  4407 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:44.950670  4403 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
W20260709 12:20:44.958369  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.934875  6258 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:44.970366  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:44.971503  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.972078  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.973038  6242 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:20:44.974376  6256 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:44.978343  6248 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:20:44.979784  6249 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 12:20:44.980070  6260 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:20:44.981868  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:44.987797  6158 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:44.988134  4247 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:20:44.988386  6219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41690 (request call id 93) took 5053 ms. Trace:
I20260709 12:20:44.988634  6238 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.052412  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:45.055598  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:44.989372  6259 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:20:44.987766  4257 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:44.989715  6267 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:44.992434  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:44.996362  6154 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.997131  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:44.964162  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:45.069893  4404 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:45.002739  4403 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:20:45.008915  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 121445us
I20260709 12:20:45.011575  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:44.987046  6151 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:45.047430  4402 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:45.048298  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.027366  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.073283  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:45.032913  6182 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:45.074330  4400 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:45.079676  4333 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:45.093941  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.095098  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.095286  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.097908  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.080732  6230 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.099813  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.096472  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.162084  4406 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:45.164744  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.101387  4408 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:20:45.092450  6258 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:45.206344  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:45.228998  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.281104  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:45.312549  4990 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:20:45.311254  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.218107  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.172735  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.218359  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:45.247710  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 90340.3us
W20260709 12:20:45.343484  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.343807  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:45.310647  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.050019  6219 rpcz_store.cc:276] 0709 12:20:39.894522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.117125 (+222603us) service_pool.cc:224] Handling call
0709 12:20:40.126485 (+  9360us) log.cc:844] Serialized 487 byte log entry
0709 12:20:40.658370 (+531885us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18001fc1a0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0dbad01 00007fdbb0cf7691 00007fdbb0cd7eaa 00007fdbb0cded53 00007fdbb0cdecd9 00007fdbb0cdec69 00007fdbb0cdec31 00007fdbb0cdddfd 0000000000388634 0000000000388479
0709 12:20:44.939384 (+4281014us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58,"raft.queue_time_us":1030,"raft.run_cpu_time_us":15374,"raft.run_wall_time_us":538114,"spinlock_wait_cycles":5586688,"thread_start_us":10348,"threads_started":1,"wal-append.queue_time_us":49489,"wal-append.run_cpu_time_us":1812,"wal-append.run_wall_time_us":1042781}
I20260709 12:20:45.343902  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:45.094026  6267 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:45.373821  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:45.346773  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.228679  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.248013  4404 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:45.375422  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.379781  4403 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 2: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:45.379832  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.380771  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.381430  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.382405  4404 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:45.383371  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.384589  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.385514  4404 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:45.392477  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:45.392822  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:45.305148  6271 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:20:45.222316  6247 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.247s	user 0.004s	sys 0.000s
I20260709 12:20:45.394493  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:45.297298  4255 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:45.395224  4256 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:45.395591  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.281898  6141 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:20:45.284600  4955 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.571s (SENT)
I20260709 12:20:45.403501  4985 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:45.403756  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.397532  4252 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:45.208951  6200 consensus_meta.cc:287] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.000s
I20260709 12:20:45.284461  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.398814  4257 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 2: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:45.373189  6060 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.397173  4405 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:45.410828  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.222379  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:45.386432  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.223904  6273 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:20:45.290931  4138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 231916us
I20260709 12:20:45.248111  6232 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.397850  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.425518  4328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55244
I20260709 12:20:45.426177  4328 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:20:45.425830  6267 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:45.429358  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.406068  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:45.406222  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:45.303984  6270 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:45.407876  4331 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:45.394598  6258 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.103736  6230 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.410905  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:45.222177  6221 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:45.410154  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:45.411772  4404 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:45.397068  4332 raft_consensus.cc:2955] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:45.408079  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:45.411497  4405 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:45.409665  6200 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.408605  6141 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.419663  6264 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.421995  4330 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:45.222700  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:45.422923  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.424259  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.725077  4406 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:45.725469  4406 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:20:45.527251  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.726646  4252 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:20:45.500609  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.568787  4409 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:45.728636  6162 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:20:45.729501  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 323494us
I20260709 12:20:45.556547  4991 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:45.731531  4987 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:45.732604  6200 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:45.666676  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:45.733790  6230 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:45.734325  6230 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.734206  6264 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.735191  4331 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:45.466230  6257 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:45.736294  6257 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:45.736506  6270 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.737169  6257 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:45.738258  6257 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:45.437674  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.569890  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:45.438935  4403 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:45.569820  6232 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:45.724813  4334 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:45.743407  4325 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:45.743875  6162 consensus_queue.cc:1059] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:45.733928  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:45.431622  6273 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.746636  6197 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:45.459290  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48778.6us
I20260709 12:20:45.487372  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd41dc8658414bcfb8662c0efe3caffc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:45.748899  4137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 261668us
I20260709 12:20:45.749009  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:20:45.749341  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.750617  6289 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.740792  4402 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:45.495563  4992 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:45.724284  4152 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 2 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:45.784536  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.755340  4218 leader_election.cc:336] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.518s (SENT)
I20260709 12:20:45.755916  4989 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:45.749054  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:45.750991  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.791283  4152 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:45.794751  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50679.6us
I20260709 12:20:45.742848  6264 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:45.466619  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 184118us
I20260709 12:20:45.734807  6230 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:45.791551  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:45.800580  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 55143.2us
I20260709 12:20:45.753077  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:45.804864  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:45.716251  6158 consensus_meta.cc:287] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
W20260709 12:20:45.765645  6285 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:20:45.680457  4328 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:45.781569  6270 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:45.766011  6288 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:20:45.724570  6220 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:45.766980  6179 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:45.752024  6279 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.840095  4955 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:45.755679  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:45.826884  4407 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:45.799427  6246 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.416823  6060 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.810277  4406 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:45.834857  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 86397.3us
I20260709 12:20:45.843046  6158 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.768253  4983 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:45.832161  6220 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:20:45.846391  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 91132.3us
I20260709 12:20:45.822674  6197 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.471756  6097 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.358s
I20260709 12:20:45.835714  4334 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:45.829195  4988 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:45.834089  6219 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:45.871970  6220 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.873158  6220 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.819386  6264 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.854717  4406 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:45.844339  6267 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.866293  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1633) took 1034 ms. Trace:
W20260709 12:20:45.861658  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 112723us
I20260709 12:20:45.870061  4325 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:20:45.870404  4218 leader_election.cc:336] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.531s (SENT)
I20260709 12:20:45.751084  6289 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.876672  4254 rpcz_store.cc:276] 0709 12:20:44.826413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.830911 (+  4498us) service_pool.cc:224] Handling call
0709 12:20:44.861015 (+ 30104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.086108 (+225093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.086154 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.098347 (+ 12193us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.396329 (+297982us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:45.396878 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.396943 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.860483 (+463540us) raft_consensus.cc:1685] finished
0709 12:20:45.860507 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.860643 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4812,"raft.queue_time_us":48898,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":248509,"threads_started":2,"wal-append.queue_time_us":290335}
I20260709 12:20:45.854530  6179 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:20:45.871122  4201 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:20:45.878611  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:45.882845  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:45.886788  4201 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 78ee025f73f248629704f4ff6eaad5a0 already in progress
I20260709 12:20:45.877590  4331 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:45.887183  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 78ee025f73f248629704f4ff6eaad5a0 already in progress
I20260709 12:20:45.858466  6060 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:45.875065  4250 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:45.862968  6158 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:45.898936  4218 leader_election.cc:336] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.569s (SENT)
I20260709 12:20:45.910888  4218 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:45.849004  6279 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.900542  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:45.901132  4153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 258) took 2058 ms. Trace:
I20260709 12:20:45.901628  6294 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:45.902891  6141 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:45.885454  6264 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.903540  6219 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:45.921829  6264 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:45.922600  6294 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:20:45.878700  6293 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:45.855759  6241 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:45.923717  6294 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.913826  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:45.914469  6179 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:45.879213  6283 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:20:45.916213  6274 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:45.916883  6158 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:45.918069  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:45.945787  6297 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:45.880484  6289 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:45.946566  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:45.918660  6097 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:45.947870  6097 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:45.922533  4406 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:45.879401  6253 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:45.949702  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:45.950105  4255 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:20:45.950526  6162 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:20:45.880270  6230 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:45.886099  6267 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.939818  6251 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:45.943540  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:45.907557  6232 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.942143  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.999899  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 67311.9us
I20260709 12:20:45.853950  6246 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:45.915815  6279 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:45.951869  6280 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:45.975059  4331 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:46.015060  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 162701us
I20260709 12:20:46.019565  6239 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.020478  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:46.003780  6280 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.992190  6240 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:20:46.001354  6230 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:46.157066  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 213621us
W20260709 12:20:46.022222  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 57563.1us
I20260709 12:20:46.133790  6239 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.158130  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.171209  4332 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:46.159189  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:46.168509  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:46.183909  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.206645  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:46.206975  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.207324  4257 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
W20260709 12:20:46.190387  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.913187  4153 rpcz_store.cc:276] 0709 12:20:43.842891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.843116 (+   225us) service_pool.cc:224] Handling call
0709 12:20:45.901052 (+2057936us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:44.696043 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:44.790609 (+ 94566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:44.793768 (+  3159us) write_op.cc:435] Acquired schema lock
0709 12:20:44.796067 (+  2299us) tablet.cc:662] Decoding operations
0709 12:20:44.831401 (+ 35334us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:44.833560 (+  2159us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:44.844340 (+ 10780us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:44.873030 (+ 28690us) tablet.cc:701] Row locks acquired
0709 12:20:44.879406 (+  6376us) write_op.cc:260] PREPARE: finished
0709 12:20:44.896499 (+ 17093us) write_op.cc:270] Start()
0709 12:20:44.924471 (+ 27972us) write_op.cc:276] Timestamp: P: 1783599644893396 usec, L: 0
0709 12:20:44.927385 (+  2914us) op_driver.cc:348] REPLICATION: starting
0709 12:20:45.041879 (+114494us) log.cc:844] Serialized 530 byte log entry
0709 12:20:45.808698 (+766819us) op_driver.cc:464] REPLICATION: finished
0709 12:20:45.873935 (+ 65237us) write_op.cc:301] APPLY: starting
0709 12:20:45.874021 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:45.874128 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:45.896715 (+ 22587us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:45.896964 (+   249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:45.897136 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:20:45.897190 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:45.897368 (+   178us) log.cc:844] Serialized 23 byte log entry
0709 12:20:45.897531 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.897636 (+   105us) write_op.cc:454] Released schema lock
0709 12:20:45.897671 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:45.898027 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.898054 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":58580,"apply.run_cpu_time_us":1716,"apply.run_wall_time_us":24084,"num_ops":1,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":4430,"prepare.run_wall_time_us":376376,"replication_time_us":881091,"thread_start_us":26028,"threads_started":1}]]}
I20260709 12:20:46.044374  6219 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.156240  6251 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.206317  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:46.127487  6221 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:20:46.133193  6296 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:20:46.216220  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 238744us
I20260709 12:20:46.038189  6264 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.165470  6280 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.221236  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:46.033736  6279 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.156358  6272 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.173682  6289 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.212904  4247 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:46.209674  6250 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.004422  6232 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.003841  6097 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:46.212848  6163 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:46.216845  6060 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.173558  6158 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 12:20:46.265920  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.219259  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:46.173892  6274 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:20:46.220724  6141 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:46.257087  4297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.003s
I20260709 12:20:46.222491  6251 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.218151  6219 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.215107  6202 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:20:46.202297  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 352) took 1102 ms. Trace:
W20260709 12:20:46.267148  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 98710.1us
I20260709 12:20:46.371778  6230 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:46.529994  6308 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:20:46.275092  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.283968  6258 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 12:20:46.259886  6250 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.693116  6308 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.290900  4331 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:20:46.682535  6220 consensus_meta.cc:287] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.001s
I20260709 12:20:46.701385  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2100) took 1310 ms. Trace:
I20260709 12:20:46.693351  6230 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:46.514119  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.694079  4248 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:20:46.652166  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:46.305614  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 84456.2us
I20260709 12:20:46.283326  4149 catalog_manager.cc:5697] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:46.581156  6301 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:20:46.753190  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:46.367321  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 351155us
W20260709 12:20:46.695161  4297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.016s	sys 0.008s
I20260709 12:20:46.577713  6307 raft_consensus.cc:1064] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
W20260709 12:20:46.311872  6286 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:20:46.750404  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:46.693135  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.701687  4331 rpcz_store.cc:276] 0709 12:20:45.390781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.391040 (+   259us) service_pool.cc:224] Handling call
0709 12:20:45.404769 (+ 13729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.873823 (+469054us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540008e920. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cfc06f 00007fdbb0d74f60 00007fdbb0d767de 00007fdbb0d80b49 00007fdbb0d81416 00007fdbb0d7dd8f 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62
0709 12:20:46.701112 (+827289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.701337 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313293184}
W20260709 12:20:46.471722  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 249961us
I20260709 12:20:46.273240  4992 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:46.283802  6246 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.754796  6274 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:46.745967  4988 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:46.418565  6264 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.410000  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 738) took 1188 ms. Trace:
I20260709 12:20:46.760447  4149 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.595753  6158 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:46.771736  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.797943  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.799610  6197 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.800443  6197 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.800789  6308 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.801530  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.801713  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.801867  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.802265  4330 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:46.803328  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.468822  6241 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:46.410866  6239 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.284026  6305 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.274268  6302 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:46.245461  6279 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.590103  6240 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:46.775058  4149 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:46.707325  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.770679  6274 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.789291  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.791047  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.791435  6310 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.791958  6141 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.792045  6314 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:46.795383  4983 rpcz_store.cc:276] 0709 12:20:45.221847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.221982 (+   135us) service_pool.cc:224] Handling call
0709 12:20:46.380197 (+1158215us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54006aefd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:46.409909 (+ 29712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784331136}
I20260709 12:20:46.468531  6273 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:46.238389  6272 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.805050  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.575837  6232 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:46.375357  4250 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:46.860481  6274 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:46.861346  4250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1632) took 2035 ms (client timeout 2078 ms). Trace:
I20260709 12:20:46.847908  6310 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:46.861855  4250 rpcz_store.cc:269] 0709 12:20:44.826127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.833005 (+  6878us) service_pool.cc:224] Handling call
0709 12:20:45.614239 (+781234us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:45.755565 (+141326us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59e9c 00007fdbadc59a5b 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:46.861280 (+1105715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53346304}
I20260709 12:20:46.864406  6310 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.814186  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.839720  6302 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.258759  6289 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:46.867846  6302 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.841485  6240 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.287575  6060 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.871898  6060 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.325060  6300 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.506s
W20260709 12:20:46.833088  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 79986.3us
I20260709 12:20:46.874366  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:46.875864  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:46.876228  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1587) took 1438 ms. Trace:
I20260709 12:20:46.877158  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:46.878618  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:46.836546  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.880106  4325 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:46.311728  6163 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:46.842581  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51611.4us
I20260709 12:20:46.881511  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.882722  6163 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.883714  4333 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:46.807140  6267 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:46.809770  6197 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.887481  6289 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:46.888171  6289 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.809806  6158 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.889463  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:46.890293  4332 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:46.890763  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:46.832469  6239 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:46.855839  6273 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.858029  6279 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.829602  6179 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:46.860424  6219 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.817899  6308 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:46.891067  6158 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:46.853482  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48499.7us
I20260709 12:20:46.945034  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.892096  6060 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.860832  6162 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.894804  6141 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:46.876801  4248 rpcz_store.cc:276] 0709 12:20:45.438268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.439154 (+   886us) service_pool.cc:224] Handling call
0709 12:20:45.769336 (+330182us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:45.769603 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.752381 (+982778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.875875 (+123494us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b5400120f54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:46.876113 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174346880}
I20260709 12:20:46.808225  6264 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.871048  6240 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.849206  6305 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:46.952392  4371 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.958817  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.934456  6306 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:46.941807  6274 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:46.969158  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.967473  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:46.942255  6179 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.949661  6308 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:20:46.979190  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 97746.3us
I20260709 12:20:46.985265  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:46.986219  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.987814  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:46.916361  6311 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 12:20:46.850337  6241 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.001106  6241 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.001720  6241 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:47.002089  6241 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:46.993451  6267 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.004487  6267 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.004896  6267 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.006202  6244 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.006655  6244 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.007005  6244 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:46.983521  6253 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.008239  6253 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.008757  6272 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:46.691828  4409 rpcz_store.cc:276] 0709 12:20:45.099881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.728514 (+628633us) service_pool.cc:224] Handling call
0709 12:20:45.729181 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.729388 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:45.729709 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 12:20:45.916263 (+186554us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b180032ef00. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:20:46.125080 (+208817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:46.127532 (+  2452us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:46.151621 (+ 24089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.156730 (+  5109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.172718 (+ 15988us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":8946,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1489,"spinlock_wait_cycles":4166912,"thread_start_us":291805,"threads_started":2,"wal-append.queue_time_us":144450,"wal-append.run_cpu_time_us":926,"wal-append.run_wall_time_us":1014949}
I20260709 12:20:47.010728  6253 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.011356  6240 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.013870  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2109) took 1081 ms. Trace:
I20260709 12:20:47.014365  6244 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.933848  6239 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.986001  4407 raft_consensus.cc:2376] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3. Re-sending same reply.
I20260709 12:20:47.017011  6264 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.014457  4327 rpcz_store.cc:276] 0709 12:20:45.932274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.000208 (+ 67934us) service_pool.cc:224] Handling call
0709 12:20:46.127315 (+127107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.211402 (+ 84087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.213409 (+  2007us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:46.286562 (+ 73153us) log.cc:844] Serialized 26 byte log entry
0709 12:20:46.806098 (+519536us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:46.816087 (+  9989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.826988 (+ 10901us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.013435 (+186447us) raft_consensus.cc:1685] finished
0709 12:20:47.013468 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.013778 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19829,"raft.queue_time_us":52841,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5141,"thread_start_us":379526,"threads_started":1,"wal-append.queue_time_us":537966}
I20260709 12:20:47.018910  6246 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:47.019016  6251 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:47.019404  6246 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:46.973117  6289 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.020272  6246 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.021493  6246 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.943663  6273 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.966049  6202 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:46.995584  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:47.032698  4408 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:46.996033  4248 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:20:47.032855  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 46754.1us
I20260709 12:20:47.007136  6307 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:46.955338  6197 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:46.966156  6306 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:47.025087  4406 raft_consensus.cc:2376] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2. Re-sending same reply.
W20260709 12:20:47.026022  4256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.020s
I20260709 12:20:47.033572  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:47.037350  4256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.020s
I20260709 12:20:46.987092  6302 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:47.044905  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 294553us
I20260709 12:20:47.032176  6097 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:47.046608  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.046720  6097 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.047461  6313 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.047164  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.048928  6097 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.049371  6313 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.050206  6197 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:47.050396  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.051183  6197 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:47.052037  6313 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.052382  6267 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.054483  6267 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:47.055084  6279 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.051528  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:46.983994  6163 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:46.970270  6305 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.056473  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.058336  6305 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:46.992127  6310 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.059728  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.060071  6308 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.061077  4402 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:47.059577  6257 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.015767  6250 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.063787  6257 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.002982  6241 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.064956  6241 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.065852  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.067134  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.073800  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.076299  4403 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:20:47.078167  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.078871  4403 raft_consensus.cc:2393] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:47.079877  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.113782  4402 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:47.114585  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:47.114743  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49000.9us
W20260709 12:20:47.118360  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 71846.6us
I20260709 12:20:47.121253  6313 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.121981  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:47.122601  6279 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.123835  6317 raft_consensus.cc:2764] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:20:47.124476  6257 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:47.125434  6257 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:47.125752  6257 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:47.125963  4402 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:47.126482  6257 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:47.132604  6257 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.132900  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:47.133549  4402 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:47.135398  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.124485  6264 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:20:47.044298  6306 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:46.980907  6274 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.122324  6251 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:47.116204  6202 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.143375  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.143989  4248 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:47.144028  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.144680  4254 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:47.145036  6310 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:20:47.145614  6304 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.860s	user 0.009s	sys 0.008s
I20260709 12:20:47.115924  6232 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.146265  6310 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:47.146733  6310 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:47.140868  6163 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.139335  6317 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.148758  6317 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.146279  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.150180  4247 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:47.145519  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.154335  4408 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:47.152592  4152 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 383) took 1665 ms. Trace:
I20260709 12:20:47.154137  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:47.136324  6244 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.156844  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:47.161896  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 239584us
W20260709 12:20:47.140027  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.162706  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:47.163763  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 174821us
W20260709 12:20:47.164696  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 273967us
I20260709 12:20:47.167143  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:47.169137  4402 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:47.169234  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.173102  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.173874  4403 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:47.174636  4988 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:47.177119  4988 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:20:47.181444  4250 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:47.177039  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.181738  6310 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.183109  6310 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.183828  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.154997  6158 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:47.185396  6330 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.185891  6330 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:47.186255  6330 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.187520  4956 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.151369  6239 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.188776  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.190774  6158 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:47.190991  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.188717  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.195227  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:47.191265  6158 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:47.197039  6158 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.197912  4983 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:47.170526  6250 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.199836  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.191829  4400 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
W20260709 12:20:47.202953  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.204761  6232 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.204895  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.205500  4325 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:20:47.205289  6232 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.155867  4152 rpcz_store.cc:276] 0709 12:20:45.487121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.487318 (+   197us) service_pool.cc:224] Handling call
0709 12:20:47.152529 (+1665211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:45.929978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:45.930558 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:45.930591 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:20:45.930607 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:45.931045 (+   438us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:45.931107 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:45.931134 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:45.939364 (+  8230us) tablet.cc:701] Row locks acquired
0709 12:20:45.939379 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:20:45.947792 (+  8413us) write_op.cc:270] Start()
0709 12:20:45.947910 (+   118us) write_op.cc:276] Timestamp: P: 1783599645947707 usec, L: 0
0709 12:20:45.947932 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:45.949596 (+  1664us) log.cc:844] Serialized 907 byte log entry
0709 12:20:46.447680 (+498084us) op_driver.cc:464] REPLICATION: finished
0709 12:20:46.702732 (+255052us) write_op.cc:301] APPLY: starting
0709 12:20:46.756541 (+ 53809us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:46.803653 (+ 47112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:46.839553 (+ 35900us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:46.966540 (+126987us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:46.989936 (+ 23396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:20:46.997388 (+  7452us) write_op.cc:312] APPLY: finished
0709 12:20:46.997689 (+   301us) log.cc:844] Serialized 29 byte log entry
0709 12:20:46.997914 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.998036 (+   122us) write_op.cc:454] Released schema lock
0709 12:20:46.998075 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:46.998486 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:46.998526 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":224457,"apply.run_cpu_time_us":2923,"apply.run_wall_time_us":302895,"num_ops":2,"prepare.queue_time_us":103686,"prepare.run_cpu_time_us":3347,"prepare.run_wall_time_us":25342,"replication_time_us":470453,"thread_start_us":262571,"threads_started":2}]]}
I20260709 12:20:47.206761  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.165060  6302 raft_consensus.cc:2764] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:47.170662  6240 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.164227  6317 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.217130  4956 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.214051  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.214910  6202 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:47.218297  4955 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.215718  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:47.218909  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.215188  6321 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:47.223729  6141 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.224190  6141 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.224555  6141 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.226719  6274 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.227466  6267 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.227885  6267 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.228207  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.229897  6273 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.231675  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.227438  6253 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.232755  6240 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:47.233484  6253 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.234918  6240 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.211318  6237 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:20:47.235948  6179 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.236260  6253 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:47.239727  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.228238  6267 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.239888  4400 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:20:47.243626  6274 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:47.244259  6274 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:47.244539  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:47.245687  4372 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.227447  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:47.246556  4331 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.246999  6237 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:47.247438  6237 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.247747  6237 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:47.248489  4407 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
W20260709 12:20:47.217326  6280 consensus_meta.cc:287] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.966s	user 0.012s	sys 0.001s
I20260709 12:20:47.212608  6326 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.209836  6264 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.260888  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.262594  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 44397us
I20260709 12:20:47.270584  4955 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.266281  4331 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:47.270957  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.271704  6319 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.272178  6319 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.272642  6319 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.288260  6311 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:20:47.299393  6322 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:20:47.311792  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 104585us
I20260709 12:20:47.313011  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.320381  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1586) took 1888 ms. Trace:
W20260709 12:20:47.320875  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50384.5us
I20260709 12:20:47.321326  6273 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:47.320386  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 104746us
W20260709 12:20:47.322964  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 104286us
I20260709 12:20:47.323606  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:47.323819  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:47.320461  4401 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:47.324481  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:47.332828  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:47.333225  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.334021  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.334602  4252 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:47.334055  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.335949  4406 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:47.341288  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.328348  4325 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:47.263899  6202 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:47.341876  4256 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:47.349490  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:47.353307  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:47.353741  4254 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.354368  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.354460  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:47.270426  6179 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.359623  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:47.322690  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.357368  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.365792  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.363569  4153 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.366545  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.362895  6250 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.368395  6250 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:47.368896  6250 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.321784  6237 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.380826  4406 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:47.376169  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.340093  6328 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.378168  4149 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 387) took 2367 ms. Trace:
I20260709 12:20:47.379642  6312 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.269797  6280 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:47.382892  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.243283  6141 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:47.384690  4218 leader_election.cc:336] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.865s (SENT)
I20260709 12:20:47.396199  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:47.385139  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 72258.7us
I20260709 12:20:47.350236  6163 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.320885  4255 rpcz_store.cc:276] 0709 12:20:45.431932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.471917 (+ 39985us) service_pool.cc:224] Handling call
0709 12:20:45.803006 (+331089us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:45.821841 (+ 18835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.950530 (+128689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.320091 (+1369561us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002b5cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:47.320310 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398541824}
I20260709 12:20:47.392465  4409 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:47.408720  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.389344  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.410606  4332 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:47.341415  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.363472  6244 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.386379  6232 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.394937  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.395599  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.397156  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.400084  6331 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.386783  6317 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.401459  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.402163  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:47.402442  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.375458  6307 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.330507  6264 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.404534  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.265444  6302 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:47.405468  6237 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.411546  4248 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:47.428491  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.419184  4989 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:47.427416  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.387745  4149 rpcz_store.cc:276] 0709 12:20:44.995133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.995282 (+   149us) service_pool.cc:224] Handling call
0709 12:20:45.620253 (+624971us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:47.362911 (+1742658us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:47.148479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:47.149077 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:47.149118 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:20:47.149138 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:47.149747 (+   609us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:47.149815 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:47.149845 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:20:47.150198 (+   353us) tablet.cc:701] Row locks acquired
0709 12:20:47.150222 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:20:47.150396 (+   174us) write_op.cc:270] Start()
0709 12:20:47.150549 (+   153us) write_op.cc:276] Timestamp: P: 1783599647150343 usec, L: 0
0709 12:20:47.150572 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:20:47.190289 (+ 39717us) log.cc:844] Serialized 1294 byte log entry
0709 12:20:47.204929 (+ 14640us) op_driver.cc:464] REPLICATION: finished
0709 12:20:47.227287 (+ 22358us) write_op.cc:301] APPLY: starting
0709 12:20:47.227399 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:47.227542 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:47.227644 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:47.228168 (+   524us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:47.228365 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:20:47.228418 (+    53us) write_op.cc:312] APPLY: finished
0709 12:20:47.228667 (+   249us) log.cc:844] Serialized 35 byte log entry
0709 12:20:47.228840 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.228945 (+   105us) write_op.cc:454] Released schema lock
0709 12:20:47.228984 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:47.229334 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.229363 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":166441728,"child_traces":[["op",{"apply.queue_time_us":1962,"apply.run_cpu_time_us":2042,"apply.run_wall_time_us":12921,"num_ops":3,"prepare.queue_time_us":205978,"prepare.run_cpu_time_us":3906,"prepare.run_wall_time_us":42154,"replication_time_us":54209,"spinlock_wait_cycles":32000,"thread_start_us":135204,"threads_started":1}]]}
I20260709 12:20:47.468794  4254 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:47.427416  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.461876  6244 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.473434  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:47.473739  6244 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.419485  4334 raft_consensus.cc:2393] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:47.414930  4250 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:47.403682  6312 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:47.480517  6312 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.464208  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.465070  6241 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.465276  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.464960  6331 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.350839  6319 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.459546  4249 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:47.485065  4987 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:47.470826  4984 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:47.471895  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:47.486053  4331 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:20:47.472276  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.471853  6332 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:20:47.488058  6331 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.481600  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:47.483558  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 78487.2us
I20260709 12:20:47.489256  4332 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
W20260709 12:20:47.470661  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 85993.2us
I20260709 12:20:47.486968  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:47.484567  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 129272us
I20260709 12:20:47.402938  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.492787  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.490041  4219 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.392781  6328 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:47.420295  6141 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:47.494019  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:47.509351  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 112233us
I20260709 12:20:47.509902  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:47.414930  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.415799  6280 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.506069  4331 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:20:47.484694  6060 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.519675  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:47.513643  4372 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.521426  4330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:20:47.522212  4330 raft_consensus.cc:606] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.510537  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.527669  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.528291  4987 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:47.528990  4988 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:47.529073  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:47.511744  4986 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:47.524391  6162 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:47.507380  6311 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.532310  6158 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.422144  6306 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:47.425082  6267 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.554473  6267 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:47.420687  6163 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.556525  6163 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.539950  6060 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.542635  6300 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:47.557582  6300 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:47.558269  6330 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.558516  6300 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.520411  6219 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.559389  4990 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:47.559553  6219 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.559984  6219 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.561439  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.562564  4328 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:47.532770  6279 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:47.563556  6279 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.563949  6279 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.471020  6317 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:47.566660  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.543675  4331 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:47.422482  6202 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.568717  4151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 367) took 1818 ms. Trace:
I20260709 12:20:47.569262  4151 rpcz_store.cc:276] 0709 12:20:45.749914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.750055 (+   141us) service_pool.cc:224] Handling call
0709 12:20:47.568620 (+1818565us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23653,"reported_tablets":1}
I20260709 12:20:47.546500  6308 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:47.543780  6338 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:20:47.543928  6321 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:20:47.548410  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.542346  4983 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:47.549686  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.542225  4250 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:47.551733  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.552032  4992 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:47.532402  6311 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.552817  6306 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.532367  6162 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.504204  6310 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:47.585391  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.575764  4153 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 4 to 5, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 5 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.576759  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:47.637352  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 60699.7us
W20260709 12:20:47.638006  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.638583  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.508785  6328 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:47.597441  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 86995.9us
I20260709 12:20:47.402647  6274 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:47.599869  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 278034us
I20260709 12:20:47.642745  4330 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:47.608522  4984 raft_consensus.cc:2368] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:47.546514  6250 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.648010  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.640202  4153 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 4, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:47.630723  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 103852us
I20260709 12:20:47.632164  4986 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:47.650041  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.650535  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.647042  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:47.647189  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:47.633234  6311 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:47.636338  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51007.7us
I20260709 12:20:47.645637  6141 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:47.649138  4153 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 5 to 6, VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131) evicted. New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:47.654325  4371 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.633935  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.656090  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:47.657419  6253 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:47.658288  6264 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:47.660116  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.669799  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.661386  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.671728  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:47.672326  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:47.646211  6258 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:47.643821  6267 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:47.673465  4153 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 3, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 3 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.653138  6313 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:47.651494  6326 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.651713  6257 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:47.674279  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:47.641922  6310 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.694118  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.701215  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.654877  6244 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.702978  4325 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:47.675817  6340 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.681173  6273 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.692937  6338 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:47.692792  6306 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.682189  6313 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.682345  6331 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.676589  4988 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:47.706941  6305 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:47.692577  6253 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:47.712280  6321 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:47.702884  6237 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.678138  6202 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.732513  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.673246  6239 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:20:47.701241  6317 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.719353  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.716334  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.722736  6319 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.707485  6267 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:47.721072  6313 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.741394  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.706542  4325 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:47.721566  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.732273  6330 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:47.733312  6237 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.743515  4325 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:47.739543  6306 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:47.742409  6241 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:47.761294  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.762415  6279 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.767627  4325 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.760260  6237 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.744227  6250 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.745111  6305 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.751919  6253 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.775359  6241 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:47.775527  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.776119  6289 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:47.796895  6279 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.807569  6267 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:47.813428  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.765650  4327 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:47.783537  6310 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.821213  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.809584  6241 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.835145  6264 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:47.835716  6264 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:47.836622  6264 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.837980  6264 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.751931  6317 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:20:47.839443  4325 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:20:47.822643  6344 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:20:47.822118  6305 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.851337  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:47.839635  6289 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:47.864634  6306 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:47.865095  6306 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:47.865489  6306 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:47.868948  6244 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.870563  6279 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:47.871006  6279 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:47.871840  6279 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.870832  6219 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.881978  6312 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.882836  6162 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.883527  6219 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.883989  6312 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.872992  6279 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.886672  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.887827  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.888392  6179 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:47.888499  6326 raft_consensus.cc:2764] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:20:47.888847  6179 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:47.889254  6179 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.895404  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.889318  6326 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:47.913360  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.913812  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.899953  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.870615  6313 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.928588  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:47.929265  4984 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:47.929836  6313 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:47.931563  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:47.932320  4985 raft_consensus.cc:2393] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:47.932179  6328 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.933701  6179 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:47.934747  6328 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:47.936570  4296 connection.cc:256] RPC call timeout handler was delayed by -1.2532764269999461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 12:20:47.945225  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:47.946426  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 268600us
I20260709 12:20:47.845846  6311 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.950443  6060 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:47.953991  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:47.947886  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.959971  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:47.977757  6338 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:47.978394  6338 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:47.979579  6338 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:47.983698  6179 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:47.992126  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 297550us
I20260709 12:20:47.995090  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:47.948237  6289 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:47.947034  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:47.997776  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.996071  6338 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:47.957695  6329 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:48.012514  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:47.962124  6326 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:48.015337  6240 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.015887  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 344199us
I20260709 12:20:47.996658  6280 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:48.025149  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:20:48.026722  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 280377us
I20260709 12:20:48.028023  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:48.012395  6329 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:47.996754  6297 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:20:48.031471  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 377114us
I20260709 12:20:48.017009  6326 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:48.040331  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:48.047247  4406 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.025348  4992 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:48.025507  6280 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.049863  6280 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:48.009826  6289 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:48.035063  6230 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.083823  4988 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:48.083979  6297 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:48.045903  6317 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:48.047721  6253 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:48.033131  6349 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:20:48.037667  6312 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:48.111619  6312 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.111441  6329 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:48.112303  6312 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:48.037524  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:48.091399  6302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60130 (request call id 94) took 3412 ms. Trace:
I20260709 12:20:48.046690  6346 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:20:48.094645  6305 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:48.026561  6241 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:48.030954  6240 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:48.047451  6219 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:20:48.045888  6340 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.053857  6326 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:48.126947  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.168850  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 116690us
I20260709 12:20:48.127657  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:48.129011  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 92620.9us
I20260709 12:20:48.170285  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:48.130946  4984 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:48.110402  6317 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:48.099213  6230 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:48.107465  6253 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.139511  6329 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:48.194857  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 67319.3us
I20260709 12:20:48.197350  6251 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:48.197415  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:48.197818  6251 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.198081  4254 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:48.198170  6251 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:48.198693  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:48.148036  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.129791  4325 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:48.172925  4249 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:48.131726  6305 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:48.185421  4329 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:48.189847  4248 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:48.168216  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:48.203734  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:48.204906  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:48.210206  4402 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:48.205497  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:48.205801  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:48.206475  4400 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:48.206988  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:48.212149  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:48.214493  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:48.215533  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:48.134732  6328 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:20:48.217114  4401 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:48.217850  4256 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:48.240588  4405 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:48.180442  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:48.169170  6340 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:48.274510  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:48.383440  4253 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:20:48.383859  6251 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:48.317842  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:48.384896  4987 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:48.386268  6362 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:20:48.386499  6251 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:48.210326  6311 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:48.313037  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 101350us
I20260709 12:20:48.278781  6330 raft_consensus.cc:2764] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:48.191632  6253 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.348284  4406 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:48.316845  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:48.301409  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:48.348910  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:48.274875  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:48.278409  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:48.349120  6365 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:20:48.805799  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:48.806530  4404 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:48.808276  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:48.396483  4984 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.809120  4333 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:48.667809  4985 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:48.790696  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:48.209527  6221 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:20:48.763943  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.573904  4987 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:48.323611  6349 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.802857  6310 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:48.673923  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:48.637182  6264 consensus_meta.cc:287] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.001s
W20260709 12:20:48.776820  4991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.013s	sys 0.017s
I20260709 12:20:48.801196  4254 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:48.804973  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:48.387909  6356 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:20:48.390844  6289 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:48.124821  6302 rpcz_store.cc:276] 0709 12:20:44.679433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.679609 (+   176us) service_pool.cc:224] Handling call
0709 12:20:44.812797 (+133188us) log.cc:844] Serialized 487 byte log entry
0709 12:20:45.426629 (+613832us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180032ef60. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:20:48.080409 (+2653780us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3347,"raft.run_cpu_time_us":10244,"raft.run_wall_time_us":205375,"spinlock_wait_cycles":2860416,"thread_start_us":252022,"threads_started":1,"wal-append.queue_time_us":394972,"wal-append.run_cpu_time_us":2118,"wal-append.run_wall_time_us":1085028}
W20260709 12:20:48.614470  6338 consensus_meta.cc:287] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.002s
I20260709 12:20:48.803520  6375 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:48.209333  6179 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.691s
W20260709 12:20:48.880695  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.011s	sys 0.003s
W20260709 12:20:48.472426  6306 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.014s
I20260709 12:20:48.397558  6163 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.487s
I20260709 12:20:48.463462  6240 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:48.887737  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:48.348785  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:48.803758  6371 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:48.380142  6241 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:48.805388  6312 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.000s
I20260709 12:20:48.340540  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:48.238714  6230 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:48.888648  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:48.897944  4984 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:48.620107  6274 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:48.278648  6272 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:48.426095  6328 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.465329  6361 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:48.341588  6313 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.611589  6279 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.726s	user 0.013s	sys 0.009s
W20260709 12:20:48.820446  6060 consensus_meta.cc:287] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.858s	user 0.011s	sys 0.010s
I20260709 12:20:48.799202  6360 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:20:49.168571  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 279984us
W20260709 12:20:49.160176  6329 consensus_meta.cc:287] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.960s	user 0.010s	sys 0.000s
I20260709 12:20:48.605337  6197 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.137224  6353 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.925432  6244 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.165392  6280 consensus_meta.cc:287] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.112s	user 0.007s	sys 0.011s
I20260709 12:20:49.164075  6274 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:49.175130  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:48.882475  6346 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.888022  4986 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:49.166847  6272 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.124817  6352 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.186213  4404 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:20:49.174757  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.011s	sys 0.003s
I20260709 12:20:49.262115  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8afcac1f47834987ac3889edd37f61a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:49.052259  6273 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:48.805464  6345 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:20:49.177597  6326 consensus_meta.cc:287] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.998s	user 0.009s	sys 0.001s
I20260709 12:20:49.190079  6280 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.189640  4990 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:49.174440  6339 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:49.187067  6197 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.172297  6060 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:49.215449  4297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.004s	sys 0.016s
I20260709 12:20:49.168732  6312 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.188027  4255 raft_consensus.cc:2368] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4.
I20260709 12:20:48.890087  6310 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.219585  6219 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.303052  4250 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:48.889910  6349 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.221649  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.221796  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:48.559208  6162 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.177687  6179 consensus_queue.cc:1243] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:20:49.020215  6330 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:48.923319  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:49.229559  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:49.229684  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:49.180560  6340 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:49.222011  6230 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:49.213271  4992 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:48.606592  4409 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:48.923552  6351 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.190835  6244 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.193511  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:49.239614  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.231738  4333 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:49.244093  4408 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:49.229876  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.201174  6264 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.253975  4987 raft_consensus.cc:2955] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:49.173708  6313 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.168509  6371 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.173789  6328 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:49.177469  6306 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.233109  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:49.179991  6360 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.188274  6353 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.177767  6375 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.216799  6346 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:49.278321  6361 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:49.789731  6264 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.278209  6321 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.512s
I20260709 12:20:49.790510  4247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1598) took 2292 ms. Trace:
I20260709 12:20:49.791766  6321 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:49.790910  4247 rpcz_store.cc:276] 0709 12:20:47.497942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.503386 (+  5444us) service_pool.cc:224] Handling call
0709 12:20:47.611329 (+107943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:47.646621 (+ 35292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:47.651874 (+  5253us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:47.695571 (+ 43697us) log.cc:844] Serialized 26 byte log entry
0709 12:20:48.091839 (+396268us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:48.185103 (+ 93264us) log.cc:844] Serialized 14 byte log entry
0709 12:20:48.617403 (+432300us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b48002a0558. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:20:48.790981 (+173578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.791100 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.790193 (+999093us) raft_consensus.cc:1685] finished
0709 12:20:49.790300 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.790450 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2955,"prepare.queue_time_us":237411,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":11380,"raft.run_cpu_time_us":3064,"raft.run_wall_time_us":402385,"spinlock_wait_cycles":82210176,"thread_start_us":390807,"threads_started":2,"wal-append.queue_time_us":608638}
I20260709 12:20:49.793109  6346 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.793219  6326 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.793774  6346 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:49.793816  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.794380  4332 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:49.370859  6359 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:49.795442  6326 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.251940  6289 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:49.795835  6359 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.796478  6289 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.792461  6321 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.219650  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 573) took 1329 ms. Trace:
W20260709 12:20:49.833345  4248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1645) took 1621 ms (client timeout 1620 ms). Trace:
I20260709 12:20:49.834235  4256 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:49.835539  4333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 449) took 1613 ms (client timeout 1852 ms). Trace:
W20260709 12:20:49.791180  4249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 436) took 1512 ms (client timeout 1940 ms). Trace:
I20260709 12:20:49.350200  6317 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:49.848114  4248 rpcz_store.cc:269] 0709 12:20:48.211638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.221282 (+1009644us) service_pool.cc:224] Handling call
0709 12:20:49.833273 (+611991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.244858  6251 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:49.332360  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.872822  4253 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:49.873440  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:20:49.873632  4253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1646) took 1258 ms (client timeout 1597 ms). Trace:
W20260709 12:20:49.874292  4253 rpcz_store.cc:269] 0709 12:20:48.615101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.248839 (+633738us) service_pool.cc:224] Handling call
0709 12:20:49.873563 (+624724us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:49.842600  4297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.343s	user 0.009s	sys 0.019s
I20260709 12:20:49.876269  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:49.876972  4334 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:49.491067  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7935718b80b24232b822244ef31fa44b"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:49.878539  4404 raft_consensus.cc:606] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:49.231079  6373 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.865264  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:49.893637  4984 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:49.865924  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:49.866022  4333 rpcz_store.cc:269] 0709 12:20:48.222415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.222553 (+   138us) service_pool.cc:224] Handling call
0709 12:20:49.835466 (+1612913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.449808  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:49.865700  4249 rpcz_store.cc:269] 0709 12:20:48.278558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.229635 (+951077us) service_pool.cc:224] Handling call
0709 12:20:49.791119 (+561484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.896377  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.844853  4985 raft_consensus.cc:2368] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4.
I20260709 12:20:49.879098  4404 raft_consensus.cc:614] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:49.273792  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:49.248214  6374 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:49.899894  4402 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:49.270128  6272 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:49.903967  4333 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:49.894634  4989 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:20:49.918936  4989 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:49.900648  4401 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:49.275004  6279 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.866765  6221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.015s	sys 0.030s
I20260709 12:20:49.911037  4331 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:49.332850  6337 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:49.652591  6302 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.795197  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.319986  6380 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:49.863336  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1601) took 1675 ms. Trace:
W20260709 12:20:49.772282  6378 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 12:20:49.913609  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:49.666143  6257 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.847699  6300 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.352232  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:49.919261  4989 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:49.911120  4405 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:49.919786  4256 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:20:49.964383  4256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1605) took 1724 ms (client timeout 1846 ms). Trace:
I20260709 12:20:49.923941  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:49.965443  4253 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:49.777019  6253 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.316s	user 0.006s	sys 0.003s
W20260709 12:20:49.964778  4256 rpcz_store.cc:269] 0709 12:20:48.240121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.221541 (+981420us) service_pool.cc:224] Handling call
0709 12:20:49.964325 (+742784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.843777  6339 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.773733  6338 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:49.766825  6163 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:49.848183  6179 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:49.973028  4327 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:49.892298  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 764) took 1031 ms. Trace:
I20260709 12:20:49.847332  6345 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:49.870862  4250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1644) took 1668 ms (client timeout 1928 ms). Trace:
I20260709 12:20:49.966720  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:49.971421  6300 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.974968  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:49.975453  6253 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.976333  6312 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.976902  4253 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:49.977934  6197 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.979568  6280 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:49.984807  4986 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:20:49.985334  6382 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:49.989087  6383 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:49.910635  6373 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.869958  6162 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.991194  6385 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:49.940026  6384 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:20:49.937429  6221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.015s	sys 0.030s
I20260709 12:20:49.915534  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1469) took 1352 ms. Trace:
I20260709 12:20:49.940415  4255 rpcz_store.cc:276] 0709 12:20:48.188126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.191452 (+  3326us) service_pool.cc:224] Handling call
0709 12:20:49.863238 (+1671786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:49.924455  6374 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.992833  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:49.938813  6279 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.892892  6330 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.277799  6352 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.994926  6310 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.847837  4991 rpcz_store.cc:276] 0709 12:20:47.890097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.899803 (+  9706us) service_pool.cc:224] Handling call
0709 12:20:47.900126 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.900345 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:20:48.106807 (+206462us) log.cc:844] Serialized 14 byte log entry
0709 12:20:49.167570 (+1060763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:49.171668 (+  4098us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:49.175571 (+  3903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.184116 (+  8545us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.219544 (+ 35428us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298670,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":4602,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7441,"thread_start_us":1201009,"threads_started":2,"wal-append.queue_time_us":480190,"wal-append.run_cpu_time_us":5654,"wal-append.run_wall_time_us":1001294}
I20260709 12:20:49.997493  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 433) took 1795 ms. Trace:
I20260709 12:20:49.998848  6313 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:50.000757  6321 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:50.001561  6305 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.002619  6306 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.300915  6273 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.968354  6337 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.005978  6328 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:50.008319  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.014180  6360 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:49.943444  6380 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.017139  6353 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:49.864485  6219 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:50.019730  4402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 375) took 1805 ms (client timeout 2005 ms). Trace:
I20260709 12:20:49.902166  6251 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:49.943007  6302 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.389868  4371 leader_election.cc:400] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4.
W20260709 12:20:50.381160  4402 rpcz_store.cc:269] 0709 12:20:48.214151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.214295 (+   144us) service_pool.cc:224] Handling call
0709 12:20:50.019487 (+1805192us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54002445d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:50.019666 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3863911808}
I20260709 12:20:50.388985  6398 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:50.022732  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1468) took 1460 ms. Trace:
I20260709 12:20:49.856072  6351 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:49.483740  6274 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:50.028229  6349 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:50.029469  4408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 376) took 1815 ms (client timeout 1852 ms). Trace:
I20260709 12:20:49.964287  4989 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.408864  4989 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:50.030532  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1778) took 1819 ms. Trace:
I20260709 12:20:50.035040  4331 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:49.795159  6346 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:50.036605  4401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1467) took 1474 ms (client timeout 1928 ms). Trace:
I20260709 12:20:50.038259  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1774) took 1856 ms. Trace:
I20260709 12:20:49.970510  6257 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:50.042088  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 234995us
W20260709 12:20:50.407979  4408 rpcz_store.cc:269] 0709 12:20:48.214445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.215102 (+   657us) service_pool.cc:224] Handling call
0709 12:20:50.029251 (+1814149us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000bb3d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:50.029391 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878194944}
I20260709 12:20:50.041121  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:50.055109  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 577) took 2145 ms. Trace:
W20260709 12:20:50.412298  4401 rpcz_store.cc:269] 0709 12:20:48.562140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.569254 (+  7114us) service_pool.cc:224] Handling call
0709 12:20:50.036401 (+1467147us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54002a80d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:50.036533 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704365312}
I20260709 12:20:50.426409  4990 rpcz_store.cc:276] 0709 12:20:47.894497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.895014 (+   517us) service_pool.cc:224] Handling call
0709 12:20:49.189229 (+1294215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.797263 (+608034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.039379 (+242116us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54005154d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:50.039538 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2880775936}
I20260709 12:20:50.413105  4332 rpcz_store.cc:276] 0709 12:20:48.182259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.182438 (+   179us) service_pool.cc:224] Handling call
0709 12:20:48.182698 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.794750 (+1612052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.037992 (+243242us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54003d4354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:50.038187 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3706179456}
I20260709 12:20:49.779217  6367 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:49.944033  6359 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:50.056296  4334 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:50.245186  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 767) took 1365 ms. Trace:
W20260709 12:20:50.229249  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 448459us
W20260709 12:20:50.235389  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.365931  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:50.362134  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 1.16867e+06us
I20260709 12:20:50.364595  4404 raft_consensus.cc:606] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:50.366566  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:50.036130  6339 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:50.364900  4257 rpcz_store.cc:276] 0709 12:20:48.202400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.202529 (+   129us) service_pool.cc:224] Handling call
0709 12:20:48.202805 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.217742 (+ 14937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.217773 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.820228 (+602455us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.274039 (+453811us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:49.274090 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.274157 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:49.997258 (+723101us) raft_consensus.cc:1685] finished
0709 12:20:49.997283 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:49.997428 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6728,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":57163,"thread_start_us":385419,"threads_started":1,"wal-append.queue_time_us":1032156}
I20260709 12:20:50.056514  6338 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:50.387902  6386 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.388175  6289 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.389284  6337 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:50.389169  6380 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.087721  6163 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:50.391209  4405 rpcz_store.cc:276] 0709 12:20:48.562506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.563433 (+   927us) service_pool.cc:224] Handling call
0709 12:20:48.800208 (+236775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.964001 (+1163793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.022412 (+ 58411us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000113d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:50.022643 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554408704}
I20260709 12:20:50.194908  6371 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.369603  6392 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.420672  4256 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:50.056298  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 450) took 1811 ms. Trace:
I20260709 12:20:50.375778  6360 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.435608  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:50.235845  6388 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:50.364281  6375 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.375999  6384 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.121394  6179 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.372972  6383 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:50.390259  4371 leader_election.cc:403] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:20:50.409675  4329 rpcz_store.cc:276] 0709 12:20:48.210790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.211762 (+   972us) service_pool.cc:224] Handling call
0709 12:20:48.220747 (+  8985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:48.221059 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:48.221084 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:48.807438 (+586354us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.483501 (+676063us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:49.483561 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.483657 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.030249 (+546592us) raft_consensus.cc:1685] finished
0709 12:20:50.030280 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.030446 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136700,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":68689,"thread_start_us":494033,"threads_started":1,"wal-append.queue_time_us":1067955}
I20260709 12:20:50.437184  4987 rpcz_store.cc:276] 0709 12:20:48.879940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.939918 (+ 59978us) service_pool.cc:224] Handling call
0709 12:20:48.940631 (+   713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.230347 (+289716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.230392 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.233313 (+  2921us) log.cc:844] Serialized 487 byte log entry
0709 12:20:49.253848 (+ 20535us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:49.866891 (+613043us) log.cc:844] Serialized 14 byte log entry
0709 12:20:50.244713 (+377822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.244839 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.244906 (+    67us) raft_consensus.cc:1685] finished
0709 12:20:50.244925 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.245106 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":521564,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":156,"thread_start_us":397656,"threads_started":2,"wal-append.queue_time_us":20492}
W20260709 12:20:51.051445  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 615952us
W20260709 12:20:50.627835  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.051280  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39902 (request call id 21) took 1076 ms. Trace:
I20260709 12:20:50.516746  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 435) took 2313 ms. Trace:
I20260709 12:20:51.089738  4253 raft_consensus.cc:2393] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:51.051119  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:50.579419  4331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 448) took 2355 ms (client timeout 2005 ms). Trace:
I20260709 12:20:51.050613  4326 rpcz_store.cc:276] 0709 12:20:48.245433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.245567 (+   134us) service_pool.cc:224] Handling call
0709 12:20:49.344475 (+1098908us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:49.344715 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.911638 (+566923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.911697 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:49.911754 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:49.911798 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.055955 (+144157us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540013cc54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:50.056027 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.056221 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325835904}
I20260709 12:20:50.397573  6306 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:20:50.498008  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 456936us
I20260709 12:20:50.401676  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 583) took 1113 ms. Trace:
I20260709 12:20:51.092494  4329 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:51.090999  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:51.092501  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 443) took 1312 ms. Trace:
I20260709 12:20:51.158851  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:51.106419  4404 rpcz_store.cc:276] 0709 12:20:49.974700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.974852 (+   152us) service_pool.cc:224] Handling call
0709 12:20:51.051219 (+1076367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.115646  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1613) took 1189 ms. Trace:
I20260709 12:20:51.091763  4252 rpcz_store.cc:276] 0709 12:20:48.202972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.813166 (+610194us) service_pool.cc:224] Handling call
0709 12:20:48.887668 (+ 74502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.239665 (+351997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.239711 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.245064 (+  5353us) log.cc:844] Serialized 26 byte log entry
0709 12:20:49.709774 (+464710us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:50.297246 (+587472us) log.cc:844] Serialized 14 byte log entry
0709 12:20:50.516269 (+219023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.516380 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.516446 (+    66us) raft_consensus.cc:1685] finished
0709 12:20:50.516464 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.516650 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":515351,"prepare.queue_time_us":771313,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":726711,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":74769,"thread_start_us":922628,"threads_started":3,"wal-append.queue_time_us":710692}
I20260709 12:20:50.700356  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:50.709957  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 438) took 1441 ms. Trace:
W20260709 12:20:50.362116  4250 rpcz_store.cc:269] 0709 12:20:48.202057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.205473 (+  3416us) service_pool.cc:224] Handling call
0709 12:20:49.864247 (+1658774us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:51.154199  4331 rpcz_store.cc:269] 0709 12:20:48.215143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.215322 (+   179us) service_pool.cc:224] Handling call
0709 12:20:50.569841 (+2354519us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54002521d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:50.570013 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3889340672}
I20260709 12:20:50.364651  4992 rpcz_store.cc:276] 0709 12:20:48.839600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.858542 (+ 18942us) service_pool.cc:224] Handling call
0709 12:20:49.870605 (+1012063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.108160  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:51.155635  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:50.938745  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.938556  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 779) took 1702 ms. Trace:
I20260709 12:20:50.480794  4983 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:51.110937  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:50.579442  6407 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.433410  6398 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:50.496913  6197 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:51.171504  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:50.442718  4247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1654) took 1016 ms. Trace:
I20260709 12:20:50.500175  4254 raft_consensus.cc:2410] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:20:51.291720  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 920944us
I20260709 12:20:51.291828  4256 rpcz_store.cc:276] 0709 12:20:49.925792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.966485 (+ 40693us) service_pool.cc:224] Handling call
0709 12:20:51.115411 (+1148926us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400061dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:51.115562 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131200384}
I20260709 12:20:51.292431  4987 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:51.290813  4984 rpcz_store.cc:276] 0709 12:20:49.235802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.945384 (+709582us) service_pool.cc:224] Handling call
0709 12:20:50.037183 (+ 91799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:50.407551 (+370368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.407581 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:50.407628 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:50.407675 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.938283 (+530608us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540071e8d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:50.938347 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.938501 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851207424}
I20260709 12:20:50.365022  4409 rpcz_store.cc:276] 0709 12:20:48.562827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.599869 (+ 37042us) service_pool.cc:224] Handling call
0709 12:20:48.606110 (+  6241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:49.847718 (+1241608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:49.912192 (+ 64474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:50.496989  6310 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.286976  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 196882us
W20260709 12:20:51.291769  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 136204us
I20260709 12:20:51.390514  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:50.587481  6244 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:51.222477  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:51.293251  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 182425us
I20260709 12:20:50.962440  6391 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:50.987044  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 455) took 1061 ms. Trace:
W20260709 12:20:51.210170  4989 consensus_meta.cc:287] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.003s
I20260709 12:20:51.407167  4989 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:20:51.407763  4989 pending_rounds.cc:85] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 7
I20260709 12:20:51.159485  4253 rpcz_store.cc:276] 0709 12:20:49.780192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.365642 (+585450us) service_pool.cc:224] Handling call
0709 12:20:51.092443 (+726801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:50.479947  6353 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:51.091548  6360 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:50.496331  6389 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:50.498302  6399 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:51.376780  4329 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:51.389605  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:51.391753  4256 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:20:51.153219  6337 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.300s
I20260709 12:20:51.172649  6306 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.300130  6297 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:51.223560  6351 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:51.172295  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:51.394981  4297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.008s	sys 0.021s
I20260709 12:20:50.997104  6305 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:51.285799  6326 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:50.579864  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:50.603890  6352 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:50.615373  6251 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:50.926594  4248 consensus_meta.cc:287] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.001s
I20260709 12:20:51.105469  6388 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:50.962114  6393 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.592543  6279 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.708739  6374 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:51.406672  4333 rpcz_store.cc:276] 0709 12:20:49.925474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.925732 (+   258us) service_pool.cc:224] Handling call
0709 12:20:49.926063 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:50.406879 (+480816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.406921 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:50.406967 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:50.407000 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.986736 (+579736us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400104fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:50.986795 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.986955 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105312512}
I20260709 12:20:51.291337  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 786) took 1025 ms. Trace:
I20260709 12:20:51.609295  4990 rpcz_store.cc:276] 0709 12:20:50.266179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.684610 (+418431us) service_pool.cc:224] Handling call
0709 12:20:51.291259 (+606649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.054864  6274 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:50.529951  4328 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:50.595402  6330 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:50.498334  6257 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.585258  6373 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.621199  6359 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:50.498566  6390 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:50.724164  6264 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:50.630745  6346 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.375630  6385 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.095319  6392 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.155036  6289 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:51.171648  6371 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.326s
W20260709 12:20:50.940253  4372 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.130:42725 timed out after 1.689s (SENT) [suppressed 57 similar messages]
I20260709 12:20:51.221776  6404 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:50.993934  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 780) took 1757 ms. Trace:
I20260709 12:20:50.557214  6402 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.596967  6162 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:51.456236  4404 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:51.527848  4296 connection.cc:256] RPC call timeout handler was delayed by -2.1191747210000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 12:20:51.526453  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:51.672832  4402 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:51.498917  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:51.557024  4219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.031s	sys 0.051s
W20260709 12:20:51.818813  4219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.032s	sys 0.051s
W20260709 12:20:51.819139  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 852199us
I20260709 12:20:51.409173  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:51.507432  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:51.514139  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:51.566329  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1617) took 1034 ms. Trace:
I20260709 12:20:51.820955  4256 rpcz_store.cc:276] 0709 12:20:50.531623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.390279 (+858656us) service_pool.cc:224] Handling call
0709 12:20:51.566271 (+175992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.822654  4256 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:51.395147  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 784) took 1129 ms. Trace:
I20260709 12:20:51.823462  4987 rpcz_store.cc:276] 0709 12:20:50.265423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.105415 (+839992us) service_pool.cc:224] Handling call
0709 12:20:51.395086 (+289671us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:51.566901  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.817543  6402 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.570833  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:51.826416  4326 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:51.826498  6306 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:51.584544  4297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.010s	sys 0.021s
I20260709 12:20:51.827592  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 452) took 1933 ms. Trace:
I20260709 12:20:51.827988  4328 rpcz_store.cc:276] 0709 12:20:49.893918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.900331 (+  6413us) service_pool.cc:224] Handling call
0709 12:20:50.019801 (+119470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.617629 (+1597828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.827353 (+209724us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002f3ad4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:51.827528 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878446848}
W20260709 12:20:51.568135  4254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 437) took 2300 ms (client timeout 2919 ms). Trace:
I20260709 12:20:51.829209  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:51.829140  4254 rpcz_store.cc:269] 0709 12:20:49.267982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.268157 (+   175us) service_pool.cc:224] Handling call
0709 12:20:51.567967 (+2299810us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54000df554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:51.568083 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388958976}
I20260709 12:20:51.574891  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:50.437570  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:51.624147  6330 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:51.338728  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:51.339100  6230 consensus_meta.cc:287] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.436s	user 0.012s	sys 0.000s
I20260709 12:20:51.565726  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:51.865697  4329 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:51.588218  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1616) took 1056 ms. Trace:
I20260709 12:20:50.990639  6302 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:50.927688  6395 raft_consensus.cc:476] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:50.953189  6317 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.568854  6313 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.512928  6244 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.590096  6413 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.723775  6219 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.591833  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:51.594046  4248 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:51.496826  4989 pending_rounds.cc:107] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:20:51.223843  6345 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:51.559047  6272 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.588s	user 0.006s	sys 0.006s
I20260709 12:20:51.526542  4409 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:20:50.937322  6280 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:51.391817  6273 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:51.525542  6411 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.600281  4253 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:50.460618  6367 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:51.603569  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:51.605767  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:51.607792  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.525789  6397 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:51.404150  6394 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4.
I20260709 12:20:51.588634  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:51.158239  4986 rpcz_store.cc:276] 0709 12:20:49.288400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.983920 (+695520us) service_pool.cc:224] Handling call
0709 12:20:49.984266 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:50.364166 (+379900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.396891 (+ 32725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.453549  6253 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.619354  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1785) took 1528 ms. Trace:
I20260709 12:20:51.593779  6401 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:51.498359  6353 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:51.388845  4247 rpcz_store.cc:276] 0709 12:20:49.417752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.992444 (+574692us) service_pool.cc:224] Handling call
0709 12:20:50.434048 (+441604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.405087  6310 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.221508  6412 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:51.627969  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:51.630553  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:51.528164  6408 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:51.291476  4255 rpcz_store.cc:276] 0709 12:20:49.268504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.400403 (+1131899us) service_pool.cc:224] Handling call
0709 12:20:50.569732 (+169329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:50.685434 (+115702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.693441 (+  8007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:50.696022 (+  2581us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:50.709568 (+ 13546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.709693 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.709874 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.396119  6197 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.617682  6374 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.631039  6359 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.595809  6297 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.397500  6407 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:51.812463  6418 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:20:51.812827  6415 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:51.815955  6163 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:51.816951  6383 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:51.817412  4327 consensus_meta.cc:287] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.422s	user 0.009s	sys 0.008s
I20260709 12:20:51.601660  6380 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:20:51.831281  4331 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:51.832526  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:51.837868  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1649) took 2481 ms. Trace:
I20260709 12:20:51.614611  6326 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:51.600991  6389 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.632834  6398 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:51.861358  4984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 783) took 1596 ms (client timeout 1983 ms). Trace:
I20260709 12:20:51.861688  6338 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:51.861928  6409 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:51.862335  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:51.863137  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:51.863329  6388 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.863472  6360 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.649585  4988 rpcz_store.cc:276] 0709 12:20:49.236067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.972302 (+736235us) service_pool.cc:224] Handling call
0709 12:20:49.972739 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:50.501129 (+528390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.525422 (+ 24293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:50.546537 (+ 21115us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:50.560651 (+ 14114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.993626 (+432975us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540064c8d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:50.993693 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.993855 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078545792}
I20260709 12:20:51.866568  4257 rpcz_store.cc:276] 0709 12:20:50.531356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.172028 (+640672us) service_pool.cc:224] Handling call
0709 12:20:51.588065 (+416037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:51.514856  6391 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.874665  4405 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:51.311568  6386 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.592907  6399 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:51.623224  6393 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.262094  4250 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:52.262765  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1615) took 1731 ms. Trace:
I20260709 12:20:52.263149  4250 rpcz_store.cc:276] 0709 12:20:50.531066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.396822 (+865756us) service_pool.cc:224] Handling call
0709 12:20:52.262697 (+865875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.264564  4250 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:51.895479  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 578) took 3547 ms. Trace:
I20260709 12:20:52.265795  4326 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:51.920152  6371 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:52.266449  6411 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.002692  6402 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.674041  6390 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.268479  6353 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:52.180709  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.269446  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:52.269618  6390 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:51.634946  4991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 787) took 1368 ms (client timeout 1549 ms). Trace:
W20260709 12:20:52.270284  4991 rpcz_store.cc:269] 0709 12:20:50.266456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.499704 (+233248us) service_pool.cc:224] Handling call
0709 12:20:51.631477 (+1131773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.211735  6230 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.650296  6289 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.272159  4252 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:52.271962  6272 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.272861  6409 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:52.273382  6409 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:52.273687  4252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1614) took 1743 ms (client timeout 1983 ms). Trace:
I20260709 12:20:51.637954  6400 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:52.274271  6272 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:52.274109  4252 rpcz_store.cc:269] 0709 12:20:50.530740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.292033 (+761293us) service_pool.cc:224] Handling call
0709 12:20:52.273527 (+981494us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54002b52d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:52.273635 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040264960}
I20260709 12:20:51.908071  6375 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.275990  4252 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:52.276580  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1653) took 2933 ms. Trace:
I20260709 12:20:52.276216  6408 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.276142  6375 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.276916  4252 rpcz_store.cc:276] 0709 12:20:49.417267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.275376 (+2858109us) service_pool.cc:224] Handling call
0709 12:20:52.275686 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.276357 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.276522 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:52.154340  6305 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.001s
I20260709 12:20:52.279482  4330 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:20:52.279825  4330 pending_rounds.cc:85] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:20:52.280078  4330 pending_rounds.cc:107] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.6
I20260709 12:20:52.280210  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1648) took 2938 ms. Trace:
I20260709 12:20:52.280330  4330 raft_consensus.cc:2917] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Aborting config change with OpId 3.6: Aborted: Op aborted by new leader
I20260709 12:20:52.280819  4330 raft_consensus.cc:2889] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:52.281256  4989 raft_consensus.cc:2889] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:52.281479  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55244 (request call id 88) took 7581 ms. Trace:
I20260709 12:20:52.281858  6251 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.282361  6251 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.281795  4330 rpcz_store.cc:276] 0709 12:20:44.700582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.707376 (+  6794us) service_pool.cc:224] Handling call
0709 12:20:44.723144 (+ 15768us) log.cc:844] Serialized 487 byte log entry
0709 12:20:44.994679 (+271535us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5400333ea0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cf7142 00007fdbb0cd7eaa 00007fdbb0cded53 00007fdbb0cdecd9 00007fdbb0cdec69 00007fdbb0cdec31 00007fdbb0cdddfd 0000000000388634 0000000000388479 00007fdbadc91475
0709 12:20:45.276827 (+282148us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b1800158f20. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc5f2a6 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cfeb26 00007fdbb0cf849a 00007fdbb0cf7714
0709 12:20:45.765326 (+488499us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5400333ea0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cfeb26 00007fdbb0cf849a 00007fdbb0cf7714 00007fdbb0cd7eaa 00007fdbb0cded53 00007fdbb0cdecd9 00007fdbb0cdec69 00007fdbb0cdec31 00007fdbb0cdddfd 0000000000388634
0709 12:20:52.281401 (+6516075us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":371,"raft.run_cpu_time_us":9697,"raft.run_wall_time_us":1175644,"spinlock_wait_cycles":28262400,"thread_start_us":64851,"threads_started":1,"wal-append.queue_time_us":101110,"wal-append.run_cpu_time_us":2945,"wal-append.run_wall_time_us":1388323}
I20260709 12:20:52.284363  6060 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.284821  6060 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.285382  6251 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.286021  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 778) took 3050 ms. Trace:
I20260709 12:20:52.286363  4989 rpcz_store.cc:276] 0709 12:20:49.235562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.918588 (+683026us) service_pool.cc:224] Handling call
0709 12:20:49.918830 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.281745 (+2362915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.285965 (+  4220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.287241  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1776) took 4093 ms. Trace:
I20260709 12:20:52.287750  6280 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:52.261919  4256 rpcz_store.cc:276] 0709 12:20:49.342160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.821869 (+2479709us) service_pool.cc:224] Handling call
0709 12:20:51.822240 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.823057 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.823273 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.288110  4330 rpcz_store.cc:276] 0709 12:20:48.193979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.194113 (+   134us) service_pool.cc:224] Handling call
0709 12:20:48.197071 (+  2958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.284247 (+4087176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.287006 (+  2759us) spinlock_profiling.cc:243] Waited 4.08 s on lock 0x7b54001d5bd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:52.287193 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9388012288}
I20260709 12:20:52.289070  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1787) took 2197 ms. Trace:
W20260709 12:20:52.004251  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.957423  6414 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:52.290158  6414 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.290948  6397 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:52.289479  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:51.984922  6179 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.292366  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.271430  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:51.909137  6330 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.300606  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 775) took 3066 ms. Trace:
I20260709 12:20:52.301963  6399 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.300971  4985 rpcz_store.cc:276] 0709 12:20:49.234682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.914145 (+679463us) service_pool.cc:224] Handling call
0709 12:20:49.944228 (+ 30083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:50.339865 (+395637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.339913 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:50.375355 (+ 35442us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.162996 (+787641us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:51.631241 (+468245us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.637415 (+  6174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.637514 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:52.181879 (+544365us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b18002c3620. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91522 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:20:52.300316 (+118437us) raft_consensus.cc:1685] finished
0709 12:20:52.300429 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.300555 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5336,"prepare.queue_time_us":985539,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":494612,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":61522,"spinlock_wait_cycles":82498304,"thread_start_us":710148,"threads_started":3,"wal-append.queue_time_us":1090516}
I20260709 12:20:52.266115  4990 raft_consensus.cc:2368] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:52.266773  6371 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.294729  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1792) took 1007 ms. Trace:
I20260709 12:20:52.265681  4983 rpcz_store.cc:276] 0709 12:20:48.317741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.323473 (+  5732us) service_pool.cc:224] Handling call
0709 12:20:48.387470 (+ 63997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.332889 (+2945419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.817939 (+485050us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54006aefd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:51.864830 (+ 46891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4646680832}
I20260709 12:20:52.293792  6374 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.291496  6397 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.302872  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:52.298743  6412 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.305027  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:52.303725  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:52.312353  4138 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:20:52.307910  6060 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:52.271337  4984 rpcz_store.cc:269] 0709 12:20:50.265124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.507927 (+1242803us) service_pool.cc:224] Handling call
0709 12:20:51.861270 (+353343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.310969  6289 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.315774  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:52.301359  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:52.028400  6392 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.265203  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1652) took 2922 ms. Trace:
I20260709 12:20:52.319056  4250 rpcz_store.cc:276] 0709 12:20:49.343076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.263877 (+2920801us) service_pool.cc:224] Handling call
0709 12:20:52.264215 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.264966 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.265150 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.319617  6244 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:52.299599  4248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1606) took 3022 ms (client timeout 1926 ms). Trace:
W20260709 12:20:52.320611  4248 rpcz_store.cc:269] 0709 12:20:49.276986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.864950 (+587964us) service_pool.cc:224] Handling call
0709 12:20:52.299420 (+2434470us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540019a854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:52.299535 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159555968}
I20260709 12:20:52.313123  6375 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.908851  6410 consensus_queue.cc:1059] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.414s
I20260709 12:20:52.323019  6413 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:52.324958  4254 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:52.326462  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1650) took 2984 ms. Trace:
W20260709 12:20:52.021974  6339 consensus_meta.cc:287] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.907s	user 0.005s	sys 0.004s
W20260709 12:20:52.181396  4955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.000s	sys 0.034s
I20260709 12:20:52.265826  6317 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.289534  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 440) took 2832 ms. Trace:
I20260709 12:20:52.307780  6326 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.270244  4986 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:20:52.232457  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.271620  6230 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.299587  4333 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:52.280565  4253 rpcz_store.cc:276] 0709 12:20:49.341848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.408391 (+2066543us) service_pool.cc:224] Handling call
0709 12:20:51.600103 (+191712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.279984 (+679881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.280160 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.278658  6407 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.317919  6415 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.298681  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:52.297663  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1786) took 2206 ms. Trace:
I20260709 12:20:52.297209  6389 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:52.298501  6197 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:52.345363  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 512855us
I20260709 12:20:52.279099  4332 rpcz_store.cc:276] 0709 12:20:50.090921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.439908 (+348987us) service_pool.cc:224] Handling call
0709 12:20:50.440888 (+   980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.556600 (+1115712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.556652 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.556725 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:51.556771 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.619091 (+ 62320us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002661d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:51.619140 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.619263 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328624384}
I20260709 12:20:52.326809  4254 rpcz_store.cc:276] 0709 12:20:49.342448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.830244 (+2487796us) service_pool.cc:224] Handling call
0709 12:20:52.059241 (+228997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.325385 (+266144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.326158 (+   773us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400121454. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:52.326389 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610536704}
W20260709 12:20:51.896514  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 1.45892e+06us
I20260709 12:20:52.372109  4331 rpcz_store.cc:276] 0709 12:20:51.287761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.338179 (+ 50418us) service_pool.cc:224] Handling call
0709 12:20:52.294674 (+956495us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:52.370654  4955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.000s	sys 0.040s
I20260709 12:20:52.287379  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:52.266831  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:51.985951  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.373824  4334 rpcz_store.cc:276] 0709 12:20:50.091492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.447604 (+356112us) service_pool.cc:224] Handling call
0709 12:20:50.447999 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:51.818827 (+1370828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:51.818864 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:51.818906 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:51.818939 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.297355 (+478416us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001d65d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:52.297419 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.297573 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2989048576}
I20260709 12:20:52.375351  4325 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:52.374320  4989 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 1.
I20260709 12:20:52.381157  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.381304  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 785) took 2115 ms. Trace:
W20260709 12:20:52.261623  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 1.3213e+06us
I20260709 12:20:52.381888  4989 rpcz_store.cc:276] 0709 12:20:50.265879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.287138 (+2021259us) service_pool.cc:224] Handling call
0709 12:20:52.381251 (+ 94113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.373385  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:52.373427  4955 connection.cc:256] RPC call timeout handler was delayed by -1.6847839090000889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:20:52.383281  4955 connection.cc:256] RPC call timeout handler was delayed by -1.6145839090004301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:20:52.287814  4296 connection.cc:256] RPC call timeout handler was delayed by -2.064274720999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 12:20:52.371583  4256 rpcz_store.cc:276] 0709 12:20:49.456878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.288740 (+2831862us) service_pool.cc:224] Handling call
0709 12:20:52.289011 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.289208 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.289238 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.289283 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:52.289315 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.289374 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.289484 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:52.384244  4296 connection.cc:256] RPC call timeout handler was delayed by -2.0435747209999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 12:20:52.384771  4296 connection.cc:256] RPC call timeout handler was delayed by -1.76637472099992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 12:20:52.385226  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1612) took 2473 ms. Trace:
W20260709 12:20:52.385447  4296 connection.cc:256] RPC call timeout handler was delayed by -1.76637472099992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 12:20:52.384784  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.386078  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:52.386387  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6430747210001755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 12:20:52.386655  4331 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
W20260709 12:20:52.383700  4955 connection.cc:256] RPC call timeout handler was delayed by -1.5308839090002948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:20:52.387491  4955 connection.cc:256] RPC call timeout handler was delayed by -1.4831839090002177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 12:20:52.387313  4256 rpcz_store.cc:276] 0709 12:20:49.916064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.384544 (+2468480us) service_pool.cc:224] Handling call
0709 12:20:52.384805 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.384961 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.384983 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.385020 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:52.385047 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.385091 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.385178 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:52.387951  4955 connection.cc:256] RPC call timeout handler was delayed by -1.4831839090002177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:20:52.389534  4955 connection.cc:256] RPC call timeout handler was delayed by -1.4516839090001668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 12:20:52.389945  4955 connection.cc:256] RPC call timeout handler was delayed by -1.4516839090001668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 12:20:52.390231  4955 connection.cc:256] RPC call timeout handler was delayed by -1.3931839090000722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 12:20:52.390816  4955 connection.cc:256] RPC call timeout handler was delayed by -1.1861839090001922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 12:20:52.391466  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:52.296309  6386 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.394474  4218 leader_election.cc:400] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:52.396311  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.396960  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:52.397547  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.381945  4332 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:52.398378  4333 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:52.302593  4330 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:52.401105  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.404397  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.403008  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.405055  4334 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:52.405666  4331 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:52.406008  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.406672  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:51.864686  6300 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.414197  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2136) took 1424 ms. Trace:
I20260709 12:20:52.414953  4331 rpcz_store.cc:276] 0709 12:20:50.989380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.413586 (+1424206us) service_pool.cc:224] Handling call
0709 12:20:52.413802 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.413944 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.413964 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.413999 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:52.414024 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.414067 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.414146 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.414208  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2135) took 1425 ms. Trace:
I20260709 12:20:52.416610  4334 rpcz_store.cc:276] 0709 12:20:50.989097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.413297 (+1424200us) service_pool.cc:224] Handling call
0709 12:20:52.413562 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.413725 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.413750 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.413787 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:52.413820 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.413868 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.414165 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.418834  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.420712  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2132) took 1432 ms. Trace:
I20260709 12:20:52.421229  4333 rpcz_store.cc:276] 0709 12:20:50.988231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.419654 (+1431423us) service_pool.cc:224] Handling call
0709 12:20:52.420026 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.420266 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.420307 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.420367 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:52.420419 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.420495 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.420641 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:52.386955  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6205747210001391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 12:20:52.289088  6280 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.305778  6310 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.423504  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.302003  6330 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.368901  6374 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.447594  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:52.447816  4325 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:52.448239  4401 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.310045  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 442) took 2530 ms. Trace:
I20260709 12:20:52.426862  4326 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:52.428085  6230 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.428668  6390 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:52.412947  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 587) took 1016 ms. Trace:
I20260709 12:20:52.308306  6297 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.431474  6402 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:52.433115  6349 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:52.012683  6384 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.435597  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:52.435738  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 585) took 1041 ms. Trace:
W20260709 12:20:52.376063  6274 consensus_meta.cc:287] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.001s
I20260709 12:20:52.419714  4332 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
W20260709 12:20:52.464186  4956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.009s
W20260709 12:20:52.464588  4956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.003s	sys 0.009s
I20260709 12:20:52.437922  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:52.464856  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 594515us
I20260709 12:20:52.465173  4400 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:51.942665  6257 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.439335  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1794) took 1082 ms. Trace:
W20260709 12:20:52.439648  4371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.000s	sys 0.014s
W20260709 12:20:52.438059  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3654064859997561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 12:20:52.468132  4371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.000s	sys 0.014s
I20260709 12:20:52.468690  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:20:52.468799  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 1.0792e+06us
I20260709 12:20:52.470042  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:52.303141  6399 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.008620  6385 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:51.869590  6404 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:52.307132  6367 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.360148  6371 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.864485  6373 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:52.293915  6359 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:51.943044  6306 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.444132  4248 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:52.443960  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:52.349110  6410 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:52.423766  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1611) took 2545 ms. Trace:
I20260709 12:20:52.484207  4254 rpcz_store.cc:276] 0709 12:20:49.877933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.371705 (+2493772us) service_pool.cc:224] Handling call
0709 12:20:52.423092 (+ 51387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.423327 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.423369 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.423427 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:52.423477 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.423553 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.423694 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.343264  6391 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.426270  6317 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.449383  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.329807  6408 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.268479  6411 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.371868  4327 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
W20260709 12:20:52.488198  4327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 445) took 4290 ms (client timeout 1681 ms). Trace:
I20260709 12:20:52.402642  6389 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:52.490375  6389 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.490803  6389 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.404021  6244 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.451918  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:52.495105  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:52.454591  6405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.009s	sys 0.007s
I20260709 12:20:52.303601  6313 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:52.488576  4327 rpcz_store.cc:269] 0709 12:20:48.198233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.208648 (+ 10415us) service_pool.cc:224] Handling call
0709 12:20:49.351995 (+1143347us) spinlock_profiling.cc:243] Waited 9.49 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:52.488099 (+3136104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21835136}
I20260709 12:20:52.508641  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.493285  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1609) took 2651 ms. Trace:
I20260709 12:20:52.461030  4405 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.509374  6317 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.509892  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.510481  4153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 259) took 5814 ms. Trace:
I20260709 12:20:52.443873  6273 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:52.511559  6273 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.510881  4153 rpcz_store.cc:276] 0709 12:20:46.695632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.695805 (+   173us) service_pool.cc:224] Handling call
0709 12:20:52.510274 (+5814469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:47.975782 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:48.090632 (+114850us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:48.090669 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:20:48.090688 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:48.091378 (+   690us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:48.091939 (+   561us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:48.091988 (+    49us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:48.092660 (+   672us) tablet.cc:701] Row locks acquired
0709 12:20:48.092679 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:20:48.092852 (+   173us) write_op.cc:270] Start()
0709 12:20:48.092970 (+   118us) write_op.cc:276] Timestamp: P: 1783599648092796 usec, L: 0
0709 12:20:48.092989 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:20:48.093682 (+   693us) log.cc:844] Serialized 2039 byte log entry
0709 12:20:49.990456 (+1896774us) op_driver.cc:464] REPLICATION: finished
0709 12:20:50.928437 (+937981us) write_op.cc:301] APPLY: starting
0709 12:20:50.938222 (+  9785us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:51.155175 (+216953us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:51.342288 (+187113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:51.670725 (+328437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:51.670917 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:20:51.670961 (+    44us) write_op.cc:312] APPLY: finished
0709 12:20:51.671238 (+   277us) log.cc:844] Serialized 47 byte log entry
0709 12:20:52.503467 (+832229us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:52.503570 (+   103us) write_op.cc:454] Released schema lock
0709 12:20:52.503655 (+    85us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":283832,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":603589,"num_ops":5,"prepare.queue_time_us":257855,"prepare.run_cpu_time_us":4442,"prepare.run_wall_time_us":133109,"replication_time_us":1897272,"thread_start_us":1294682,"threads_started":3,"wal-append.queue_time_us":759668}]]}
I20260709 12:20:52.470618  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:52.467993  4334 rpcz_store.cc:276] 0709 12:20:51.356632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.438206 (+1081574us) service_pool.cc:224] Handling call
0709 12:20:52.438590 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.438812 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.438851 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.438907 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:52.438954 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.439021 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.439250 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.472685  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:52.472738  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.576251  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.468823  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:52.576877  4334 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
W20260709 12:20:52.576944  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 104330us
I20260709 12:20:52.471722  6399 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:52.478068  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.482113  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:52.482281  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:52.577710  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:52.577809  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:52.578284  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 96068us
I20260709 12:20:52.457141  6310 consensus_queue.cc:1059] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:20:52.289512  4328 rpcz_store.cc:276] 0709 12:20:50.091820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.861826 (+1770006us) service_pool.cc:224] Handling call
0709 12:20:52.288492 (+426666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.288699 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.288740 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.288797 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:52.288833 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.288893 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.289010 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.399130  6339 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.486428  4333 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:52.596664  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.597462  4333 raft_consensus.cc:2410] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:52.456868  4986 rpcz_store.cc:276] 0709 12:20:51.396511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.269187 (+872676us) service_pool.cc:224] Handling call
0709 12:20:52.403239 (+134052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.475759  6230 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.274652  6400 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.471657  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:52.462710  4988 rpcz_store.cc:276] 0709 12:20:51.394048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.298371 (+904323us) service_pool.cc:224] Handling call
0709 12:20:52.435646 (+137275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.399664  6413 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.598508  6251 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.632815  6251 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:52.633370  6251 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.499145  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1795) took 1103 ms. Trace:
I20260709 12:20:52.490865  6404 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.508898  6313 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.460990  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:52.508916  4401 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
W20260709 12:20:52.568609  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 73577.9us
I20260709 12:20:52.740415  4331 rpcz_store.cc:276] 0709 12:20:51.395753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.442544 (+1046791us) service_pool.cc:224] Handling call
0709 12:20:52.465710 (+ 23166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.465829 (+   119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.465844 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.465870 (+    26us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:20:52.465889 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.465921 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.498996 (+ 33075us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54002044d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:52.499099 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52364544}
I20260709 12:20:52.741451  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:20:52.577360  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 108591us
I20260709 12:20:52.578907  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.579401  4325 raft_consensus.cc:2393] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 2: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:52.578923  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:52.581195  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.484103  6410 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:52.582818  6411 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.743710  6317 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.489528  6306 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.584380  6273 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:52.584746  6257 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:52.587733  4405 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:52.587743  4395 tablet_service.cc:1558] Processing DeleteTablet for tablet fd41dc8658414bcfb8662c0efe3caffc with delete_type TABLET_DATA_TOMBSTONED (TS 899897e6794541b5ab538af361fc9e6c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60130
I20260709 12:20:52.580778  6297 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:52.581053  6399 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.485354  6373 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.450863  4255 rpcz_store.cc:276] 0709 12:20:49.779790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.292988 (+2513198us) service_pool.cc:224] Handling call
0709 12:20:52.293382 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.308705 (+ 15323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.308998 (+   293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.309062 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:52.309105 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.309753 (+   648us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54000dfa54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:52.309810 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.309975 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34676608}
I20260709 12:20:52.594298  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.751099  4326 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:52.733232  6398 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:52.488956  6384 raft_consensus.cc:2764] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:52.581852  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:52.598114  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:52.753504  4256 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:52.587420  6425 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.493183  6330 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:52.600495  4219 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:52.601172  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.489364  6423 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 12:20:52.603435  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 132893us
I20260709 12:20:52.606376  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:52.756736  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 174944us
I20260709 12:20:52.493042  6414 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:52.610085  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 169008us
I20260709 12:20:52.762136  6306 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.744086  6411 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.761732  4151 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 2, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 2 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.497869  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1610) took 2648 ms. Trace:
I20260709 12:20:52.764487  4248 rpcz_store.cc:276] 0709 12:20:49.849022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.321892 (+2472870us) service_pool.cc:224] Handling call
0709 12:20:52.368185 (+ 46293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.482101 (+113916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.497545 (+ 15444us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b5400230354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:52.497791 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173899136}
I20260709 12:20:52.486214  6427 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.510511  4327 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:52.598237  6408 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.766446  6408 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:52.766997  6408 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.613052  4990 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:52.621898  6415 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.624827  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 782) took 2360 ms. Trace:
I20260709 12:20:52.763422  4151 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 3 to 4, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 1 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.625645  4991 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:52.628758  6339 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:52.629915  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1800) took 1029 ms. Trace:
I20260709 12:20:52.609624  6310 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.514791  4250 rpcz_store.cc:276] 0709 12:20:49.841671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.320050 (+2478379us) service_pool.cc:224] Handling call
0709 12:20:52.320405 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.368214 (+ 47809us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:52.411968 (+ 43754us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.477050 (+ 65082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.478647 (+  1597us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:52.480837 (+  2190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.482058 (+  1221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.489422 (+  7364us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43695,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":3075,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4486,"spinlock_wait_cycles":53632,"thread_start_us":98387,"threads_started":2,"wal-append.queue_time_us":195774}
I20260709 12:20:52.737718  4249 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:52.594535  6409 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.613564  6397 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.617672  6393 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.738336  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1607) took 3288 ms. Trace:
W20260709 12:20:52.732990  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.754936  6425 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.742717  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:52.745038  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 166189us
I20260709 12:20:52.739658  6244 raft_consensus.cc:3055] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:52.744225  6317 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:52.757241  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:52.758265  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 157799us
I20260709 12:20:52.759647  6412 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.753247  6398 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:52.816274  6411 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:52.760344  6274 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.610773  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:52.815517  6425 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.820901  6386 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.824043  6274 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.824226  4254 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.824401  6386 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:52.824973  6386 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.771873  4984 rpcz_store.cc:276] 0709 12:20:50.264817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.315692 (+2050875us) service_pool.cc:224] Handling call
0709 12:20:52.316117 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.316461 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.316487 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:52.368378 (+ 51891us) log.cc:844] Serialized 26 byte log entry
0709 12:20:52.444622 (+ 76244us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:52.444659 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.444717 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:52.624588 (+179871us) raft_consensus.cc:1685] finished
0709 12:20:52.624612 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.624766 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2653,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":75128,"threads_started":1,"wal-append.queue_time_us":116134}
I20260709 12:20:52.755926  4333 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:52.756420  6257 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:52.827091  6257 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.790335  4330 raft_consensus.cc:2410] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:20:52.815442  6244 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:52.831487  6244 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.832724  6425 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.834940  6425 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:52.791033  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:52.836067  4256 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:52.836163  6386 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.795981  4405 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:52.796792  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:52.781486  4151 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 3 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.837847  6373 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.789600  4328 rpcz_store.cc:276] 0709 12:20:51.600732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.607426 (+1006694us) service_pool.cc:224] Handling call
0709 12:20:52.629345 (+ 21919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.629554 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.629583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.629634 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:52.629668 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.629733 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.629854 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:52.838768  4151 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 5 to 6, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.840225  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:52.841306  6390 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:52.841686  6390 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.842039  6390 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:52.841837  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:52.806047  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:52.805975  4401 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:52.757900  6330 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:52.844514  6280 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.845377  6330 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.845480  6280 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:52.742980  4218 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:52.847126  6412 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.849063  6349 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.849833  6349 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:52.809370  4252 rpcz_store.cc:276] 0709 12:20:49.450558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.277912 (+2827354us) service_pool.cc:224] Handling call
0709 12:20:52.278225 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.436467 (+158242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.436503 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.436549 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:52.436581 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.681581 (+245000us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000631d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:52.738176 (+ 56595us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:52.738287 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363437312}
I20260709 12:20:52.807540  6403 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.789419  6230 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:52.800370  6421 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.814183  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:52.772022  6410 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:52.819274  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 62153.7us
I20260709 12:20:52.883551  4334 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.820223  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:52.822916  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.824518  6274 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:52.825173  6424 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.331s	user 0.009s	sys 0.000s
I20260709 12:20:52.749825  6272 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:20:52.851576  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 108656us
I20260709 12:20:52.842718  6399 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.851740  6420 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.868619  4401 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:52.873888  4254 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:20:52.876032  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61960.8us
I20260709 12:20:52.813211  6391 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
W20260709 12:20:52.815411  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 72748.6us
I20260709 12:20:52.876222  4985 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:52.800854  6414 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:20:52.875277  6230 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.879709  6403 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:52.880173  6306 consensus_queue.cc:1059] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:52.879771  6421 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.886518  6264 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:52.887319  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 67189.8us
I20260709 12:20:52.883900  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:52.821621  6163 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.890130  6280 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:20:52.898897  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:52.840867  4151 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.908257  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:52.909403  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:52.898820  6393 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:52.913476  4257 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:52.897773  6272 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:52.887718  6402 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:20:52.851060  6349 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.897450  6300 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:20:52.899407  6423 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:20:52.946487  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.207376  4333 raft_consensus.cc:2376] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3. Re-sending same reply.
W20260709 12:20:53.208402  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 324556us
I20260709 12:20:52.909579  6400 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.215161  6264 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.015755  6425 raft_consensus.cc:993] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:53.215729  6264 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.218102  6374 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:53.218731  6374 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:20:53.012701  6432 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:20:53.219954  6374 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:52.996666  6386 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.221998  6374 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.222379  6386 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.222906  6386 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.223260  6386 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:53.225170  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.914397  6230 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.229094  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.013638  6339 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.216s
I20260709 12:20:53.230674  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.260910  4332 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:20:53.262215  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.002393  6409 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:53.203764  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 297747us
W20260709 12:20:53.202863  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 299652us
I20260709 12:20:53.004232  6434 tablet_replica.cc:333] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
W20260709 12:20:53.183089  6435 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:20:53.288338  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:53.001701  6431 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:20:53.295440  6163 raft_consensus.cc:1081] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:53.296334  4408 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:53.296444  6163 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:53.298864  6397 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.299629  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.300375  6274 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:53.302328  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.251515  6412 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:53.012524  6390 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.310454  6390 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:52.990118  6317 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.311596  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.312269  4983 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
W20260709 12:20:53.312915  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.243161  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 344676us
W20260709 12:20:53.067421  6389 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.576s	user 0.015s	sys 0.000s
I20260709 12:20:53.203801  6244 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.007635  6297 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.156876  6408 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.331049  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.331915  4984 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
W20260709 12:20:53.249365  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 302947us
I20260709 12:20:53.003453  6399 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.233487  6393 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.232777  6272 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.949934  6410 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.011387  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.372946  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:53.252453  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:53.254444  4334 raft_consensus.cc:2393] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:53.090977  6414 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:53.265097  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:53.231356  4249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1651) took 3888 ms (client timeout 2090 ms). Trace:
I20260709 12:20:53.232338  6420 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.270988  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:53.273147  4405 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:53.274508  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:53.382424  4333 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:53.283046  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.289048  4989 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 1.
I20260709 12:20:53.293984  4988 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:20:53.294942  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.389633  4986 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:53.391397  6420 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.392889  6403 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.395509  6163 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:53.396057  6163 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:53.333711  6389 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.396713  6163 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.398254  6389 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.330322  6297 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:53.398603  6330 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.399441  6297 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.400743  6297 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.404505  6408 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.413302  6444 raft_consensus.cc:993] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:53.414009  6444 raft_consensus.cc:1081] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:20:53.307816  6274 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:53.323942  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.298717  6230 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:53.322288  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 53097us
I20260709 12:20:53.250427  4247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1608) took 3760 ms. Trace:
I20260709 12:20:53.444895  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.017663  6251 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.259246  6411 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:53.365485  6393 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.450511  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.451619  6251 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:53.379252  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 126935us
W20260709 12:20:53.379257  4249 rpcz_store.cc:269] 0709 12:20:49.342745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.913315 (+570570us) service_pool.cc:224] Handling call
0709 12:20:53.231103 (+3317788us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b5400120554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:53.231244 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5811698432}
W20260709 12:20:53.382495  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 174596us
I20260709 12:20:53.384012  4332 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 1.
I20260709 12:20:52.913796  6197 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.336s
W20260709 12:20:53.455221  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.445242  4247 rpcz_store.cc:276] 0709 12:20:49.487879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.289294 (+2801415us) service_pool.cc:224] Handling call
0709 12:20:52.290139 (+   845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.345945 (+ 55806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.345996 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:52.461733 (+115737us) log.cc:844] Serialized 26 byte log entry
0709 12:20:52.746222 (+284489us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:20:52.760765 (+ 14543us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.761247 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.761318 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.237364 (+476046us) raft_consensus.cc:1685] finished
0709 12:20:53.237390 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.247952 (+ 10562us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9540,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":36,"raft.queue_time_us":41200,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":231,"thread_start_us":284563,"threads_started":2,"wal-append.queue_time_us":393029}
I20260709 12:20:53.387996  4330 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:53.396188  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 781) took 3168 ms. Trace:
I20260709 12:20:53.457764  4985 rpcz_store.cc:276] 0709 12:20:50.264371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.314784 (+2050413us) service_pool.cc:224] Handling call
0709 12:20:52.315071 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.908964 (+593893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.395931 (+486967us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400574754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:53.396128 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289957120}
I20260709 12:20:53.458925  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:53.321460  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:53.416900  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.420810  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 593) took 1128 ms. Trace:
I20260709 12:20:53.422699  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 584) took 4060 ms. Trace:
I20260709 12:20:53.396093  6423 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.425438  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 444) took 3645 ms. Trace:
I20260709 12:20:53.463630  4257 rpcz_store.cc:276] 0709 12:20:49.780510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.316633 (+2536123us) service_pool.cc:224] Handling call
0709 12:20:52.316904 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.207090 (+890186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.425242 (+218152us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400259c54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:53.425383 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371417856}
I20260709 12:20:53.460868  6310 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.427706  4956 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:53.425468  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.466382  4331 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.430698  6427 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.431890  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.476130  4326 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.434114  6398 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.437373  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1789) took 3233 ms. Trace:
W20260709 12:20:53.481678  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 54112.4us
I20260709 12:20:53.438833  6421 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.442121  4372 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.443823  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.496701  4331 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:20:53.450251  6411 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.385354  4328 raft_consensus.cc:2376] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3. Re-sending same reply.
I20260709 12:20:53.457244  4296 leader_election.cc:400] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:53.501087  4296 leader_election.cc:403] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.387233  6414 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.460300  6373 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:53.516759  4401 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:53.460584  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:53.461650  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 140321us
I20260709 12:20:53.518275  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:53.461890  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:53.461505  4990 rpcz_store.cc:276] 0709 12:20:49.362672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.314017 (+2951345us) service_pool.cc:224] Handling call
0709 12:20:52.314675 (+   658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.771518 (+456843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.422400 (+650882us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400512054. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:53.422632 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685642496}
W20260709 12:20:53.427130  4138 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b3efae3bdfff46bb9bbff1ed1ea70a90 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:20:53.482501  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:53.526473  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44048.4us
I20260709 12:20:53.480970  6427 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:53.492174  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 216416us
I20260709 12:20:53.533991  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.494726  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.481769  4329 rpcz_store.cc:276] 0709 12:20:50.204208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.907739 (+1703531us) service_pool.cc:224] Handling call
0709 12:20:51.993974 (+ 86235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.752897 (+758923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.752929 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:52.774525 (+ 21596us) log.cc:844] Serialized 26 byte log entry
0709 12:20:53.167527 (+393002us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:53.167877 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.436953 (+269076us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54002035d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:53.437002 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.437053 (+    51us) raft_consensus.cc:1685] finished
0709 12:20:53.437069 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.437306 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9347,"raft.queue_time_us":34433,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4041,"spinlock_wait_cycles":1744545664,"thread_start_us":346155,"threads_started":1,"wal-append.queue_time_us":437788}
I20260709 12:20:53.444782  6230 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:53.489787  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 47750.9us
W20260709 12:20:53.491439  6392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.035s	sys 0.070s
W20260709 12:20:53.501571  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 44462us
I20260709 12:20:53.489297  6423 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.517472  6411 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.528101  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:53.529079  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 67297.2us
W20260709 12:20:53.483237  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 133550us
W20260709 12:20:53.530369  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.535004  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:53.553453  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.540174  4372 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.517884  6300 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.510502  6441 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:53.517280  6408 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:53.463460  6274 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.543623  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.545004  4326 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:53.567430  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.557057  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:53.569036  4400 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:53.564899  4219 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.533159  6317 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.535056  6244 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.564471  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:20:53.542066  6392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.036s	sys 0.070s
I20260709 12:20:53.537569  6251 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:53.546667  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.572113  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:53.572321  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.461391  4991 rpcz_store.cc:276] 0709 12:20:52.292862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.402554 (+109692us) service_pool.cc:224] Handling call
0709 12:20:52.625244 (+222690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.772299 (+147055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.420494 (+648195us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400474850. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:53.420722 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444351232}
I20260709 12:20:53.575479  4990 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:20:53.575639  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.561435  6349 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:53.542407  6398 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.585832  4371 leader_election.cc:400] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4.
I20260709 12:20:53.586408  6423 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.587740  6440 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:53.588258  6440 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.588615  6440 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:53.591665  6452 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:20:53.575938  6386 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.593938  6386 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.560745  6300 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.579607  6403 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.586748  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:53.599927  4956 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.604502  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:53.605381  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:53.608479  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.601727  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.565611  6446 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.576735  6384 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:53.616520  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.616338  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.574492  6230 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:53.617504  4329 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:53.617887  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.617466  4330 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:20:53.618753  4331 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.620157  4992 raft_consensus.cc:2393] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:53.623644  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.624440  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.625109  4326 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:53.626029  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:53.577144  6251 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.627235  6251 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.582583  6257 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.599074  6408 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:53.604833  6274 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:53.605746  6300 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.611771  6244 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.611539  6397 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.640748  6310 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:53.616318  6384 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.605211  6374 consensus_queue.cc:1059] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:20:53.648175  6434 raft_consensus.cc:2243] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:53.616638  6446 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:53.649323  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 49495.6us
I20260709 12:20:53.652060  6392 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:53.654763  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:53.648070  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:53.658017  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:53.776383  4402 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
W20260709 12:20:53.537079  4138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 109993us
I20260709 12:20:53.645778  4327 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:53.663640  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:53.651412  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46101.6us
W20260709 12:20:53.780454  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 116732us
I20260709 12:20:53.781724  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.749770  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:53.644198  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:53.782963  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:53.784399  4988 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:53.772401  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 170761us
I20260709 12:20:53.790248  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:53.791205  4402 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:53.792725  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:53.788297  4372 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.797394  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:53.686619  6163 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.657617  6244 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:53.660583  6272 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.633250  6230 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.807812  6230 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.807962  6244 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.809010  6163 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.809376  6272 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.810314  6197 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.810554  6272 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.637549  6257 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:53.811885  4984 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:53.811844  6257 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.811285  6272 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.814070  4328 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:53.814136  6272 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.661561  6264 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.806519  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:53.815950  4408 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:53.816404  4989 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 2: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:53.708788  6251 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.817724  6264 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.818751  6264 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:53.819836  6251 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.820127  6264 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.821882  6264 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.649814  6274 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.618459  6403 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:53.824045  6274 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.664589  6374 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:53.825702  6374 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:53.826607  6403 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.714623  6300 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:53.616600  6410 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:20:53.827236  6374 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.664785  6434 raft_consensus.cc:2272] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:53.828747  6374 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.829408  6410 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:53.829929  6410 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:53.829983  6300 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:53.656810  6389 consensus_queue.cc:1059] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:20:53.832799  6389 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:53.833220  6389 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.833631  6434 ts_tablet_manager.cc:1916] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:53.833904  6310 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.834455  6310 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:53.834990  6310 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:53.661878  6424 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:53.834759  6389 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.851958  6459 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.852476  6389 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.658716  6384 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:53.653503  6402 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:20:53.642127  6408 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.869634  6408 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.706158  6411 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:53.877522  6257 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.878372  6411 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:53.712788  6393 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.880852  6384 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.881726  6393 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.657305  6397 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.864373  6402 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.884279  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.884492  6402 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.885262  4247 raft_consensus.cc:2368] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
W20260709 12:20:53.885547  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.835583  6410 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.790541  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:53.887194  6410 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:53.887511  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:53.888295  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 98135.4us
I20260709 12:20:53.890544  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.710258  6427 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.891497  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:53.891927  6442 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:53.892477  6442 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.892640  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.892935  6442 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:53.893553  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.893901  6427 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.661155  6414 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.680298  6439 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.894408  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:53.903849  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 111415us
I20260709 12:20:53.904121  6439 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:53.904631  6439 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:53.689599  6454 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:20:53.657222  6457 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:53.831036  6300 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:53.911966  6300 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.912071  6457 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.912482  6300 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:53.912729  6457 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:53.726413  6440 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.852694  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:53.853210  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.611662  6349 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:20:53.943585  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.944595  4254 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:53.945007  6349 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:53.945451  6349 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:53.945694  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.946596  4253 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:53.948001  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.949003  4256 raft_consensus.cc:2368] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:53.884968  6397 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.893339  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:53.646755  6444 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:53.665365  6446 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.899439  6459 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:20:53.900194  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.901192  6197 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:53.908799  6461 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:53.928061  6421 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:53.938807  6384 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.943060  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:53.943257  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.894364  4247 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:20:53.956914  4987 raft_consensus.cc:2368] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:53.946729  6349 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:53.961746  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:53.963063  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 164386us
I20260709 12:20:53.968921  6257 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:53.968972  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:53.981003  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.986931  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:53.986524  6444 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:54.138576  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.124122  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.038137  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:53.991065  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:54.039834  4400 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:20:54.116092  4331 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:54.039441  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.183838  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:54.070897  6264 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:54.104055  6471 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:20:54.077277  6470 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
I20260709 12:20:53.996757  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.194953  4992 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:54.111841  6393 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.195977  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.195755  4257 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:54.196375  6264 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.196583  6393 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.197232  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.198097  4257 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:54.199497  6264 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:54.199695  4983 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:54.201372  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.202184  4983 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:54.199525  4249 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:54.204833  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.205451  4249 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.128641  6440 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:54.087431  6163 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:54.190743  4248 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:54.086163  6230 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.192843  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.115378  6411 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.103456  6439 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.194052  6398 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:20:54.194255  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.083160  4988 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:54.054622  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.182217  6444 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:54.117645  6410 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:54.210940  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.211587  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.225705  6434 ts_tablet_manager.cc:1929] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:20:54.226223  4405 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:20:54.229151  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.232368  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.054072  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.084587  6310 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:54.203199  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.236824  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.237999  6442 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.241536  4256 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:54.239342  4989 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:54.168041  6274 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:54.291930  6445 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.711s	user 0.005s	sys 0.000s
I20260709 12:20:54.292929  6442 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:54.293089  6274 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.294258  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 396) took 1501 ms. Trace:
I20260709 12:20:54.263701  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.294742  4403 rpcz_store.cc:276] 0709 12:20:52.793150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.793649 (+   499us) service_pool.cc:224] Handling call
0709 12:20:52.793989 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:52.794339 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.794380 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:52.798770 (+  4390us) log.cc:844] Serialized 26 byte log entry
0709 12:20:53.214781 (+416011us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180032f740. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:20:53.456306 (+241525us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:53.456339 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.456399 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.189223 (+732824us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:20:54.293861 (+104638us) raft_consensus.cc:1685] finished
0709 12:20:54.293880 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.294043 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4242,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7372,"spinlock_wait_cycles":14294272,"thread_start_us":241329,"threads_started":1,"wal-append.queue_time_us":712867}
I20260709 12:20:54.261520  4252 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:54.298779  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.299201  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.299876  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.300026  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.242364  6393 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.301339  4252 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.302119  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 470) took 1391 ms. Trace:
I20260709 12:20:54.294756  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.283864  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.285722  6230 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.286123  6434 log.cc:1199] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/wals/fd41dc8658414bcfb8662c0efe3caffc
I20260709 12:20:54.286981  4326 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.287704  4250 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.289598  6310 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:54.290364  4983 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:54.302145  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.302501  4325 rpcz_store.cc:276] 0709 12:20:52.910134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.910313 (+   179us) service_pool.cc:224] Handling call
0709 12:20:53.304438 (+394125us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:53.304655 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.538672 (+234017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.538719 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.538776 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:53.538821 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.267891 (+729070us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54002d4e54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:54.272529 (+  4638us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.301946 (+ 29417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540411520}
I20260709 12:20:54.274507  6257 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.303272  4247 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.312034  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.314918  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:54.334798  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:54.370659  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.344810  4329 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:20:54.378382  4334 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.378760  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.379244  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:54.379670  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.308444  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:54.383638  4326 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:54.384045  4987 raft_consensus.cc:2393] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:54.385367  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.386121  4256 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:20:54.392627  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 121762us
I20260709 12:20:54.394249  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.395215  6403 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:54.395380  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.395843  6403 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.391774  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.396596  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.395502  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.391637  4257 raft_consensus.cc:2376] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3. Re-sending same reply.
I20260709 12:20:54.399641  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.400724  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.401723  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.402769  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.403465  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.405958  6434 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60130 (request call id 95) took 1829 ms. Trace:
I20260709 12:20:54.407670  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:54.408553  4331 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:54.409489  4983 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:54.411711  4327 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:54.412873  4327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:20:54.413695  4327 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.414099  4327 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:54.414247  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.344389  6459 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.416134  6439 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:54.391721  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.417541  4330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
W20260709 12:20:54.385516  6408 consensus_meta.cc:287] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
I20260709 12:20:54.397292  4252 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:54.415055  4253 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:54.426937  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.343724  6410 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.393456  6257 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:54.396329  6403 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.433928  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.351416  6264 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:20:54.357210  6457 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.481570  4256 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.482728  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:54.483613  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50605.6us
I20260709 12:20:54.485579  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.335410  6411 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:54.472281  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.477231  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.396318  4250 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:54.490477  4987 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:54.491132  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.406427  6434 rpcz_store.cc:276] 0709 12:20:52.583285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.587464 (+  4179us) service_pool.cc:224] Handling call
0709 12:20:53.003773 (+416309us) ts_tablet_manager.cc:1151] Deleting tablet fd41dc8658414bcfb8662c0efe3caffc
0709 12:20:53.003887 (+   114us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:53.941747 (+937860us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:54.225516 (+283769us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:54.405800 (+180284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261628,"tablet-delete.queue_time_us":252290,"thread_start_us":142030,"threads_started":1}
W20260709 12:20:54.507535  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 142049us
I20260709 12:20:54.509841  4989 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:54.511026  4989 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:54.513998  4408 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:54.513907  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.514838  4404 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:54.515760  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.516155  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.516685  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.517522  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:54.502792  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 56766.9us
I20260709 12:20:54.515779  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.520589  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.521991  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.522094  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:54.522964  6374 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:54.428861  6408 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.524248  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.524585  6374 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:54.524983  4401 raft_consensus.cc:2393] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:54.525173  6408 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.524996  6374 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:54.525751  4988 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:54.500918  4253 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
W20260709 12:20:54.504912  6300 consensus_meta.cc:287] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.004s
I20260709 12:20:54.506901  6257 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:54.488116  6230 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:54.503409  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:54.527024  4330 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.518473  4403 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:54.535332  4330 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:54.533468  4249 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:54.529619  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.536016  4329 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:54.536624  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.537453  4249 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.538496  4990 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:54.526032  6374 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:54.539541  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.541201  4256 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:54.541205  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.542559  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.542948  4257 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:54.544066  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.546341  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.547092  4252 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.547981  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.548709  4252 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:54.549558  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.550205  4252 raft_consensus.cc:2368] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
I20260709 12:20:54.550976  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.551748  4252 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:54.551622  6257 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:54.552270  4409 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:54.552167  6257 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:54.552580  4255 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:54.552794  6257 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:54.554073  4255 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:20:54.554726  4219 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:54.540120  6230 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.535912  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.565232  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:54.568265  4252 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:54.573494  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.573781  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:54.574769  4329 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:54.572362  6398 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.576321  6393 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:54.576794  6482 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:20:54.534917  6300 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.576967  6393 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:54.577998  6393 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:54.578770  6300 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.574309  4257 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:54.580222  4402 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:54.580986  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:54.581238  4401 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:54.572419  4252 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:54.579162  6411 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.585847  6446 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:54.586290  6230 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.586879  6410 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.587761  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:54.616413  4326 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:54.576789  6398 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:54.547152  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:54.594533  4256 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:54.628459  4406 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:54.598397  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.599417  6274 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:54.600356  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:54.600865  6427 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:54.602798  4247 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:54.583767  4296 leader_election.cc:400] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:20:54.614209  4255 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:54.615528  6446 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:55.001947  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.002490  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.002980  4296 leader_election.cc:403] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:54.664536  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 64245.9us
I20260709 12:20:54.676163  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.670588  4401 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:54.671335  4402 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:54.675698  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:54.974015  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 271444us
I20260709 12:20:54.696238  4330 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.008863  4331 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 3. Ops: []
I20260709 12:20:54.845070  4326 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:20:54.673749  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:54.677613  4955 leader_election.cc:336] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.681s (SENT)
I20260709 12:20:54.659619  4257 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:54.674252  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:54.986650  6478 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.662s	user 0.008s	sys 0.003s
I20260709 12:20:55.017740  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:54.998323  4986 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.020329  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.018213  4257 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:54.671205  6457 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:54.803274  6403 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.017022  6374 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.023233  6163 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:55.023766  6163 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.023372  4326 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.024722  6374 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.000541  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.025704  4328 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.026396  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.027479  4325 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:54.663980  6384 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.017230  6230 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:20:55.026858  4257 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:55.013412  4327 consensus_meta.cc:287] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.018s
I20260709 12:20:54.671600  6410 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:54.677800  6274 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:54.838531  6197 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:54.677963  6408 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.716349  6398 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.033085  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.034373  4403 raft_consensus.cc:2368] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:55.033049  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:55.036144  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.038232  4404 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.036553  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:54.995641  6257 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:54.674476  6444 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.032377  6374 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.047148  4257 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.047209  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.034196  6442 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:55.049784  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 506933us
I20260709 12:20:55.049773  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.046371  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 607) took 1438 ms. Trace:
I20260709 12:20:55.053287  4986 rpcz_store.cc:276] 0709 12:20:53.600881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.405618 (+804737us) service_pool.cc:224] Handling call
0709 12:20:54.997781 (+592163us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:20:54.998011 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.030003 (+ 31992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.039006 (+  9003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31660416}
I20260709 12:20:55.053004  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.054908  4408 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.055065  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:20:55.055984  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 378443us
I20260709 12:20:55.056088  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.040653  6197 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.058326  4407 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.058353  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.061846  4401 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.064568  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.065696  4325 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:55.036914  4327 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.070099  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1672) took 1124 ms. Trace:
I20260709 12:20:55.071241  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:55.071985  4255 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:55.072711  4329 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.073375  6197 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.070560  4254 rpcz_store.cc:276] 0709 12:20:53.945485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.954517 (+  9032us) service_pool.cc:224] Handling call
0709 12:20:53.968792 (+ 14275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:53.969395 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.969440 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:53.970093 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:20:54.180366 (+210273us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:54.180406 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.180474 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.985866 (+805392us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:20:55.068973 (+ 83107us) raft_consensus.cc:1685] finished
0709 12:20:55.068996 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.069989 (+   993us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"spinlock_wait_cycles":63724160,"thread_start_us":209821,"threads_started":1,"wal-append.queue_time_us":298414}
I20260709 12:20:55.056929  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.078150  4325 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 8. Ops: []
I20260709 12:20:55.075373  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.078568  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.079124  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.050675  6408 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.076599  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.081121  4326 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:55.081386  4400 raft_consensus.cc:2393] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.082988  4408 raft_consensus.cc:2393] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:55.075145  4327 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.050401  6384 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.050302  6374 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.086720  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:55.088454  6439 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:55.088778  6273 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:55.086557  4372 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.098912  4332 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:55.100101  6457 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:20:55.105650  4326 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:55.112012  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.106292  4247 raft_consensus.cc:2368] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:55.113575  6446 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:55.114409  6446 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:55.114730  6446 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.115684  6446 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.116930  6446 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.117242  6408 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.118803  4330 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.119627  6444 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:55.119719  6386 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:55.120394  6386 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.120765  6374 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.121330  6386 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.122081  6400 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:55.123440  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.123687  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.124293  4984 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:55.124321  4992 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:55.125118  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.125074  4983 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:55.111270  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.135926  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.137370  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.138079  4984 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:20:55.143836  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.144377  6457 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.144840  6457 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.144909  6384 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.145589  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.145875  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.145807  6457 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.146945  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.098444  6273 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:55.147521  4329 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:20:55.146283  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:55.147472  4401 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:55.148345  4403 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.148415  4329 pending_rounds.cc:85] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 6
I20260709 12:20:55.141469  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.150647  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.085327  6197 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:20:55.151269  4402 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:20:55.144448  4984 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:55.153079  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.153705  6273 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.154183  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.154860  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.119104  4328 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.149125  4329 pending_rounds.cc:107] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:20:55.158157  6374 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.158520  4329 raft_consensus.cc:2889] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:55.158578  6374 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:55.158751  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.159053  6374 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.154906  4402 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.153095  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.160522  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.155999  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.161510  4253 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:55.154989  6384 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.161283  6444 consensus_queue.cc:1059] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:20:55.147209  6457 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.154896  6310 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:20:55.168000  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.161398  4328 raft_consensus.cc:2368] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8.
I20260709 12:20:55.187805  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.170621  4218 leader_election.cc:400] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:55.188622  4218 leader_election.cc:403] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.185494  4408 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:55.155210  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.173638  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.173638  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.179905  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.104269  6274 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.171248  4405 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:55.187404  4988 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:55.171198  4404 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:55.184211  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:55.185139  4955 leader_election.cc:336] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.905s (SENT)
I20260709 12:20:55.179243  4400 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:55.197649  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:55.192807  4402 raft_consensus.cc:2368] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:55.164098  6403 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.164826  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.164050  6384 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:55.176244  6349 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.194286  4331 raft_consensus.cc:2393] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:55.194399  4296 leader_election.cc:400] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:55.131542  6439 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.198407  4325 raft_consensus.cc:2368] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3.
I20260709 12:20:55.199328  4256 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:55.200652  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.200866  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:55.201354  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.193092  6490 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:55.189656  6459 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:55.174852  4992 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:20:55.231388  6374 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.233762  6374 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.233834  4330 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:20:55.235461  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 64988.8us
I20260709 12:20:55.236405  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:20:55.236837  6480 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.911s	user 0.009s	sys 0.016s
I20260709 12:20:55.237361  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.239466  6427 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.239831  6427 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.240131  6427 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:55.243566  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 77829.4us
I20260709 12:20:55.244458  6273 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:55.172426  6163 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.221065  6459 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:55.245481  6459 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.216811  6386 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:55.246758  6386 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.246812  6163 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.189525  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.215008  4296 leader_election.cc:403] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:55.248646  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 65184us
I20260709 12:20:55.211992  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 409) took 1567 ms. Trace:
I20260709 12:20:55.249842  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:55.219584  4253 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.251533  4252 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.252691  6374 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:55.252875  4252 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.254245  6374 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:55.254653  6374 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:55.222712  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.255400  6444 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:55.255676  4256 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.255854  6444 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.213666  6384 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.256804  6444 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.257859  6444 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.258970  6490 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.259388  6490 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:55.259780  6490 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.224591  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:55.223151  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.261533  4247 raft_consensus.cc:2368] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3.
I20260709 12:20:55.262127  6400 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:55.255055  6374 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:55.263919  6386 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.265214  6386 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.265422  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.266363  6230 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.266808  6230 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:55.267282  6230 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.268771  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.270206  6408 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.270666  6408 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:55.271097  6408 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.249692  4409 rpcz_store.cc:276] 0709 12:20:53.644807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.646921 (+  2114us) service_pool.cc:224] Handling call
0709 12:20:55.211728 (+1564807us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54002a6cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:55.211903 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737340672}
I20260709 12:20:55.205592  6442 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:55.225832  6439 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:55.244681  4955 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.940s (SENT)
I20260709 12:20:55.275931  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:55.277204  6400 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:55.236894  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.284047  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.286607  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.287526  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.297878  4257 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:20:55.214820  4250 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.298595  4257 pending_rounds.cc:85] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 5
I20260709 12:20:55.301548  4257 pending_rounds.cc:107] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:20:55.299170  4325 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:20:55.297354  4956 leader_election.cc:400] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8.
I20260709 12:20:55.303268  4956 leader_election.cc:403] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.301985  4257 raft_consensus.cc:2889] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:55.260385  6257 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.328240  4219 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.331698  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.294900  6410 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:55.342309  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:55.343061  4326 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:55.345112  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.345968  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.346940  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.351907  4406 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:20:55.352851  4990 raft_consensus.cc:2393] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:55.227797  4137 catalog_manager.cc:5028] TS 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): tablet fd41dc8658414bcfb8662c0efe3caffc (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:20:55.356688  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.341979  6403 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:55.363960  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 209152us
I20260709 12:20:55.366104  4372 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.367237  4253 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:55.368492  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 81678.8us
I20260709 12:20:55.370621  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:55.386993  4137 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 159364us
I20260709 12:20:55.387463  4256 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.379612  4407 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:55.385226  4325 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.362468  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:55.393904  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 56542.6us
I20260709 12:20:55.395160  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.396914  4407 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.397114  4406 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:20:55.393038  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90902.1us
I20260709 12:20:55.396724  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.369412  6403 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.379752  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.385528  4327 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:55.388749  6163 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.415508  6410 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.416343  6163 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.416973  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.418756  6163 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:55.422935  4955 leader_election.cc:336] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 2.235s (SENT)
I20260709 12:20:55.423936  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.425660  6384 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.371055  4409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
W20260709 12:20:55.459501  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68517.7us
I20260709 12:20:55.407704  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.423405  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:55.460556  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 164474us
I20260709 12:20:55.411365  6491 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:20:55.463492  4956 leader_election.cc:400] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3.
I20260709 12:20:55.463490  4404 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:55.464038  4956 leader_election.cc:403] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.405508  6400 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:55.397851  6494 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.398788  4137 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:20:55.470963  4137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 72247.2us
I20260709 12:20:55.467690  4990 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.406832  6300 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.405372  6403 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.469199  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.473050  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.474934  4400 raft_consensus.cc:2393] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:55.415536  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.477703  4408 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:55.478428  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:20:55.484543  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.463718  6498 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.488116  4252 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:20:55.484125  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.489974  4252 pending_rounds.cc:85] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 5
I20260709 12:20:55.490275  4252 pending_rounds.cc:107] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:20:55.490275  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.490751  4252 raft_consensus.cc:2889] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:55.470320  4409 raft_consensus.cc:606] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.473845  6384 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.494289  4405 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:55.500296  4406 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:55.496457  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.500897  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.498890  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.499367  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.502826  4326 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:55.469745  6163 consensus_queue.cc:1059] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:20:55.486809  6444 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:20:55.509027  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 112366us
I20260709 12:20:55.491856  6272 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.516278  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:55.506636  6411 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:20:55.522893  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 99984.4us
I20260709 12:20:55.523139  4984 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
W20260709 12:20:55.539496  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52025.2us
I20260709 12:20:55.515457  6300 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.541500  6374 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:55.542757  6497 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:55.543466  4151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 388) took 2995 ms. Trace:
I20260709 12:20:55.543267  6274 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.544166  6506 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:55.544486  6330 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.551729  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcac1f47834987ac3889edd37f61a3 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41690
I20260709 12:20:55.552691  6427 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.537177  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.479727  6494 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.560844  6398 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:55.520444  6384 raft_consensus.cc:2764] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:55.566521  4990 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.566951  4989 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:20:55.540369  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.567663  4986 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:55.568813  6507 raft_consensus.cc:3055] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:55.569084  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.508178  6498 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.574178  6408 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.574765  4407 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:55.575451  6230 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.577457  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.579890  4987 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.651517  6500 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:55.654253  6498 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.643620  6349 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.654632  6494 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.634479  6507 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.655979  6507 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.657224  6507 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.658622  6230 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.654645  6500 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.660069  6300 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.661026  6374 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.661923  6500 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.662760  6427 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.653501  6310 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:55.663759  6310 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.663836  4250 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.664611  6408 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.664774  6310 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.566051  4151 rpcz_store.cc:276] 0709 12:20:52.479670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.479803 (+   133us) service_pool.cc:224] Handling call
0709 12:20:55.470622 (+2990819us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:53.472421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:53.473167 (+   746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:53.473213 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:20:53.473247 (+    34us) tablet.cc:662] Decoding operations
0709 12:20:53.474082 (+   835us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:53.474174 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:53.474213 (+    39us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:53.474918 (+   705us) tablet.cc:701] Row locks acquired
0709 12:20:53.474949 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:20:53.475141 (+   192us) write_op.cc:270] Start()
0709 12:20:53.483478 (+  8337us) write_op.cc:276] Timestamp: P: 1783599653475081 usec, L: 0
0709 12:20:53.489781 (+  6303us) op_driver.cc:348] REPLICATION: starting
0709 12:20:53.573755 (+ 83974us) log.cc:844] Serialized 2105 byte log entry
0709 12:20:53.898887 (+325132us) op_driver.cc:464] REPLICATION: finished
0709 12:20:54.127816 (+228929us) write_op.cc:301] APPLY: starting
0709 12:20:54.127940 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:54.128161 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:54.128313 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:54.165692 (+ 37379us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:54.166019 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:20:54.166062 (+    43us) write_op.cc:312] APPLY: finished
0709 12:20:54.166501 (+   439us) log.cc:844] Serialized 47 byte log entry
0709 12:20:54.166803 (+   302us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.166971 (+   168us) write_op.cc:454] Released schema lock
0709 12:20:54.167051 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:54.210859 (+ 43808us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.222949 (+ 12090us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7274,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":180840,"apply.run_cpu_time_us":3934,"apply.run_wall_time_us":49561,"num_ops":5,"prepare.queue_time_us":216410,"prepare.run_cpu_time_us":4475,"prepare.run_wall_time_us":123540,"replication_time_us":408664,"thread_start_us":280922,"threads_started":2}]]}
I20260709 12:20:55.666116  6310 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:55.666330  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.584081  4985 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:55.578469  6459 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.560124  6273 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:20:55.675393  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 206700us
I20260709 12:20:55.547174  6411 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:55.595641  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 79924us
I20260709 12:20:55.595742  6403 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.626317  6444 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:55.626994  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:20:55.628212  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 110871us
W20260709 12:20:55.628903  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 88613.4us
I20260709 12:20:55.589169  4325 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:55.672734  6264 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.688565  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.688694  6459 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.689615  4402 raft_consensus.cc:1240] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:55.693816  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.699230  6518 tablet_replica.cc:333] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:20:55.703132  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.710934  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:55.711969  6300 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.712141  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.712405  6300 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:55.712937  6501 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.713377  4371 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.713515  6300 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:55.714061  4371 raft_consensus.cc:2686] T fd41dc8658414bcfb8662c0efe3caffc P 899897e6794541b5ab538af361fc9e6c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:55.714890  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.701942  6349 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.718279  6349 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:55.719280  6349 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.720468  6349 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.724609  6403 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.727761  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.728432  4327 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.708382  6264 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.732650  4331 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:55.733028  6330 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3.
I20260709 12:20:55.734059  6490 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.734952  6400 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8.
I20260709 12:20:55.715984  6273 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:20:55.705471  6393 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.735754  6400 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.736209  6400 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:55.736244  6393 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:55.737123  6400 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.737277  6393 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.738250  6400 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.738761  4987 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 3. Ops: []
I20260709 12:20:55.739456  6512 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:20:55.740190  6427 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:20:55.744395  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53270.7us
W20260709 12:20:55.749881  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 233671us
W20260709 12:20:55.750473  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 226081us
I20260709 12:20:55.750698  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.753836  6274 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:20:55.756572  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.757088  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.757862  6459 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.759390  4371 leader_election.cc:400] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3.
I20260709 12:20:55.759258  6444 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:55.759717  4371 leader_election.cc:403] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:55.760325  6444 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:55.760514  6501 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.760728  6444 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.761530  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.761735  4332 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:55.761684  6444 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.760336  4325 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:20:55.768841  6446 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.743944  6427 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.763159  6444 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.756614  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.767951  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:55.789644  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:55.791633  6505 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:55.792054  6505 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.792418  6505 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.792549  6515 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:55.793507  6420 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:55.794366  6495 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:55.795336  6420 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:55.796643  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:55.797396  6495 raft_consensus.cc:2764] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:20:55.798729  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:20:55.799750  6495 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:55.800308  6495 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.800812  6495 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:55.808790  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.764832  6500 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.752097  6506 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:20:55.819234  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 51333.3us
I20260709 12:20:55.824548  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.831959  4406 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:20:55.826084  4985 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 609) took 2185 ms (client timeout 2167 ms). Trace:
W20260709 12:20:55.833076  4985 rpcz_store.cc:269] 0709 12:20:53.602485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.602617 (+   132us) service_pool.cc:224] Handling call
0709 12:20:53.990748 (+388131us) spinlock_profiling.cc:243] Waited 921 us on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:55.788219 (+1797471us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540071f2d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:55.788344 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3145505536}
I20260709 12:20:55.836334  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.836433  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.839757  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.771595  6519 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:20:55.780627  6512 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:20:55.848527  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.822912  6257 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.841754  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.843950  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.854516  4405 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
W20260709 12:20:55.852521  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.855798  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.834430  6446 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.803035  6505 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.823017  6410 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:20:55.858682  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:55.823109  6420 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:55.861055  4408 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:55.860740  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:55.856513  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 65368.6us
I20260709 12:20:55.860029  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:55.861783  4248 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.863637  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.864774  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:55.866231  4249 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.867007  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.868376  4407 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:55.864413  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.870144  4984 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:55.859686  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:55.877801  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:55.878118  4326 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:20:55.879422  6499 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.879923  6499 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.882030  6499 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.882683  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.868223  6446 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:55.883531  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.884248  6330 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:55.884101  6446 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.845834  6273 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:20:55.888862  4326 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:55.891283  4985 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:55.892652  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:55.895491  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.896474  6507 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:55.898571  4371 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.899596  6507 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:55.874104  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:55.918637  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:55.919553  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.915966  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:55.921636  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:55.922839  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 92114.4us
I20260709 12:20:55.925098  6507 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:55.925967  6349 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:55.923082  6427 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.927619  6505 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:55.903180  4992 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:55.907763  4409 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:55.908633  6506 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:55.940021  6518 raft_consensus.cc:2243] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.941016  6518 raft_consensus.cc:2272] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.942719  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 106354us
I20260709 12:20:55.943563  6384 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.944093  6384 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:20:55.944653  6510 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.385s	user 0.004s	sys 0.012s
I20260709 12:20:55.945041  6384 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:55.946265  4327 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:20:55.947903  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:55.948513  4333 raft_consensus.cc:1813] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:55.954591  4248 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.947822  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1820) took 1645 ms. Trace:
I20260709 12:20:55.948256  4219 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:55.958878  4333 raft_consensus.cc:2368] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:55.959336  4330 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:55.961864  4330 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:55.962747  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:55.965322  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.963487  4331 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:55.967420  4331 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:20:55.977262  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51170.9us
I20260709 12:20:55.982020  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:55.982790  4325 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:55.955969  4334 rpcz_store.cc:276] 0709 12:20:54.302224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.425490 (+123266us) service_pool.cc:224] Handling call
0709 12:20:54.466627 (+ 41137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.503792 (+ 37165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.503824 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:55.279534 (+775710us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b2c0005c2d8. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbaf677a11 00007fdbaf687372 00007fdbb0db9a01 00007fdbb0d7e43a 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2
0709 12:20:55.279999 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.492120 (+212121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:55.492159 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.492219 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:55.943978 (+451759us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:20:55.947612 (+  3634us) raft_consensus.cc:1685] finished
0709 12:20:55.947631 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:55.947762 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13953,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"spinlock_wait_cycles":53489152,"thread_start_us":206712,"threads_started":1,"wal-append.queue_time_us":259820}
I20260709 12:20:55.990187  6310 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:20:56.037547  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46792.8us
I20260709 12:20:56.038486  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:55.905248  6491 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:20:55.964886  6442 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:20:56.039918  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 78401.2us
I20260709 12:20:55.976955  6427 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:56.045223  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:56.047708  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:56.076973  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.986765  6490 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:55.990171  6420 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.901383  6531 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.137s
W20260709 12:20:56.084167  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 97831.8us
I20260709 12:20:56.085693  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:56.037192  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:55.986753  6499 consensus_queue.cc:1059] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:20:56.089828  4296 leader_election.cc:400] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:55.977308  6300 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:56.092000  4296 leader_election.cc:403] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.093068  6521 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:56.093963  6300 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:56.096673  6427 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:56.096753  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:56.104101  4371 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:56.079212  6442 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:56.083812  6374 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:56.086475  6420 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:56.106236  4328 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:56.149914  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 162966us
I20260709 12:20:56.108464  4955 leader_election.cc:400] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
I20260709 12:20:56.152034  4955 leader_election.cc:403] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.108937  6310 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:56.048527  6459 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:20:56.111819  4403 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:20:56.044179  6197 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:20:56.077983  6398 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:20:55.995929  6529 consensus_queue.cc:1059] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:20:56.101200  4991 raft_consensus.cc:1813] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Handling vote request from an unknown peer 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:56.142608  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:56.213872  4985 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:56.145388  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:56.090420  6509 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:56.121071  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.106714  6411 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.176491  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:56.178656  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:56.177563  6420 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:56.179286  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:56.175655  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:56.167002  6501 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3.
I20260709 12:20:56.149174  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:56.135521  6300 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:20:56.147867  6540 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.168442  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:56.165930  6523 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:56.215831  6509 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:56.193867  6532 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:20:56.195391  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:56.151796  6518 ts_tablet_manager.cc:1916] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:20:56.167744  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59443.1us
I20260709 12:20:56.166761  6349 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
W20260709 12:20:56.208398  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.270390  6420 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:56.149493  6374 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:56.195904  6500 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.285483  6374 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.209448  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:56.216989  4219 leader_election.cc:400] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3.
I20260709 12:20:56.286747  4219 leader_election.cc:403] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:56.286708  4986 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:56.223456  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:56.187986  6427 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:56.268214  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8453600990001178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 12:20:56.289831  4296 connection.cc:256] RPC call timeout handler was delayed by -1.830060099000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:20:56.253381  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 57410.4us
I20260709 12:20:56.148277  6490 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:56.262055  4989 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:20:56.264722  4990 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:20:56.290170  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8282600990000901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:20:56.292286  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8012600990000465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 12:20:56.292598  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7976600990000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:20:56.292874  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7004600989998835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:20:56.293125  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6905600989998675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:20:56.293390  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6536600990002626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:20:56.294044  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6194600990002073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:20:56.294340  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5861600990001534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 12:20:56.294761  4296 connection.cc:256] RPC call timeout handler was delayed by -1.4340600989999075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:20:56.295123  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3611600990002444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:20:56.215766  6495 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:56.295517  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3467600990002211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 12:20:56.268887  4991 raft_consensus.cc:2410] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:20:56.297086  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3242600990001847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:20:56.297420  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3233600990001833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 12:20:56.297770  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3152600990001702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 12:20:56.293242  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:56.298058  4296 connection.cc:256] RPC call timeout handler was delayed by -1.2963600990001396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:20:56.298435  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0614600990002145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2396s for a response
I20260709 12:20:56.208881  6442 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:56.300958  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 132571us
W20260709 12:20:56.302670  4219 raft_consensus.cc:2686] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:20:56.303001  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 86151.3us
I20260709 12:20:56.257508  4983 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:56.251459  4988 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:20:56.306216  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:56.309605  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:56.310302  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.310789  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.324177  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:56.324568  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.324759  4248 raft_consensus.cc:2376] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3. Re-sending same reply.
I20260709 12:20:56.266475  6509 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.312647  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:56.316020  4253 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.318536  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.290382  6501 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:20:56.303661  6512 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:20:56.354274  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:56.354475  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.325300  4249 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:56.299853  6411 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.464191  4257 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:56.478000  4984 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:20:56.444911  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 138781us
I20260709 12:20:56.433202  4406 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:56.465090  4254 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:20:56.414023  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 100273us
I20260709 12:20:56.459554  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.312285  6310 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:20:56.811338  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.350260  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 796) took 1018 ms. Trace:
I20260709 12:20:56.676214  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:56.818643  4248 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:56.411219  4153 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:56.814837  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 502227us
I20260709 12:20:56.635499  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:56.819761  4256 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:56.819998  4257 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:56.687537  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:56.354208  4250 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:20:56.445044  6444 consensus_meta.cc:287] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.632s	user 0.003s	sys 0.006s
I20260709 12:20:56.812044  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:56.411877  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 102352us
I20260709 12:20:56.825883  4333 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.826346  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:56.405256  6535 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:20:56.386574  6495 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:56.400334  6264 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:56.817289  4958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.060s	sys 0.103s
I20260709 12:20:56.831070  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:56.831473  4958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.060s	sys 0.103s
W20260709 12:20:56.832485  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.381318  6459 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:56.807258  6548 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.548s	user 0.000s	sys 0.002s
I20260709 12:20:56.441944  6163 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:56.825275  6300 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.444795  6400 raft_consensus.cc:3055] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:56.355209  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.354803  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.821417  4249 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:56.823594  4153 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 3, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.829113  4333 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:56.753486  6257 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:56.610026  6519 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:56.829818  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:56.836167  6408 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:20:56.443861  6544 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:20:56.315982  6490 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:56.458019  6374 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:56.834128  6501 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:56.445078  6197 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:20:56.850749  4374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.028s	sys 0.030s
W20260709 12:20:56.860601  4374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.028s	sys 0.031s
I20260709 12:20:56.852630  4153 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.862109  4153 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 5, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.838124  6163 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:56.842203  6459 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:56.818017  4991 rpcz_store.cc:276] 0709 12:20:55.324687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.327458 (+  2771us) service_pool.cc:224] Handling call
0709 12:20:55.988245 (+660787us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:56.343492 (+355247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11033856}
I20260709 12:20:56.847656  6495 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:56.844209  6400 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:56.902320  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:56.889045  6549 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:20:56.888568  6542 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:56.894294  6374 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:56.897879  6517 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:56.889698  6551 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:20:56.900429  4252 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
W20260709 12:20:56.871941  6511 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 1.234s	user 0.010s	sys 0.017s
W20260709 12:20:56.904174  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49929us
I20260709 12:20:56.895957  6490 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:56.864676  6197 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.919209  4257 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
W20260709 12:20:56.923556  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 68735.2us
I20260709 12:20:56.915062  4248 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:20:56.941792  4984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:20:56.960718  4984 raft_consensus.cc:606] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:56.961160  4984 raft_consensus.cc:614] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:56.845041  6300 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:56.837849  6444 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:20:56.964946  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:56.965049  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:56.948622  4330 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.965691  4405 raft_consensus.cc:2368] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:20:56.965204  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:56.949721  4334 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:56.965853  4329 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:56.949903  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:56.967170  4248 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.951829  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:56.863843  6257 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:56.968290  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:56.968595  4407 raft_consensus.cc:2376] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3. Re-sending same reply.
I20260709 12:20:56.968895  4257 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:56.965173  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:56.970538  4407 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:20:56.973323  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:56.947988  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 82224.5us
W20260709 12:20:56.964156  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 96915.7us
W20260709 12:20:56.954964  6494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.031s	sys 0.031s
I20260709 12:20:56.944083  6330 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:56.993569  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:56.948585  6542 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:56.953838  6517 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:56.965615  6197 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.000119  4254 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:56.987327  6494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.031s	sys 0.033s
I20260709 12:20:56.873118  6310 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.008451  4257 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:56.987440  6533 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:56.989002  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:57.013474  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:57.017204  4407 raft_consensus.cc:2376] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3. Re-sending same reply.
I20260709 12:20:56.985646  6264 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:20:56.986928  6420 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:20:57.027630  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:56.950122  6501 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:20:57.026772  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:57.015738  6533 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.031649  4402 raft_consensus.cc:2368] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:57.028499  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:57.038875  4400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:57.015424  6549 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:20:57.040298  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 51402.4us
I20260709 12:20:57.040545  4400 raft_consensus.cc:606] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.044250  4400 raft_consensus.cc:614] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:56.997812  6330 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.028910  6374 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.031278  6349 raft_consensus.cc:2764] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:20:56.985239  6459 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.049551  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:57.071595  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 44952.3us
I20260709 12:20:57.050948  4955 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.035948  6515 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.038875  6490 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.040257  6533 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:57.044473  6499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.015s	sys 0.004s
I20260709 12:20:57.012075  6400 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.077443  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:57.084098  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.087973  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:57.079197  6499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.016s	sys 0.004s
I20260709 12:20:57.106290  4407 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:20:57.077654  6521 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.075781  6515 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:57.084470  6420 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:20:57.052300  6509 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.068979  6549 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.114184  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.112787  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:57.122200  6556 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:57.118847  6505 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.119495  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:57.125859  6519 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:57.127353  6519 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.127713  6519 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:57.116823  4405 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:20:57.128489  6519 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.129411  6330 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.129725  6519 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.129601  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:20:57.130805  4405 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.125998  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.126106  4407 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:57.130831  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.132908  4325 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:57.132709  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:57.135361  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.138803  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1643) took 1291 ms. Trace:
I20260709 12:20:57.139187  4253 rpcz_store.cc:276] 0709 12:20:55.847455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.853536 (+  6081us) service_pool.cc:224] Handling call
0709 12:20:55.863499 (+  9963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.483259 (+619760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.138562 (+655303us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54000f3a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:57.138740 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040230656}
I20260709 12:20:57.139927  6257 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.080687  6542 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.140383  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2279) took 1299 ms. Trace:
I20260709 12:20:57.140877  6542 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.140729  4406 rpcz_store.cc:276] 0709 12:20:55.841425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.841540 (+   115us) service_pool.cc:224] Handling call
0709 12:20:57.140210 (+1298670us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400286754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:57.140330 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946362240}
I20260709 12:20:57.142613  4406 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:20:57.143460  6300 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:57.144842  6533 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.111195  6490 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.111023  4250 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:20:57.149042  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.151399  4325 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:57.154397  4401 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
W20260709 12:20:57.170431  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 44565.9us
I20260709 12:20:57.172260  4408 raft_consensus.cc:2368] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 4.
W20260709 12:20:57.286199  4955 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.644s (SENT) [suppressed 33 similar messages]
I20260709 12:20:57.186605  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:57.221328  4254 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:57.337775  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.150909  6411 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.277696  4407 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
W20260709 12:20:57.165117  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 171646us
I20260709 12:20:57.247519  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.186940  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:20:57.184454  6565 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:20:57.248699  6515 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.370249  6515 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.331039  6551 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.373865  6257 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:57.333118  6517 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.374392  6197 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.375114  6517 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:57.375439  6549 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:57.376497  6197 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:57.376894  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 129496us
I20260709 12:20:57.373872  6551 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.379354  6400 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.380398  6551 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:57.383858  6408 consensus_meta.cc:287] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 12:20:57.384264  6408 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:57.385605  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2187) took 1081 ms. Trace:
I20260709 12:20:57.385973  4332 rpcz_store.cc:276] 0709 12:20:56.304576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.304864 (+   288us) service_pool.cc:224] Handling call
0709 12:20:56.324233 (+ 19369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.350906 (+ 26673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.350932 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.367202 (+ 16270us) log.cc:844] Serialized 26 byte log entry
0709 12:20:56.915780 (+548578us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b18002d1a20. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:20:57.076250 (+160470us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:20:57.076295 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.076363 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.371540 (+295177us) raft_consensus.cc:1685] finished
0709 12:20:57.371563 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.385540 (+ 13977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95311,"raft.queue_time_us":32488,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10797,"spinlock_wait_cycles":8318720,"thread_start_us":160287,"threads_started":1,"wal-append.queue_time_us":741005}
I20260709 12:20:57.387019  6163 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.387662  6446 raft_consensus.cc:3055] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.388108  6163 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.390301  6518 ts_tablet_manager.cc:1929] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:20:57.390753  6518 log.cc:1199] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/8afcac1f47834987ac3889edd37f61a3
I20260709 12:20:57.150636  6349 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.391601  6349 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.337180  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:20:57.392813  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55749.1us
I20260709 12:20:57.393074  6457 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:20:57.239387  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50371us
I20260709 12:20:57.393926  6349 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.173854  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:20:57.357901  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.151237  6490 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.398032  6490 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.398492  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:57.398772  6457 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:57.399127  4247 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:57.399438  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.343703  6499 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:57.399808  6568 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:57.400234  6568 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:57.400226  6499 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.401401  6568 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.402319  6499 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:57.391906  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2271) took 1571 ms. Trace:
I20260709 12:20:57.402938  6568 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.403369  6257 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:57.403467  4403 rpcz_store.cc:276] 0709 12:20:55.820285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.828893 (+  8608us) service_pool.cc:224] Handling call
0709 12:20:57.391710 (+1562817us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54002a80d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:57.391846 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623898496}
I20260709 12:20:57.404841  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:57.405519  4403 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:57.402959  6500 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.407447  6500 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:57.408205  6500 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.409296  6500 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.410244  4406 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:57.360003  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.402509  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.256669  4409 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.150830  4402 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:20:57.410512  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:57.330637  6530 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 1.163s	user 0.006s	sys 0.000s
I20260709 12:20:57.255999  6529 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:57.422981  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:57.186493  6509 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:57.422962  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.185874  6512 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.427428  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:57.429782  4332 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.367281  4405 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:57.360584  6495 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:57.359347  6533 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:57.245397  6272 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:57.419239  6349 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.450223  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.451174  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.452920  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.455664  4329 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.456661  4330 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:57.457965  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:57.415171  6300 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.388118  6446 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:57.454497  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.472554  4333 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:57.457450  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:20:57.461769  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.429298  6549 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.428715  6515 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:57.184342  6442 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.246s
I20260709 12:20:57.422578  6529 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:57.483311  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.469756  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:57.486465  4334 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:57.439872  6459 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.486974  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 44508.2us
I20260709 12:20:57.489549  4405 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:20:57.492475  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.495632  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 117640us
I20260709 12:20:57.497788  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.498641  4329 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:57.474375  6272 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.503595  6507 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:20:57.504550  6507 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:57.505861  6507 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.506151  4984 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:20:57.506495  4984 pending_rounds.cc:85] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 6
I20260709 12:20:57.506282  6507 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.506747  4984 pending_rounds.cc:107] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:20:57.506987  4984 raft_consensus.cc:2889] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:57.507472  6498 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:57.507859  6498 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:57.484048  6349 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.475373  6300 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.474787  6551 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:20:57.511631  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81787.2us
I20260709 12:20:57.515556  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.516420  4330 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:57.518074  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:57.518659  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:57.521728  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.523510  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:57.489178  6521 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:57.526208  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:57.527740  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 241573us
I20260709 12:20:57.524215  4984 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:57.452572  6512 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.491545  6518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41690 (request call id 94) took 1968 ms. Trace:
I20260709 12:20:57.528131  4372 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:57.531780  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:57.499868  6549 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:57.533058  4985 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:57.535089  4330 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:57.536087  4372 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:57.536288  4955 leader_election.cc:336] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.834s (SENT)
I20260709 12:20:57.537614  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.489583  6515 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.528079  6519 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.528335  6554 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:57.499694  6459 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.547766  4990 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:57.543560  4327 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.550197  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:57.538582  6550 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:20:57.560384  6569 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:57.560492  6550 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.561043  6550 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:57.561196  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:57.550994  6563 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:57.551537  6349 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.551934  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:57.530678  6551 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:57.555594  6554 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:57.546433  6552 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:20:57.583365  4248 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:57.577473  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:57.583032  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1694) took 1150 ms. Trace:
I20260709 12:20:57.566989  4332 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:57.594493  4401 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:57.594077  4254 rpcz_store.cc:276] 0709 12:20:56.432717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.824203 (+391486us) service_pool.cc:224] Handling call
0709 12:20:57.582857 (+758654us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400120f54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:57.582966 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343579392}
I20260709 12:20:57.595745  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:57.534686  6529 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.597846  6374 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:57.569705  6505 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:57.584970  6498 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.546811  6578 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.605574  6578 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:57.604223  6550 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.605886  6498 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:57.633909  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 56554.1us
W20260709 12:20:57.624006  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 105407us
I20260709 12:20:57.563242  6519 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.605986  6578 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:57.561311  6446 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:57.635942  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.589871  6459 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:57.573879  6512 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.580466  6579 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.532629  6518 rpcz_store.cc:276] 0709 12:20:55.519767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.551439 (+ 31672us) service_pool.cc:224] Handling call
0709 12:20:55.698774 (+147335us) ts_tablet_manager.cc:1151] Deleting tablet 8afcac1f47834987ac3889edd37f61a3
0709 12:20:55.698849 (+    75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:56.960486 (+1261637us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:57.390153 (+429667us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:57.471539 (+ 81386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88851,"tablet-delete.queue_time_us":103098,"thread_start_us":74986,"threads_started":1}
I20260709 12:20:57.655555  6197 consensus_queue.cc:1059] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:20:57.655906  6579 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.657339  6490 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:20:57.658779  6579 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:57.659416  6579 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.659992  6579 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.660104  6551 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:57.639675  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 104069us
W20260709 12:20:57.661907  4955 leader_election.cc:336] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.851s (SENT)
I20260709 12:20:57.662029  6505 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.662381  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:57.569525  6264 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.538946  6549 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:57.579866  6521 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.577548  6272 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.569043  6515 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:57.566166  6563 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.645306  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:57.636525  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 175108us
W20260709 12:20:57.647897  6542 consensus_meta.cc:287] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 12:20:57.645008  6509 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:57.633137  6349 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:57.640328  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.662604  6505 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:57.931494  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 291331us
I20260709 12:20:58.107245  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:20:57.939929  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 267792us
I20260709 12:20:57.671759  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2186) took 1359 ms. Trace:
I20260709 12:20:57.828446  6490 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:57.929620  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:57.974572  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.890884  6507 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:58.126106  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.940315  6446 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.894659  4986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
W20260709 12:20:57.941941  6559 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.151s	user 0.000s	sys 0.005s
W20260709 12:20:57.942523  6570 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.690s	user 0.004s	sys 0.011s
W20260709 12:20:57.923235  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 364933us
W20260709 12:20:57.822279  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:58.002719  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 340807us
W20260709 12:20:58.142267  4955 leader_election.cc:336] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 2.157s (SENT)
I20260709 12:20:57.987116  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1652) took 1141 ms. Trace:
W20260709 12:20:57.914302  6411 consensus_meta.cc:287] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 12:20:58.088306  6579 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:57.699086  6533 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:57.840387  6230 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.570371  4247 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:57.882711  6408 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:57.640964  6499 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.091459  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:57.773494  6554 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.096421  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:58.164166  4334 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:58.127482  6519 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.100152  6578 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:57.929327  6512 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.878336  6330 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.111670  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 8afcac1f47834987ac3889edd37f61a3 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
W20260709 12:20:58.114992  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 182814us
I20260709 12:20:58.108421  6563 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:58.122965  6550 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.091917  6374 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:58.128327  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.093737  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:58.130591  4402 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: []
I20260709 12:20:58.132104  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.209722  4405 raft_consensus.cc:2410] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:58.135568  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.109155  6300 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:58.213551  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:58.151858  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.106616  6509 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:58.099361  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.215597  4327 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:58.128002  6349 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:58.132560  6507 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.163224  6411 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:58.093458  6264 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.170862  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:58.148267  4986 raft_consensus.cc:606] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.128815  6257 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:20:58.162159  6457 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.243044  6457 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.245311  6554 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:58.245839  6457 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:58.248065  6586 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:58.259796  6501 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:58.262633  6498 consensus_meta.cc:287] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 12:20:58.265233  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:20:58.195799  4137 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 84148.4us
W20260709 12:20:58.196542  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.161561  6408 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.220695  6509 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:58.157002  6495 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:58.197958  4409 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:20:58.197955  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.172503  4404 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:20:58.144115  4248 rpcz_store.cc:276] 0709 12:20:56.845798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.978258 (+132460us) service_pool.cc:224] Handling call
0709 12:20:57.583173 (+604915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.593584 (+ 10411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.986800 (+393216us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400120f50. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:57.987024 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341958912}
I20260709 12:20:58.217530  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:58.282042  4329 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:20:58.223088  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 87622.4us
I20260709 12:20:58.283706  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.284406  4254 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:58.285058  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.285776  4252 raft_consensus.cc:2368] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
I20260709 12:20:58.226552  4372 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:58.228307  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.161681  6230 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:58.170132  4247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1653) took 1316 ms (client timeout 1584 ms). Trace:
W20260709 12:20:58.236990  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 71013.8us
I20260709 12:20:58.241434  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 437) took 1115 ms. Trace:
I20260709 12:20:58.291801  4331 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:20:58.108762  4328 rpcz_store.cc:276] 0709 12:20:56.304156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.311146 (+  6990us) service_pool.cc:224] Handling call
0709 12:20:56.354993 (+ 43847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:56.412316 (+ 57323us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:20:56.412379 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:56.413065 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.406203 (+993138us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18002c60e0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:20:57.539189 (+132986us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:57.546251 (+  7062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.556985 (+ 10734us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.597428 (+ 40443us) raft_consensus.cc:1685] finished
0709 12:20:57.600042 (+  2614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.663629 (+ 63587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139951,"raft.queue_time_us":13267,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":11904,"spinlock_wait_cycles":26014336,"thread_start_us":123762,"threads_started":1,"wal-append.queue_time_us":1167603}
I20260709 12:20:58.298516  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.298655  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.167903  6499 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:58.290571  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 64107.7us
I20260709 12:20:58.225762  4983 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:58.213434  6549 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:58.294335  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.294446  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.295089  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:58.303573  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.233736  6552 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.195966  6512 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.304548  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.295714  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:58.313162  4330 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:58.297019  6529 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:20:58.297351  4247 rpcz_store.cc:269] 0709 12:20:56.849751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.959251 (+109500us) service_pool.cc:224] Handling call
0709 12:20:57.398332 (+439081us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:58.164222 (+765890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12594048}
I20260709 12:20:58.289867  4334 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:58.219172  6374 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.291920  4407 rpcz_store.cc:276] 0709 12:20:57.125524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.414281 (+288757us) service_pool.cc:224] Handling call
0709 12:20:57.414543 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:57.429890 (+ 15347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:57.429924 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:57.470558 (+ 40634us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.928861 (+458303us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:20:57.928912 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.928978 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:58.240819 (+311841us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54000baf20. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cf3dbe 00007fdbb0cfe930 00007fdbb0cfe8d8 00007fdbb0cfe858 00007fdbb0cfe813 00007fdbb0cfda9c 00007fdbb6be92f6 00007fdbb6be3aa8 00007fdbb0d3a7cb 00007fdbb0d3d2c0
0709 12:20:58.241129 (+   310us) raft_consensus.cc:1685] finished
0709 12:20:58.241152 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:58.241375 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6168,"raft.queue_time_us":11400,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":19541,"spinlock_wait_cycles":93492608,"thread_start_us":127183,"threads_started":1,"wal-append.queue_time_us":326717}
I20260709 12:20:58.299140  4254 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:58.229470  6519 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:20:58.302280  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 141715us
I20260709 12:20:58.307265  4249 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:58.307364  4256 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 2: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:58.295652  6408 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.306006  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.207279  6330 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.319483  6230 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:58.319751  6499 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:58.320094  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:58.320580  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:58.322067  6593 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:20:58.326280  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.373186  4248 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:58.373818  4252 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:20:58.326056  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:58.375797  4257 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:58.329746  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:20:58.376580  4249 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:58.303349  6594 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:58.381843  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.382697  4334 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:58.330791  4256 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:58.329396  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:20:58.329031  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 164255us
I20260709 12:20:58.386195  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.336581  4329 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:20:58.233385  6507 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.306767  6495 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:20:58.387701  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:20:58.329870  6411 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.393930  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.348958  4254 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:58.304744  6459 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:20:58.325781  4255 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
W20260709 12:20:58.404561  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 75240.3us
I20260709 12:20:58.406841  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.409449  4256 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:58.313860  6583 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.413166  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5f00fff96847178a1970711feff2f0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:20:58.372728  6515 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.415086  4249 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:20:58.425433  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1516) took 1348 ms. Trace:
I20260709 12:20:58.323724  6552 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:58.429729  4404 rpcz_store.cc:276] 0709 12:20:57.077922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.078429 (+   507us) service_pool.cc:224] Handling call
0709 12:20:58.425216 (+1346787us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54000aee54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:58.425355 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086972160}
I20260709 12:20:58.434875  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.390641  6594 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:58.396412  6442 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:58.396245  6499 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.341912  6264 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:58.411164  6459 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.404531  6550 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.443163  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.415362  6300 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:58.451155  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:58.422144  6273 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:58.430151  6583 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:58.459450  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 63896.6us
I20260709 12:20:58.422748  6517 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.478901  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:58.460419  4256 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:20:58.479537  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 82845.5us
I20260709 12:20:58.444075  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.454586  4247 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:20:58.446802  6598 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:20:58.463866  6459 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:58.470489  4407 raft_consensus.cc:606] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.498559  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:58.498819  4407 raft_consensus.cc:614] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:58.432260  6505 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:58.472987  4984 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:58.347535  6349 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.480444  4252 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:20:58.422811  6533 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:20:58.479562  4992 raft_consensus.cc:1813] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Handling vote request from an unknown peer 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:58.520982  4992 raft_consensus.cc:2410] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:20:58.465082  4257 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:20:58.483355  4985 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:20:58.446393  6594 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:58.483489  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:58.436703  6551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.026s	sys 0.030s
I20260709 12:20:58.412583  6411 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.469601  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.528403  4248 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:58.488330  6512 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:58.483139  6517 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.488919  6273 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:20:58.489423  6591 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:20:58.491315  6552 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:58.491878  6597 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.509584  4254 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:20:58.436946  6515 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.457755  6499 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:58.527832  6521 consensus_meta.cc:287] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.522s	user 0.003s	sys 0.007s
W20260709 12:20:58.528093  6551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.027s	sys 0.030s
I20260709 12:20:58.495051  6578 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.575564  6273 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.479347  6550 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:58.541448  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:58.483887  6272 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 12:20:58.584918  6606 log.cc:927] Time spent T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:20:58.520527  6495 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:58.620223  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 141072us
I20260709 12:20:58.727905  4253 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
W20260709 12:20:58.727568  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 229107us
I20260709 12:20:58.746424  4984 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:20:58.747967  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.563126  6257 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:58.738982  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.569419  6408 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:58.579883  6521 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:58.570401  6552 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.587709  4986 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
W20260709 12:20:58.680701  6446 consensus_meta.cc:287] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.003s
I20260709 12:20:58.705116  6442 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:58.614967  6374 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:58.766587  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.750480  6310 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.767829  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.570806  6597 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:58.757102  4983 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:20:58.788651  4330 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:20:58.846302  4372 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:58.849970  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.608038  6330 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:58.678879  6515 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.612613  6517 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:58.774171  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.870216  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.779211  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:58.735894  6608 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:20:58.761297  6563 consensus_meta.cc:287] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.002s
I20260709 12:20:58.740978  6554 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.766902  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:58.761533  6408 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:58.868589  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.838191  6411 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.778690  6257 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:58.790639  6552 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.788412  6619 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.241s
I20260709 12:20:58.870564  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.886938  4256 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:20:58.870934  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.870961  4331 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
W20260709 12:20:58.906052  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.301380  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0753305749999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2924s for a response
I20260709 12:20:58.847553  6501 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.304003  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 538856us
I20260709 12:20:59.304152  6501 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.284794  6550 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.305482  4404 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:59.306118  6521 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:59.307566  6501 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.309026  6563 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.303272  6614 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:59.303331  4253 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:20:59.302121  4955 leader_election.cc:336] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 2.629s (SENT)
W20260709 12:20:59.181900  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.311242  6563 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.310696  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:20:59.136621  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.312674  6533 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:58.836584  6596 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.313176  6533 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:59.313330  6554 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.313517  6596 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.314091  6533 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.315092  6533 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.315765  6554 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:58.928782  6611 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:20:59.308655  4296 leader_election.cc:400] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:20:59.316946  6611 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.317863  4296 leader_election.cc:400] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:20:59.318198  4296 leader_election.cc:403] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:59.319613  6521 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:20:59.320380  6611 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.320946  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:59.321818  6521 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:59.322310  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.322883  6257 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.323195  6521 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:58.983980  6605 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:20:59.312709  4329 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:20:59.311141  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.963431  4330 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:58.916824  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.774837  6612 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:59.323269  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:59.323508  6257 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.327139  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:59.339936  6257 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.340355  4329 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.067586  6594 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:58.861140  6601 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:58.850288  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:58.973796  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:58.973775  6459 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:58.917157  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:58.931605  6542 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.421s
I20260709 12:20:58.849977  6446 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.789687  6551 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.923723  6457 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:20:59.324610  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 557756us
I20260709 12:20:59.404006  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:59.405434  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:59.350809  4330 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:20:59.373109  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:59.406744  4407 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:20:59.070310  6509 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.760s	user 0.011s	sys 0.000s
I20260709 12:20:59.378813  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:20:59.408730  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.408994  4329 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:59.409310  4403 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:59.409574  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:20:59.318755  6614 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:59.302376  6408 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.067773  6515 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.411737  6457 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.418773  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:59.418830  6515 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.419862  4255 raft_consensus.cc:2368] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
I20260709 12:20:59.420931  6457 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.422662  6257 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.331413  6330 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.423553  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:59.009362  6230 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:20:59.423822  6614 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:59.424273  6230 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.426528  6230 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.336345  6554 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:59.400302  6601 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:58.870117  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 827) took 1329 ms. Trace:
I20260709 12:20:59.252354  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:59.330952  6615 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.329732  6589 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:59.323434  6596 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:20:59.329208  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.433825  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.366874  6517 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.363242  6411 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.860481  6310 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.410391  4372 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.409338  4326 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:59.440140  6601 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.441150  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.441527  6310 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.441778  4326 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:59.442140  6310 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:59.442651  6310 raft_consensus.cc:697] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:59.442762  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.411476  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.324121  6605 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.443583  4329 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:59.443953  6310 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.423561  6330 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.412132  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.445250  6605 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.415530  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:59.446121  4253 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:59.446309  6330 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.446820  6330 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.370103  6619 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.447762  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.447628  6619 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.448602  4372 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.449375  6596 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.449716  6619 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.424275  4254 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:20:59.381628  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:59.421142  6515 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.402454  6446 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.451139  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:59.451249  4330 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:20:59.452028  6459 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.452252  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.452510  6446 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.452641  6621 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.413220  6501 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:59.453333  6501 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:20:59.453159  6621 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.453516  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.454089  4330 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:20:59.454255  6501 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.428643  4331 raft_consensus.cc:2410] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:20:59.435245  4988 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.450780  6605 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.402959  4328 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:59.429095  6257 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.444499  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.437180  6442 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.447252  6330 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.416687  6563 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:20:59.411911  6550 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:20:59.416195  6598 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.408444  6551 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.416882  6509 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.363164  6608 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.459757  4329 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:20:59.456396  4326 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:20:59.480971  4409 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:20:59.487517  4372 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:59.544647  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 57210.6us
I20260709 12:20:59.545675  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.466558  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2203) took 1173 ms. Trace:
I20260709 12:20:59.506275  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.549561  4329 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
W20260709 12:20:59.550848  4333 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.021s
W20260709 12:20:59.552142  4333 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.022s
I20260709 12:20:59.547462  4327 rpcz_store.cc:276] 0709 12:20:58.293693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.296423 (+  2730us) service_pool.cc:224] Handling call
0709 12:20:58.296749 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:58.383769 (+ 87020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.383817 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:58.383874 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:58.383929 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.466335 (+1082406us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b54001d6ad4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:20:59.466381 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:59.466501 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199579008}
I20260709 12:20:59.459147  4330 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:59.456818  6594 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:20:59.582253  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 280323us
I20260709 12:20:59.470440  6598 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.439441  6349 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:20:59.449746  6596 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.457592  6552 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.456209  6605 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.470264  6597 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:20:59.605223  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 58356.8us
I20260709 12:20:59.465413  6330 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.607502  4330 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:59.455251  6621 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.467237  6505 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:59.483125  6542 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.611405  6598 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.541953  6264 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.475044  6509 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.472323  6551 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.467737  4988 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:59.552600  6550 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:59.478814  6608 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.458801  6411 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.579999  6563 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.436515  6615 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.551935  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:20:59.428949  4983 rpcz_store.cc:276] 0709 12:20:57.528062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.530119 (+  2057us) service_pool.cc:224] Handling call
0709 12:20:57.937882 (+407763us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:58.857861 (+919979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4005760}
I20260709 12:20:59.459448  6257 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.659350  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:59.616153  6349 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.460566  6442 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:20:59.632085  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 308868us
I20260709 12:20:59.663394  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:20:59.459757  6517 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.472023  6408 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.646287  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 831) took 1188 ms. Trace:
I20260709 12:20:59.616994  6596 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.643194  4984 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:20:59.627069  6605 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.643424  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.632107  6552 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.638358  6505 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:20:59.642393  6621 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.629014  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.684894  6608 consensus_queue.cc:1059] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
W20260709 12:20:59.822193  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 193272us
I20260709 12:20:59.657622  4330 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.631137  6589 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:20:59.643026  6550 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.829731  6550 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:59.831519  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.832788  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.798578  6442 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.833442  4325 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:20:59.703687  6552 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.834000  4330 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.835227  6608 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:59.835542  6552 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.835644  6608 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:20:59.836542  6608 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.837621  6608 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.838515  6596 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.839746  6505 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.786180  6411 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.840781  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.841114  6505 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.841629  4334 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:20:59.842113  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1873) took 1080 ms. Trace:
I20260709 12:20:59.842644  6598 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:20:59.669585  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 260059us
I20260709 12:20:59.629156  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:59.848055  4256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1663) took 1374 ms (client timeout 1708 ms). Trace:
I20260709 12:20:59.673799  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:59.842445  4334 rpcz_store.cc:276] 0709 12:20:58.776860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.777991 (+  1131us) service_pool.cc:224] Handling call
0709 12:20:59.840625 (+1062634us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:59.842033 (+  1408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3371776}
I20260709 12:20:59.851578  4992 raft_consensus.cc:1813] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:20:59.852079  4992 raft_consensus.cc:2368] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 4.
I20260709 12:20:59.673918  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:59.648362  6563 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.664398  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:20:59.662137  4328 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.679738  4985 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.642580  6542 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:20:59.859354  6501 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.669842  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:59.859759  6501 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.860088  4986 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.860147  6501 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.855577  6600 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:20:59.771984  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.865314  4333 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:20:59.730286  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:20:59.650630  6264 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:20:59.669535  6330 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:20:59.730518  6627 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:20:59.731050  6620 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 12:20:59.684077  6230 raft_consensus.cc:2764] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:20:59.781980  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:20:59.779600  6623 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:20:59.768751  6517 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.730262  6509 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.814127  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 150809us
I20260709 12:20:59.817065  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 445) took 1048 ms. Trace:
I20260709 12:20:59.783455  6519 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.772637  6408 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:20:59.765247  6615 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.675874  4988 rpcz_store.cc:276] 0709 12:20:58.458349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.459859 (+  1510us) service_pool.cc:224] Handling call
0709 12:20:59.252080 (+792221us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:20:59.643775 (+391695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53390592}
I20260709 12:20:59.818921  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:59.852885  4987 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:59.853768  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:59.847975  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 218884us
I20260709 12:20:59.855638  4249 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:20:59.855810  4334 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
W20260709 12:20:59.848510  4256 rpcz_store.cc:269] 0709 12:20:58.473380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.483210 (+  9830us) service_pool.cc:224] Handling call
0709 12:20:59.847876 (+1364666us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400085cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:59.847994 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837973376}
I20260709 12:20:59.857873  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:59.866721  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:20:59.988929  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.057458  4252 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:59.866314  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:20:59.909791  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.058218  4257 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:20:59.974931  4330 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:20:59.973578  4985 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:00.059748  4372 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:20:59.908281  4333 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:20:59.848990  6635 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.214s
I20260709 12:21:00.062098  4330 pending_rounds.cc:85] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 4
W20260709 12:21:00.091485  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 427113us
I20260709 12:21:00.316695  4330 pending_rounds.cc:107] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:21:00.317202  4330 raft_consensus.cc:2889] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:00.161439  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.088150  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 306223us
I20260709 12:21:00.061264  4409 rpcz_store.cc:276] 0709 12:20:58.768504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.768653 (+   149us) service_pool.cc:224] Handling call
0709 12:20:59.816882 (+1048229us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003aeb54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:20:59.816997 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415564544}
I20260709 12:21:00.195281  4987 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:20:59.848496  6495 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.856483  6563 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.125324  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:20:59.885403  6637 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:20:59.878072  6605 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.200387  6596 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:20:59.982278  6257 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.231907  6446 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.331840  6553 raft_consensus.cc:993] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
W20260709 12:20:59.983332  6612 consensus_meta.cc:287] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 12:21:00.333223  6553 raft_consensus.cc:1081] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:00.333539  6612 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:20:59.984329  6645 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 12:21:00.330848  4296 leader_election.cc:400] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:21:00.334574  4296 leader_election.cc:403] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:21:00.163544  6638 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:21:00.088585  6601 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:00.335264  6230 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3.
I20260709 12:21:00.333459  4257 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.335525  6601 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.335959  6601 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.336315  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:00.057298  6515 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.337267  4257 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.337387  6515 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.323508  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 835) took 1837 ms. Trace:
I20260709 12:21:00.338230  4990 rpcz_store.cc:276] 0709 12:20:58.486232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.486418 (+   186us) service_pool.cc:224] Handling call
0709 12:20:59.818787 (+1332369us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:00.323423 (+504636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25517952}
I20260709 12:21:00.339090  4986 raft_consensus.cc:2410] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:00.342188  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 257278us
I20260709 12:21:00.333200  6605 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.304886  4252 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:00.199510  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:20:59.859622  6542 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:20:59.875957  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:00.103056  6615 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:20:59.855448  6621 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.335403  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.340984  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:00.332882  4956 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.057772  6300 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.322217  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:00.346355  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:00.340087  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:20:59.982579  6598 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:00.191515  6517 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.023953  6600 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:00.196213  6411 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.348796  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.340431  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.333122  6446 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:00.350862  4988 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.329322  6495 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.084934  6509 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.089195  6519 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.353518  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.431018  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.385845  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:00.430408  4327 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:21:00.462479  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 132103us
I20260709 12:21:00.488040  4330 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.409361  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:00.489010  4326 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.358610  4334 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:00.478349  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1867) took 2349 ms. Trace:
I20260709 12:21:00.489723  4332 rpcz_store.cc:276] 0709 12:20:58.097777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.103412 (+  5635us) service_pool.cc:224] Handling call
0709 12:20:58.103735 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:58.449169 (+345434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:58.449227 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:58.463693 (+ 14466us) log.cc:844] Serialized 26 byte log entry
0709 12:20:58.861435 (+397742us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:20:58.861473 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.446764 (+1585291us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540013c754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:00.446814 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.446861 (+    47us) raft_consensus.cc:1685] finished
0709 12:21:00.446874 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.447095 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88513,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11592,"spinlock_wait_cycles":488110848,"thread_start_us":466469,"threads_started":2,"wal-append.queue_time_us":944294}
W20260709 12:21:00.478610  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 143299us
I20260709 12:21:00.493602  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.480311  4257 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.478374  4990 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:00.463541  4329 raft_consensus.cc:2410] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:00.400296  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:00.480000  4252 raft_consensus.cc:2410] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:21:00.499094  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 98937.5us
I20260709 12:21:00.487389  4956 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.439133  6515 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.468713  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.502736  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.503934  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:00.486140  6550 consensus_meta.cc:287] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 12:21:00.507974  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.485123  6230 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:00.482156  6495 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.532836  6509 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.533659  6509 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:00.482436  6612 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.507922  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.534866  6612 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.535053  4989 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.535423  6612 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.535866  6499 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:00.536213  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.536814  4989 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:21:00.536542  6499 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:00.537624  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.538172  4989 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:00.539014  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:00.540032  6505 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.698s	user 0.004s	sys 0.006s
I20260709 12:21:00.512470  6408 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:00.540009  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.482328  6300 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.543733  6300 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.512545  6553 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.544890  6553 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.545346  6553 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.498855  6330 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:00.548259  6446 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:00.549083  6651 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:00.549150  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:00.550948  4250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 488) took 2265 ms (client timeout 1835 ms). Trace:
I20260709 12:21:00.552304  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:00.510151  4257 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:00.510947  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.487888  6654 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:00.551417  4250 rpcz_store.cc:269] 0709 12:20:58.286001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.304644 (+ 18643us) service_pool.cc:224] Handling call
0709 12:21:00.550668 (+2246024us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002670d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:00.550846 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306353408}
I20260709 12:21:00.552646  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.567823  6654 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:00.568559  4984 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:21:00.569659  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:00.570052  6654 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:00.485510  6264 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:00.570765  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.570050  4988 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.513038  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.522717  6596 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:00.523542  6635 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:00.512605  6542 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:00.525705  4986 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.526961  4326 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.583702  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.585202  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.585865  4326 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:21:00.555313  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.520641  4296 leader_election.cc:400] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 2 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 4.
I20260709 12:21:00.572556  4984 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:00.574596  4371 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:00.587925  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.588169  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:00.588979  4984 raft_consensus.cc:2410] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:00.589064  4327 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.592074  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.592938  4990 raft_consensus.cc:2410] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:21:00.594297  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.480930  6411 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:00.592458  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 79495.3us
I20260709 12:21:00.477553  6615 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.484493  6517 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.597358  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:00.595116  4328 consensus_meta.cc:287] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.732s	user 0.004s	sys 0.007s
I20260709 12:21:00.601153  4984 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:00.519814  6589 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:00.604568  4326 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:00.600593  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:00.606153  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 288964us
I20260709 12:21:00.484752  6600 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:00.607671  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 87163.7us
I20260709 12:21:00.641613  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.621954  4327 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.642541  4326 raft_consensus.cc:2410] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:00.642061  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:00.606472  6521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.277s	user 0.005s	sys 0.033s
W20260709 12:21:00.693305  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51338.1us
W20260709 12:21:00.644452  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 43903.7us
I20260709 12:21:00.691949  4989 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:21:00.663923  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.691762  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.694959  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.695109  4327 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:00.695232  4326 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
W20260709 12:21:00.668648  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.597958  6654 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:00.575367  6550 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.666502  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:00.604892  6615 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.591801  6300 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:21:00.625689  6257 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.591537  6446 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:21:00.606751  6408 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:00.604077  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.597769  6264 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 12:21:00.720781  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 54388.7us
I20260709 12:21:00.644146  6230 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:00.723145  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:00.693593  6521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.370s	user 0.006s	sys 0.034s
I20260709 12:21:00.694547  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.731732  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.605504  6542 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:00.644572  6589 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.744602  6542 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.692291  6505 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.744607  6330 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.623382  6659 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:00.727077  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 152568us
I20260709 12:21:00.722110  6637 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:00.731262  6521 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:00.721045  6657 raft_consensus.cc:2764] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:21:00.728605  6653 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:00.739521  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:00.737707  6650 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:21:00.744810  6589 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:00.745324  6505 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.730057  6509 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:21:00.720329  6442 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:00.746708  4371 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:00.727957  6257 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.730907  4988 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:00.722128  6601 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.745191  6542 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.696043  4328 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:00.745924  6330 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.752727  6230 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.760499  6505 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.761343  6408 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.762192  6521 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:00.742962  6411 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:00.767374  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.750563  6637 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.760285  6657 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:00.776906  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:00.777879  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1884) took 1294 ms. Trace:
I20260709 12:21:00.778249  6660 raft_consensus.cc:2764] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:21:00.766857  6519 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.774834  6621 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.790544  6330 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:00.771001  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 620) took 1001 ms. Trace:
I20260709 12:21:00.814808  4988 rpcz_store.cc:276] 0709 12:20:59.769812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.571980 (+802168us) service_pool.cc:224] Handling call
0709 12:21:00.770929 (+198949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.803753  6637 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.818060  6553 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.818750  6600 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.804800  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:00.822619  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:00.825301  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:00.825837  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:00.826651  4407 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.807400  6665 consensus_queue.cc:1059] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:00.788022  6501 consensus_meta.cc:287] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.927s	user 0.013s	sys 0.000s
I20260709 12:21:00.812109  6666 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:00.810570  6457 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.804508  6264 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:00.813609  6550 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.826048  4403 raft_consensus.cc:2368] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:00.783633  6300 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:00.832190  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:00.853305  6664 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:00.854513  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:00.797114  6659 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:00.855662  6408 raft_consensus.cc:2764] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:21:00.855997  6659 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.841372  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:00.841441  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.860453  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.842475  4400 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:00.863605  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.864375  6257 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.864753  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:00.865306  4400 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.869385  4401 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:00.807749  6495 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.869288  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.844028  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:00.871009  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.874430  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:00.875385  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 116797us
I20260709 12:21:00.876243  4955 leader_election.cc:400] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
I20260709 12:21:00.831895  6600 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:00.876539  4955 leader_election.cc:403] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:00.805214  6563 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:00.877170  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:00.878661  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.882488  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:00.880872  6664 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.839756  6517 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:00.833514  6596 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:00.841688  6264 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.805845  4328 rpcz_store.cc:276] 0709 12:20:59.483022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.483873 (+   851us) service_pool.cc:224] Handling call
0709 12:21:00.774166 (+1290293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:00.893087  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:00.884714  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:00.893818  4401 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.833155  6457 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.889672  6230 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:00.890308  4407 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:00.892086  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 838) took 1041 ms. Trace:
I20260709 12:21:00.908921  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.909595  4407 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 1.
I20260709 12:21:00.870862  6666 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:00.875041  6654 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:00.888322  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 848) took 1011 ms. Trace:
I20260709 12:21:00.881718  6600 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.833706  6501 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:00.881134  6408 raft_consensus.cc:2764] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:00.908806  4406 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:00.909173  4400 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
W20260709 12:21:00.912384  4955 connection.cc:256] RPC call timeout handler was delayed by -2.135787805000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 12:21:00.909180  4990 rpcz_store.cc:276] 0709 12:20:59.850466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.596243 (+745777us) service_pool.cc:224] Handling call
0709 12:21:00.596544 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:00.603155 (+  6611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.603176 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:00.603652 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:21:00.742862 (+139210us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:00.754436 (+ 11574us) log.cc:844] Serialized 14 byte log entry
0709 12:21:00.891761 (+137325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.891835 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:00.891875 (+    40us) raft_consensus.cc:1685] finished
0709 12:21:00.891888 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.892026 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":6899,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1456,"raft.queue_time_us":49638,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":46834,"thread_start_us":186775,"threads_started":2,"wal-append.queue_time_us":181138}
I20260709 12:21:00.885918  6664 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.894047  6596 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.892643  6264 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:00.925149  4984 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:21:00.926841  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.927201  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:00.905220  6457 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.932374  4257 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:00.932915  6664 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.883389  6505 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:00.933429  6671 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:00.933043  6670 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.908231  6230 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.938369  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:00.959699  4257 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:00.938457  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:00.961009  4990 raft_consensus.cc:2393] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:00.961990  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.962582  4990 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:00.963411  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:00.915946  6517 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:00.939388  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:00.939693  4405 raft_consensus.cc:2368] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4.
I20260709 12:21:00.940356  4407 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:00.940300  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.966835  4400 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:00.967062  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.967656  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.968219  4400 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:00.968312  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:00.933627  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:00.969983  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:00.948645  4401 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:00.923473  6600 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.971158  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:00.971745  4328 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.952565  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:00.977324  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:00.934136  6507 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:00.932040  6521 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:00.935045  6596 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:00.981396  4984 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:00.984747  6505 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:00.989084  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.951574  6300 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.999666  4257 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
W20260709 12:21:00.999042  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59742.3us
I20260709 12:21:00.951311  6671 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:00.975795  6230 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:01.004559  4404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 447) took 2148 ms (client timeout 1644 ms). Trace:
W20260709 12:21:01.004981  4404 rpcz_store.cc:269] 0709 12:20:58.849484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.849727 (+   243us) service_pool.cc:224] Handling call
0709 12:21:00.997873 (+2148146us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54003adc54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:00.997987 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043730816}
W20260709 12:21:01.007964  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 130861us
I20260709 12:21:01.008488  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.011958  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.004127  6507 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:01.014703  4404 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.007607  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:00.983057  6499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60130 (request call id 97) took 4898 ms. Trace:
I20260709 12:21:00.986027  6521 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:01.020721  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.025785  4257 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 5: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:01.004910  6601 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.031064  4407 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:01.007445  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.005185  6671 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.015961  6507 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:01.057260  4296 connection.cc:256] RPC call timeout handler was delayed by -3.55040787300004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 12:21:01.015875  6411 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:01.063139  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.076373  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:01.077174  4401 raft_consensus.cc:2368] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:01.033885  6521 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:01.068785  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.019657  6662 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:01.008143  6300 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:01.074035  4296 connection.cc:256] RPC call timeout handler was delayed by -3.5153078729999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:21:01.085609  4296 connection.cc:256] RPC call timeout handler was delayed by -3.5036078729999645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:21:01.085947  4296 connection.cc:256] RPC call timeout handler was delayed by -3.492807872999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:21:01.086263  4296 connection.cc:256] RPC call timeout handler was delayed by -3.4874078729999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:21:01.086530  4296 connection.cc:256] RPC call timeout handler was delayed by -3.4523078729998815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:21:01.086831  4296 connection.cc:256] RPC call timeout handler was delayed by -3.2120078729999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 12:21:01.087003  4296 connection.cc:256] RPC call timeout handler was delayed by -3.1922078729999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 12:21:01.087170  4296 connection.cc:256] RPC call timeout handler was delayed by -3.0869078729997455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:21:00.917290  4986 rpcz_store.cc:276] 0709 12:20:59.877189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.644077 (+766888us) service_pool.cc:224] Handling call
0709 12:21:00.724108 (+ 80031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.827084 (+102976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:00.832203 (+  5119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:00.834726 (+  2523us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:00.846670 (+ 11944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.875998 (+ 29328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:00.886952 (+ 10954us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":768,"spinlock_wait_cycles":6792576,"thread_start_us":66795,"threads_started":1}
I20260709 12:21:01.077574  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.080050  4984 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:01.011427  6509 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:01.087404  4296 connection.cc:256] RPC call timeout handler was delayed by -3.0788078730001871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:21:01.094853  4296 connection.cc:256] RPC call timeout handler was delayed by -2.9789078730000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 12:21:01.095269  4296 connection.cc:256] RPC call timeout handler was delayed by -2.9591078729999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:21:01.095840  4296 connection.cc:256] RPC call timeout handler was delayed by -2.940207872999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:21:01.096314  4296 connection.cc:256] RPC call timeout handler was delayed by -2.9042078729999048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 12:21:01.097566  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:01.059682  6659 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.019744  6653 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:21:01.033449  6519 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:21:01.097116  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.018857  6654 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.034561  6621 consensus_queue.cc:1059] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:21:01.076180  6507 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.084538  6495 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.100924  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.122442  4984 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:01.106657  4407 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:01.106945  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:01.084697  4247 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:01.107872  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:01.111905  6612 consensus_meta.cc:287] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.003s
I20260709 12:21:01.085448  6662 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.075601  6411 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.099985  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.103001  6678 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:01.127051  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.132476  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.136554  4257 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.129614  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.014673  6666 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.133966  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.143441  4401 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:01.143652  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:01.111949  4328 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:01.144902  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.145447  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.146054  4328 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:01.146178  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.103668  6509 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.152951  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.146999  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.166520  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:01.106276  6659 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.135525  6411 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.131577  6612 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:01.173868  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 76582.4us
I20260709 12:21:01.175120  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.135581  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.131438  6408 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.131507  6662 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.151930  6601 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:01.183394  4955 leader_election.cc:336] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.835s (SENT)
I20260709 12:21:01.191045  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:01.159358  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.196157  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:01.197098  4990 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:01.200868  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1876) took 1896 ms. Trace:
I20260709 12:21:01.185284  6678 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:01.181502  4328 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:21:01.201244  4331 rpcz_store.cc:276] 0709 12:20:59.304688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.310858 (+  6170us) service_pool.cc:224] Handling call
0709 12:21:01.200672 (+1889814us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001054d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:01.200812 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235805056}
I20260709 12:21:01.206513  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.207115  4250 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.207125  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.208628  4331 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:21:01.209375  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.210179  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.196441  6601 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:01.204280  4986 raft_consensus.cc:2368] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:01.201498  4247 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:01.276577  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.031525  6499 rpcz_store.cc:276] 0709 12:20:56.078562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.083069 (+  4507us) service_pool.cc:224] Handling call
0709 12:20:56.403314 (+320245us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000b5020. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cfb520 00007fdbb0d84b42 00007fdbb0d83800 00007fdbb0d7c9fa 00007fdbb5d444c9 00007fdbaf2c0c54 00007fdbaf2c0be2 00007fdbaf2c0b11 00007fdbaf2c0a8c 00007fdbaf2bfd42
0709 12:20:57.256055 (+852741us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b58003fbcd0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cda0aa 00007fdbb0d5c447 00007fdbb0d7970a 00007fdbb0d7a76a 00007fdbb0d7991b 00007fdbb0d8503c 00007fdbb0d846b3 00007fdbb0d7c9fa 00007fdbb5d444c9 00007fdbaf2c0c54
0709 12:20:57.486443 (+230388us) log.cc:844] Serialized 487 byte log entry
0709 12:20:58.252772 (+766329us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b54000b5020. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cfeb26 00007fdbb0cf849a 00007fdbb0cf7714 00007fdbb0cd7eaa 00007fdbb0cded53 00007fdbb0cdecd9 00007fdbb0cdec69 00007fdbb0cdec31 00007fdbb0cdddfd 0000000000388634
0709 12:20:58.394800 (+142028us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b54000b5020. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cf7142 00007fdbb0cd7eaa 00007fdbb0cded53 00007fdbb0cdecd9 00007fdbb0cdec69 00007fdbb0cdec31 00007fdbb0cdddfd 0000000000388634 0000000000388479 00007fdbadc91475
0709 12:21:00.976828 (+2582028us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54663,"raft.queue_time_us":259770,"raft.run_cpu_time_us":11883,"raft.run_wall_time_us":679753,"spinlock_wait_cycles":1425066880,"thread_start_us":360325,"threads_started":1,"wal-append.queue_time_us":646314,"wal-append.run_cpu_time_us":2787,"wal-append.run_wall_time_us":1118836}
I20260709 12:21:01.254885  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.223497  6676 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:01.225888  6678 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:01.292798  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 96690.1us
I20260709 12:21:01.250738  6509 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.293172  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.287599  6507 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:01.302389  6680 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:01.303524  6507 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.302316  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:01.307475  6672 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:21:01.292091  6621 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:01.310853  4257 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:01.320887  4250 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:01.321909  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.322527  4250 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:01.323509  6676 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:01.324060  6676 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.325157  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.326316  6676 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.328480  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.329242  4328 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:01.329989  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.290833  6637 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.333568  4956 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.334558  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.336366  6601 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.331048  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:01.344925  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:01.346676  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:01.331135  6669 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 12:21:01.310009  6630 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:01.307793  6659 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.357810  4984 raft_consensus.cc:2368] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:21:01.319589  6621 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.353149  4250 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:01.362432  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:01.331207  6542 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.005s
I20260709 12:21:01.307646  6600 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.339190  6517 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:01.355229  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53930.9us
I20260709 12:21:01.356158  4326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:21:01.368884  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:01.369062  4326 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:01.369437  4326 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.315641  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.350375  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.339438  6676 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.359907  6688 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:01.372742  4250 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:01.372663  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.373598  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 614) took 1711 ms. Trace:
I20260709 12:21:01.373994  4250 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.373941  4983 rpcz_store.cc:276] 0709 12:20:59.662522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.679436 (+ 16914us) service_pool.cc:224] Handling call
0709 12:21:01.372516 (+1693080us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:01.373538 (+  1022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19839872}
I20260709 12:21:01.375548  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.375801  6681 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:01.376109  4983 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.376372  6681 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.377169  6637 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.377797  4986 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:01.378513  6681 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.356158  6630 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.378865  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.382751  4409 raft_consensus.cc:2368] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:01.364249  6621 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.367753  6674 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.395826  4254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1666) took 1547 ms (client timeout 2061 ms). Trace:
W20260709 12:21:01.399618  4254 rpcz_store.cc:269] 0709 12:20:59.848544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.852440 (+  3896us) service_pool.cc:224] Handling call
0709 12:21:01.378727 (+1526287us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:01.395762 (+ 17035us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6254464}
I20260709 12:21:01.379791  6505 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.368086  6517 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.382225  6676 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.365520  6542 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.396113  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:01.408627  6657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.021s
I20260709 12:21:01.395210  6630 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:01.365701  6659 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:01.411969  6517 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:01.415463  6676 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:01.428431  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.434002  4403 raft_consensus.cc:2368] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:01.432662  4326 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.413156  6505 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.435007  4400 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:21:01.425549  6657 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:01.412168  6674 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:01.525108  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 156298us
I20260709 12:21:01.479554  6670 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5.
I20260709 12:21:01.460147  6660 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:01.501255  6691 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:01.489277  6682 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:21:01.528009  4326 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.528748  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.428305  4255 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.428099  6612 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:01.461306  6264 consensus_meta.cc:287] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
W20260709 12:21:01.471715  6685 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:21:01.426206  6457 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.471623  6596 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.533831  6660 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:01.530902  6688 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:01.544992  6666 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:01.545264  6589 consensus_meta.cc:287] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.779s	user 0.003s	sys 0.008s
I20260709 12:21:01.459887  6230 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.545667  4991 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:01.556658  6563 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.551828  6660 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.569026  6411 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.570775  6457 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.548681  6600 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.572573  4402 raft_consensus.cc:2368] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:01.542915  6662 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.574040  6349 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.575515  6583 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.583681  4331 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:01.591511  4983 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:01.593955  6688 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:01.597844  6664 consensus_meta.cc:287] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.000s
I20260709 12:21:01.600348  6501 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.601264  6678 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:01.584286  6615 consensus_meta.cc:287] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.001s
I20260709 12:21:01.537674  6691 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.621951  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:01.622586  4331 raft_consensus.cc:2376] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5. Re-sending same reply.
I20260709 12:21:01.572052  6674 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.550899  6264 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.594056  4257 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:01.610381  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:01.612190  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.579684  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 610) took 1920 ms. Trace:
I20260709 12:21:01.621698  6615 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.566406  6589 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:01.614593  6671 consensus_meta.cc:287] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 12:21:01.624019  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:01.603943  6662 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.634814  4248 raft_consensus.cc:2376] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4. Re-sending same reply.
I20260709 12:21:01.640640  4331 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:01.640810  4248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1671) took 1790 ms (client timeout 2189 ms). Trace:
I20260709 12:21:01.636896  4296 leader_election.cc:400] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:01.641476  4296 leader_election.cc:403] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:21:01.641294  4248 rpcz_store.cc:269] 0709 12:20:59.849982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.852637 (+  2655us) service_pool.cc:224] Handling call
0709 12:21:01.612041 (+1759404us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:01.640751 (+ 28710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6533376}
I20260709 12:21:01.607774  6542 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:01.593400  6408 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:01.614800  6666 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:01.645555  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:01.618861  6505 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.649649  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:01.649967  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.663628  4249 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.651551  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:01.664357  4992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 842) took 1807 ms (client timeout 1514 ms). Trace:
W20260709 12:21:01.655817  4989 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 623) took 1885 ms (client timeout 2190 ms). Trace:
W20260709 12:21:01.658759  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.659466  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1897) took 1014 ms. Trace:
I20260709 12:21:01.666566  4327 rpcz_store.cc:276] 0709 12:21:00.644603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.722879 (+ 78276us) service_pool.cc:224] Handling call
0709 12:21:01.659252 (+936373us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002035d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:01.659404 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369140480}
W20260709 12:21:01.665263  4989 rpcz_store.cc:269] 0709 12:20:59.770680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.539778 (+769098us) service_pool.cc:224] Handling call
0709 12:21:01.655644 (+1115866us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002c3dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:01.655756 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346593536}
I20260709 12:21:01.670629  4987 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:21:01.664783  4992 rpcz_store.cc:269] 0709 12:20:59.856667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.664129 (+1807462us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:01.664291 (+   162us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:01.619504  6664 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.676349  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.640129  6659 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.680908  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:01.679998  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.680904  6408 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:01.685051  6664 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.705372  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.706043  4989 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:01.706102  6605 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:01.706357  4989 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:01.706743  6605 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:01.707104  4989 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.707639  6605 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:01.713008  6521 consensus_meta.cc:287] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
I20260709 12:21:01.713434  6521 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.692016  6659 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:01.635749  4991 rpcz_store.cc:276] 0709 12:20:59.659218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.671033 (+ 11815us) service_pool.cc:224] Handling call
0709 12:21:01.545084 (+1874051us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:01.545308 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.565736 (+ 20428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.579595 (+ 13859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19346816}
I20260709 12:21:01.715919  6659 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.685293  6264 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.663867  6694 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:21:01.685766  4247 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.686465  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.734951  4992 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:01.688239  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.736011  4990 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.689249  6495 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.692404  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:01.692546  4985 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 609) took 2033 ms (client timeout 1679 ms). Trace:
I20260709 12:21:01.694038  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:01.692083  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:21:01.659531  6692 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:01.692983  6652 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:21:01.681180  6691 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.705271  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:01.760030  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 66065.5us
W20260709 12:21:01.730885  4218 connection.cc:256] RPC call timeout handler was delayed by -1.7292438689996743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 12:21:01.759780  4409 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:01.774464  4218 connection.cc:256] RPC call timeout handler was delayed by -1.72654386899967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:21:01.662910  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.744632  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:01.737991  4985 rpcz_store.cc:269] 0709 12:20:59.658909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.659033 (+   124us) service_pool.cc:224] Handling call
0709 12:21:01.692404 (+2033371us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54006af9d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:01.692488 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45545344}
W20260709 12:21:01.757344  4137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 65280.7us
I20260709 12:21:01.718909  6615 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.708063  4989 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.724149  4249 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:01.588829  6657 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.776484  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:01.647454  6671 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.789357  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.794644  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.774132  4328 raft_consensus.cc:2393] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:01.798206  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:01.788419  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.788973  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.732832  6611 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.749529  4984 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.799377  4403 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:01.799515  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:01.799808  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 154356us
I20260709 12:21:01.800138  4327 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.796739  4985 raft_consensus.cc:2393] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:01.802459  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.803406  4409 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:01.804694  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.760653  4400 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:01.800940  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.808270  4371 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.808284  4331 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:01.809130  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:01.778595  6542 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:01.741387  6495 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:01.733254  6505 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:01.811110  4296 leader_election.cc:400] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:01.811806  4403 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:01.822536  4984 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:01.818568  4992 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:01.819852  4990 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:01.823108  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:01.823668  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.824635  4984 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:01.811837  6310 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:01.826704  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.740558  6676 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.795706  6695 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:01.691159  6630 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.827761  4403 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:01.839483  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.826303  6310 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.834926  6517 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.835660  6505 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.835980  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:01.797324  6563 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:01.810567  6598 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:01.841625  4990 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:01.862915  4990 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260709 12:21:01.812695  6507 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:01.833287  4989 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:01.844277  4327 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:01.848501  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.870850  4984 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:01.845346  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:01.803133  6596 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:01.851810  4987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 840) took 2000 ms (client timeout 1855 ms). Trace:
I20260709 12:21:01.874013  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.852970  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:01.840404  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:01.855487  4249 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:01.855736  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.815717  6654 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:01.860667  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:01.804184  6521 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.836695  6701 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:01.880777  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 452) took 2483 ms. Trace:
I20260709 12:21:01.873126  4985 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:01.847481  6230 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:01.848799  6310 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:01.884303  4253 raft_consensus.cc:2393] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:01.849431  6695 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:01.887024  4992 raft_consensus.cc:2410] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:01.863365  6694 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:01.884788  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 109613us
W20260709 12:21:01.891592  4218 connection.cc:256] RPC call timeout handler was delayed by -1.650043869000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 12:21:01.887883  4330 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:01.894966  4332 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:01.892011  4218 connection.cc:256] RPC call timeout handler was delayed by -1.640143868999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 12:21:01.899619  4218 connection.cc:256] RPC call timeout handler was delayed by -1.640143868999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:21:01.884084  4254 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:01.874405  4987 rpcz_store.cc:269] 0709 12:20:59.850957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.492912 (+641955us) service_pool.cc:224] Handling call
0709 12:21:01.851585 (+1358673us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540064c8d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:01.851743 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642081792}
I20260709 12:21:01.861361  6542 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:01.836568  6660 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:01.889454  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 80388.7us
W20260709 12:21:01.906582  4218 connection.cc:256] RPC call timeout handler was delayed by -1.4421438689996648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 12:21:01.868366  6563 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:01.874715  6598 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:01.905730  4992 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:01.817842  6611 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.907151  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:01.886029  4408 rpcz_store.cc:276] 0709 12:20:59.387575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.387716 (+   141us) service_pool.cc:224] Handling call
0709 12:20:59.388008 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:59.450384 (+ 62376us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:59.648145 (+197761us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.818847 (+170702us) log.cc:844] Serialized 14 byte log entry
0709 12:20:59.823022 (+  4175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:59.823076 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:59.823367 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:59.864721 (+ 41354us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b18004250e0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:01.323877 (+1459156us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18004250e0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:01.614134 (+290257us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b18004250e0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc5f2a6 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419
0709 12:21:01.871121 (+256987us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b54002440d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:01.871177 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.871350 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105621,"prepare.queue_time_us":284883,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":8337,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":176,"spinlock_wait_cycles":239411072,"thread_start_us":365670,"threads_started":2,"wal-append.queue_time_us":452497,"wal-append.run_cpu_time_us":1376,"wal-append.run_wall_time_us":1001596}
I20260709 12:21:01.882948  6507 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:01.797600  6666 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.884027  6654 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.906773  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:01.836711  6495 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:01.928002  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.928483  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:01.928828  4408 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:01.929621  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:01.929915  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:01.930231  4409 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:01.930438  4408 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:01.921907  4987 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.931413  4409 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:21:01.931921  4986 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:01.932627  4987 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:01.932922  4401 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:01.934213  4987 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:01.888676  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.935127  4983 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.935266  6386 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:01.936033  6386 raft_consensus.cc:697] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:01.937065  4254 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:01.929072  4400 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:01.938714  4334 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:01.940836  4296 leader_election.cc:400] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:21:01.941982  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:01.885347  6411 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.936882  6386 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:01.943461  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:01.945179  6408 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:01.869833  6678 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:21:01.948290  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:01.949180  6678 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:01.949623  6678 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:01.950012  6678 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.952461  6553 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.956684  4983 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:01.959591  6664 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:21:01.906991  4218 connection.cc:256] RPC call timeout handler was delayed by -1.4421438689996648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:21:01.963923  4218 connection.cc:256] RPC call timeout handler was delayed by -1.4331438689996503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 12:21:01.964756  4218 connection.cc:256] RPC call timeout handler was delayed by -1.4331438689996503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 12:21:01.965188  4984 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:01.907166  6542 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.892843  6694 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:01.974166  4218 connection.cc:256] RPC call timeout handler was delayed by -1.3899438690000352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 12:21:01.872720  6692 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:21:01.968012  4400 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:21:01.977169  4218 connection.cc:256] RPC call timeout handler was delayed by -1.383643869000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 12:21:01.980405  4218 connection.cc:256] RPC call timeout handler was delayed by -1.383643869000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 12:21:01.980782  4218 connection.cc:256] RPC call timeout handler was delayed by -1.2819438689998606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:21:01.981117  4218 connection.cc:256] RPC call timeout handler was delayed by -1.243243868999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 12:21:01.981983  4218 leader_election.cc:400] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:01.982321  4218 leader_election.cc:403] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:21:01.922111  6589 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:01.988137  4984 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:01.927003  6654 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:01.990145  4218 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:01.995126  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2285) took 1168 ms. Trace:
I20260709 12:21:01.996594  4402 rpcz_store.cc:276] 0709 12:21:00.826587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.826714 (+   127us) service_pool.cc:224] Handling call
0709 12:21:01.994939 (+1168225us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:01.995064 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613537152}
I20260709 12:21:01.966835  6596 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:01.919730  6615 consensus_queue.cc:1059] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:21:01.975561  6542 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.978549  6495 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.977871  6694 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:01.991739  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:02.014719  4984 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.015560  6598 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:02.016392  6699 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:21:02.017563  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1900) took 1292 ms. Trace:
I20260709 12:21:02.018028  4326 rpcz_store.cc:276] 0709 12:21:00.725309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.542331 (+817022us) service_pool.cc:224] Handling call
0709 12:21:01.542645 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.566652 (+ 24007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.566687 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.588655 (+ 21968us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.728722 (+140067us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:01.728765 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.728834 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.017272 (+288438us) raft_consensus.cc:1685] finished
0709 12:21:02.017303 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.017493 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51987,"raft.queue_time_us":20104,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7959,"thread_start_us":105596,"threads_started":1,"wal-append.queue_time_us":197385}
I20260709 12:21:02.020494  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:02.023231  6697 log.cc:927] Time spent T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.347s	user 0.002s	sys 0.000s
I20260709 12:21:01.966696  6230 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:21:01.988075  6257 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:01.986856  6605 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:02.010792  6621 consensus_meta.cc:287] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.004s
W20260709 12:21:02.035408  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.035580  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 857) took 1099 ms. Trace:
I20260709 12:21:02.023099  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.055579  4326 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:02.056674  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:02.057497  4326 raft_consensus.cc:2393] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:02.005064  6631 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:21:02.036170  4991 rpcz_store.cc:276] 0709 12:21:00.935894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.716127 (+780233us) service_pool.cc:224] Handling call
0709 12:21:01.716495 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.716887 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.716920 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.717443 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.867686 (+150243us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:01.876800 (+  9114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.885729 (+  8929us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.035246 (+149517us) raft_consensus.cc:1685] finished
0709 12:21:02.035306 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.035504 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11242,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":23375,"thread_start_us":131199,"threads_started":1,"wal-append.queue_time_us":204156}
I20260709 12:21:02.004053  6411 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:21:02.015252  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:02.066224  4984 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:02.037987  6671 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:02.074227  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 84166.7us
I20260709 12:21:02.075286  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:02.077390  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:02.057948  6505 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.076690  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.102349  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:02.102671  4326 raft_consensus.cc:2393] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:02.104352  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:02.105726  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.110571  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:02.111249  4326 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:02.113178  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.113801  4326 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.115247  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:02.041806  6621 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.079720  6631 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:02.117511  6490 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:02.123085  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.120968  6505 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:02.029219  6507 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.122738  6631 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:02.030808  6563 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.077042  6676 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:02.076335  6411 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:02.151232  6631 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.110253  6257 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:02.150662  6442 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:02.156502  4326 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:02.128599  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2287) took 1301 ms. Trace:
I20260709 12:21:02.166884  4406 rpcz_store.cc:276] 0709 12:21:00.827547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.827957 (+   410us) service_pool.cc:224] Handling call
0709 12:21:00.908486 (+ 80529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.925762 (+ 17276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.128331 (+1202569us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b54003769d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:02.128524 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184401792}
I20260709 12:21:02.129561  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2208) took 2519 ms. Trace:
I20260709 12:21:02.123901  6505 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.118539  6521 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.121773  6630 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:02.122740  6490 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.169713  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.166275  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:02.120463  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:02.178126  4326 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:02.178179  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 57805us
I20260709 12:21:02.180917  4218 leader_election.cc:400] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:02.181366  4218 leader_election.cc:403] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.185249  6310 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:02.189327  4255 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.002s
I20260709 12:21:02.189934  6611 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.176802  6505 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.204082  6659 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.205076  6611 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:02.207351  6611 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:02.207686  6611 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:02.208442  6611 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.209635  6611 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.168177  4325 rpcz_store.cc:276] 0709 12:20:59.610495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.849314 (+238819us) service_pool.cc:224] Handling call
0709 12:21:01.201605 (+1352291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.201797 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.201821 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:01.201866 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:01.201905 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.201959 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.129288 (+927329us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001054d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:02.129417 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3109286144}
I20260709 12:21:02.155484  6411 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:02.171908  6660 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:02.199935  4247 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:02.165289  6442 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:02.179386  6490 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:02.228087  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:02.200719  6694 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.206492  4255 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:02.202775  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:02.212575  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.246562  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:02.247001  6668 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 1.358s	user 0.000s	sys 0.005s
I20260709 12:21:02.180826  6521 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.248126  4325 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:02.249101  6521 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.230690  6630 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:02.215327  6411 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.256778  6694 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.258615  6542 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.180231  6583 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:02.180395  6676 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:02.259562  6583 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:02.259673  6676 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:02.260490  6583 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:02.260666  6676 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.225569  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:02.262317  4402 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:02.222702  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:02.222483  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:02.226248  4409 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:02.263338  4401 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:02.223600  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:02.226660  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 45929.2us
I20260709 12:21:02.227792  6300 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:02.229491  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:02.265744  4400 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:02.202221  4326 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:02.248531  6442 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.258903  6621 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:02.216041  4405 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2290) took 1386 ms (client timeout 1764 ms). Trace:
W20260709 12:21:02.226917  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.269711  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:02.271477  4403 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:02.272414  6310 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:02.280161  6615 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.281689  6615 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.283758  6615 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.284991  6678 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.286118  6654 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.287644  4407 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:02.281044  6690 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:02.288839  6690 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:02.273939  4405 rpcz_store.cc:269] 0709 12:21:00.829279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.860179 (+ 30900us) service_pool.cc:224] Handling call
0709 12:21:02.211924 (+1351745us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54003ae154. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:02.215981 (+  4057us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180567936}
I20260709 12:21:02.292325  6517 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:02.293583  6442 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:02.295529  4983 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:02.295382  6630 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:02.296113  6630 consensus_queue.cc:1243] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:02.296597  6630 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:02.296921  6630 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:02.297672  4989 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:02.279855  6589 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:21:02.298321  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 860) took 1344 ms. Trace:
I20260709 12:21:02.298806  6589 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:02.279731  6671 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:02.299345  6589 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:02.299752  6671 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:02.300349  6589 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.300683  6671 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.301693  6589 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.279942  6659 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:02.298658  4989 rpcz_store.cc:276] 0709 12:21:00.953615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.874928 (+921313us) service_pool.cc:224] Handling call
0709 12:21:02.297159 (+422231us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:02.297359 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.298093 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.298271 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20673280}
I20260709 12:21:02.310058  4328 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.311187  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.312805  4328 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:02.315640  6615 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:02.316740  6517 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:02.317198  6517 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:02.318249  6654 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:02.318199  6517 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:02.320266  6698 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.444s	user 0.002s	sys 0.000s
I20260709 12:21:02.275638  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:02.324846  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49273.6us
W20260709 12:21:02.325518  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.325929  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.326237  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.327898  6517 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:02.328007  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:02.328464  6553 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:02.330305  6678 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:02.332173  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:02.332365  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:02.332968  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:02.334105  4153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 384) took 6920 ms. Trace:
I20260709 12:21:02.336272  4400 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:02.331076  6495 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:21:02.337447  4988 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.338627  4218 leader_election.cc:400] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:02.419063  4218 leader_election.cc:403] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.334544  4153 rpcz_store.cc:276] 0709 12:20:55.409648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.409954 (+   306us) service_pool.cc:224] Handling call
0709 12:20:55.814955 (+405001us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:02.330110 (+6515155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:57.340762 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:57.341602 (+   840us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:57.341675 (+    73us) write_op.cc:435] Acquired schema lock
0709 12:20:57.341703 (+    28us) tablet.cc:662] Decoding operations
0709 12:20:57.342516 (+   813us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:57.342635 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:57.342676 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:57.360760 (+ 18084us) tablet.cc:701] Row locks acquired
0709 12:20:57.423196 (+ 62436us) write_op.cc:260] PREPARE: finished
0709 12:20:57.483935 (+ 60739us) write_op.cc:270] Start()
0709 12:20:57.485857 (+  1922us) write_op.cc:276] Timestamp: P: 1783599657458471 usec, L: 0
0709 12:20:57.485881 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:57.556630 (+ 70749us) log.cc:844] Serialized 1654 byte log entry
0709 12:20:58.984613 (+1427983us) op_driver.cc:464] REPLICATION: finished
0709 12:20:59.627874 (+643261us) write_op.cc:301] APPLY: starting
0709 12:20:59.638983 (+ 11109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:59.650420 (+ 11437us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:59.663018 (+ 12598us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:59.776463 (+113445us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:59.791474 (+ 15011us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:20:59.797933 (+  6459us) write_op.cc:312] APPLY: finished
0709 12:20:59.809732 (+ 11799us) log.cc:844] Serialized 41 byte log entry
0709 12:20:59.809914 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.810023 (+   109us) write_op.cc:454] Released schema lock
0709 12:20:59.810063 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:59.810960 (+   897us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:59.810985 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30873,"reported_tablets":13,"spinlock_wait_cycles":80315264,"child_traces":[["op",{"apply.queue_time_us":624133,"apply.run_cpu_time_us":3641,"apply.run_wall_time_us":189273,"num_ops":4,"prepare.queue_time_us":222653,"prepare.run_cpu_time_us":16800,"prepare.run_wall_time_us":790875,"raft.queue_time_us":480871,"raft.run_cpu_time_us":29547,"raft.run_wall_time_us":415353,"replication_time_us":1498486,"thread_start_us":1317613,"threads_started":4,"wal-append.queue_time_us":603006,"wal-append.run_cpu_time_us":18834,"wal-append.run_wall_time_us":2643987}]]}
I20260709 12:21:02.423712  6495 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:02.423653  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 159109us
I20260709 12:21:02.428277  6495 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:02.431833  6495 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.433009  6495 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.432934  6490 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.329869  6615 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:02.279395  6542 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:02.411023  4326 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:02.440367  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.440840  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.446071  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.451926  4254 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:02.453055  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.453778  4254 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:02.447136  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:02.455374  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.456545  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:02.456640  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.457073  4254 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.451849  4248 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:02.434580  6411 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.424371  6621 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5.
I20260709 12:21:02.465524  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.487648  4247 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:02.488302  4253 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:02.489143  4247 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:02.490633  4247 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:02.466624  4256 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:02.467743  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.492470  4252 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:21:02.468633  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.468143  4151 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 3, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.493695  4257 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:02.469832  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:02.494351  4151 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 4, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.496886  6411 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.496971  4151 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:02.297708  6630 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.479918  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:02.425395  6442 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:02.512051  6442 consensus_queue.cc:1059] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:02.513674  4249 raft_consensus.cc:2410] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:02.505234  4248 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:02.505555  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.517449  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.519791  4326 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:02.520712  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.522753  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:02.523509  4326 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:02.503175  4254 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:02.438195  6490 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:02.535980  4327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.021s
W20260709 12:21:02.536422  4327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.021s
W20260709 12:21:02.506224  6704 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.433s	user 0.003s	sys 0.007s
I20260709 12:21:02.499251  6695 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:02.472985  6690 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:02.547212  4333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.020s	sys 0.029s
W20260709 12:21:02.847802  6408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.025s	sys 0.050s
W20260709 12:21:02.882535  4333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.027s	sys 0.036s
W20260709 12:21:02.882720  6408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.026s	sys 0.051s
I20260709 12:21:02.883090  6408 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:02.787601  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.883445  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2218) took 1893 ms. Trace:
I20260709 12:21:02.884166  6408 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.884065  4333 rpcz_store.cc:276] 0709 12:21:00.990381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.853780 (+863399us) service_pool.cc:224] Handling call
0709 12:21:01.854147 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.861213 (+  7066us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:01.977620 (+116407us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.883083 (+905463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:02.883136 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:02.883182 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.883247 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.883390 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":144962,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":1007544,"threads_started":2}
I20260709 12:21:02.540042  6505 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:02.855180  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2219) took 1864 ms. Trace:
W20260709 12:21:02.848016  4992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.024s	sys 0.033s
W20260709 12:21:02.682915  4332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.002s	sys 0.033s
W20260709 12:21:02.886541  4992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.025s	sys 0.034s
W20260709 12:21:02.886844  4332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.003s	sys 0.041s
W20260709 12:21:02.652761  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.020s	sys 0.048s
W20260709 12:21:02.602906  4330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.013s	sys 0.024s
W20260709 12:21:02.887792  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.029s	sys 0.049s
W20260709 12:21:02.525552  6596 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.014s	sys 0.019s
I20260709 12:21:02.539475  6600 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:21:02.842204  4372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.023s	sys 0.043s
W20260709 12:21:02.888238  4330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.021s	sys 0.028s
I20260709 12:21:03.049152  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:03.050098  4249 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:02.886277  4327 rpcz_store.cc:276] 0709 12:21:00.990612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.869855 (+879243us) service_pool.cc:224] Handling call
0709 12:21:01.870141 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.870349 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:02.004757 (+134408us) log.cc:844] Serialized 14 byte log entry
0709 12:21:02.854832 (+850075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:02.854896 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:02.854945 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.855004 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:02.855118 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20736,"prepare.queue_time_us":163473,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":317881,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":18092,"thread_start_us":622000,"threads_started":2}
I20260709 12:21:02.605445  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:02.652318  4990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.025s
W20260709 12:21:03.051622  4990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.020s	sys 0.031s
I20260709 12:21:02.894451  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:03.051981  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 1.10852e+06us
I20260709 12:21:03.052798  4254 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:02.855192  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:02.941485  4218 leader_election.cc:400] T 8afcac1f47834987ac3889edd37f61a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 4.
W20260709 12:21:02.993170  4371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.009s	sys 0.025s
W20260709 12:21:03.049167  4372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.031s	sys 0.045s
W20260709 12:21:03.054454  4371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.013s	sys 0.025s
W20260709 12:21:03.054556  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 113319us
W20260709 12:21:03.055044  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 1.12511e+06us
I20260709 12:21:03.055706  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:02.994169  4331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.009s	sys 0.019s
W20260709 12:21:03.057734  4331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.013s	sys 0.019s
I20260709 12:21:03.058655  4333 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:03.059799  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.060243  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.054637  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 1.12759e+06us
I20260709 12:21:03.063727  4372 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:02.992856  4956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.010s
W20260709 12:21:03.065959  4956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.009s	sys 0.010s
W20260709 12:21:03.066642  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 719418us
I20260709 12:21:03.051534  4248 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.070272  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:03.079479  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.080224  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.080670  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.052371  4990 raft_consensus.cc:2955] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 5 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:21:02.683111  6657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.016s	sys 0.024s
W20260709 12:21:02.603996  6501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.018s	sys 0.035s
W20260709 12:21:03.025106  6631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.014s	sys 0.010s
W20260709 12:21:02.683272  6601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.003s	sys 0.031s
W20260709 12:21:02.894958  6710 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:21:02.962882  6666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.014s	sys 0.038s
W20260709 12:21:02.635473  6386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.023s	sys 0.042s
I20260709 12:21:02.886919  6505 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:02.922552  6521 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.662093  6589 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:02.619524  6630 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:02.612984  4328 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:21:03.048975  6596 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.016s	sys 0.036s
I20260709 12:21:02.662321  4988 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:02.903695  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:03.082362  6600 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:03.023962  6694 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:03.108884  6657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.024s	sys 0.039s
I20260709 12:21:03.153587  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:03.181346  4327 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:03.132668  4249 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
W20260709 12:21:03.116061  6501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.018s	sys 0.050s
W20260709 12:21:03.171620  6598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.008s	sys 0.022s
W20260709 12:21:03.117321  6601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.011s	sys 0.036s
I20260709 12:21:03.108946  6695 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.127947  6690 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:03.183364  4955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.027s	sys 0.039s
W20260709 12:21:03.156669  6386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.026s	sys 0.063s
I20260709 12:21:03.183125  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 453) took 1492 ms. Trace:
W20260709 12:21:03.187942  4325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.008s	sys 0.023s
W20260709 12:21:03.245926  4955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.031s	sys 0.043s
W20260709 12:21:03.128300  6666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.014s	sys 0.045s
W20260709 12:21:03.174913  6583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.011s	sys 0.071s
I20260709 12:21:03.193264  4248 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:03.163604  6589 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:03.246379  4325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.008s	sys 0.024s
W20260709 12:21:03.116173  6631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.016s	sys 0.015s
W20260709 12:21:03.247004  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 913508us
I20260709 12:21:03.246271  4404 rpcz_store.cc:276] 0709 12:21:01.690956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.693121 (+  2165us) service_pool.cc:224] Handling call
0709 12:21:01.693411 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.723262 (+ 29851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.723318 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.740584 (+ 17266us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.907773 (+167189us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:01.907809 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.907867 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.486683 (+578816us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:03.172056 (+685373us) raft_consensus.cc:1685] finished
0709 12:21:03.172081 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.183063 (+ 10982us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":41321,"spinlock_wait_cycles":13497728,"thread_start_us":106266,"threads_started":1,"wal-append.queue_time_us":220544}
W20260709 12:21:03.185082  6507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.011s	sys 0.022s
W20260709 12:21:03.191483  6553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.020s	sys 0.014s
I20260709 12:21:03.280603  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1907) took 1663 ms. Trace:
I20260709 12:21:03.281309  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.168047  6521 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:03.201743  6598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.009s	sys 0.023s
W20260709 12:21:03.250031  6583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.012s	sys 0.071s
I20260709 12:21:03.284597  4325 rpcz_store.cc:276] 0709 12:21:01.617473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.247507 (+630034us) service_pool.cc:224] Handling call
0709 12:21:02.247776 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.247987 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:02.342449 (+ 94462us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.280155 (+937706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:03.280236 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:03.280310 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.280398 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.280542 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":901915,"threads_started":1}
I20260709 12:21:03.300815  6666 consensus_queue.cc:1059] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:03.285247  4955 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.183568  6701 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:03.281402  6507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.014s	sys 0.030s
W20260709 12:21:03.291972  6553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.020s	sys 0.014s
I20260709 12:21:03.362360  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1901) took 2510 ms. Trace:
I20260709 12:21:03.318527  4250 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:03.203356  6715 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.191677  6505 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.237227  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 563) took 1243 ms. Trace:
I20260709 12:21:03.320833  6657 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:03.187273  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 639) took 1190 ms. Trace:
I20260709 12:21:03.262058  4327 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:03.251152  6714 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:03.194403  6563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.011s	sys 0.023s
I20260709 12:21:03.192070  4247 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:03.324740  4955 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.362943  4329 rpcz_store.cc:276] 0709 12:21:00.851765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.601322 (+749557us) service_pool.cc:224] Handling call
0709 12:21:01.601810 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.617932 (+ 16122us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:01.799587 (+181655us) log.cc:844] Serialized 14 byte log entry
0709 12:21:01.944909 (+145322us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4800043458. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:21:02.058873 (+113964us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:02.071794 (+ 12921us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.071934 (+   140us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:02.071968 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.072031 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:02.319114 (+247083us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b18003370c0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91522 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:03.360365 (+1041251us) raft_consensus.cc:1685] finished
0709 12:21:03.360391 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.362285 (+  1894us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15624,"prepare.queue_time_us":265012,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":17957,"raft.run_cpu_time_us":2616,"raft.run_wall_time_us":338057,"spinlock_wait_cycles":74840832,"thread_start_us":348070,"threads_started":2,"wal-append.queue_time_us":739816}
I20260709 12:21:03.315876  6517 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:03.315676  6631 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:03.190347  6694 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.361891  6386 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:03.376202  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.380097  6563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.011s	sys 0.028s
I20260709 12:21:03.360689  6667 consensus_queue.cc:1059] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:21:03.381757  6671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.020s	sys 0.028s
W20260709 12:21:03.394493  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 69860.3us
I20260709 12:21:03.431886  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:03.432164  6725 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:03.432564  6264 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:03.433045  6264 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:03.433221  4955 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.371201  6542 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:03.434237  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 865) took 2253 ms. Trace:
I20260709 12:21:03.433921  6264 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:03.434443  6722 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:21:03.434602  4992 rpcz_store.cc:276] 0709 12:21:01.180804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.916379 (+735575us) service_pool.cc:224] Handling call
0709 12:21:01.916661 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.922806 (+  6145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.922834 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.967094 (+ 44260us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.887256 (+920162us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:02.887314 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.887391 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.433977 (+546586us) raft_consensus.cc:1685] finished
0709 12:21:03.434002 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.434183 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2512,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":4234,"thread_start_us":888042,"threads_started":1,"wal-append.queue_time_us":1304768}
W20260709 12:21:03.436142  6724 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:03.437673  6521 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:03.438200  6521 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.438607  6521 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.439662  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 553) took 2102 ms. Trace:
I20260709 12:21:03.440034  4332 rpcz_store.cc:276] 0709 12:21:01.337387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.895764 (+558377us) service_pool.cc:224] Handling call
0709 12:21:01.896023 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.913636 (+ 17613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.913665 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.914137 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.348372 (+434235us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b4800043458. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:21:02.887454 (+539082us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:02.887508 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.887584 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.439367 (+551783us) raft_consensus.cc:1685] finished
0709 12:21:03.439388 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.439603 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91804,"raft.queue_time_us":5552,"raft.run_cpu_time_us":2324,"raft.run_wall_time_us":427025,"spinlock_wait_cycles":9540992,"thread_start_us":914419,"threads_started":1,"wal-append.queue_time_us":1324396}
I20260709 12:21:03.442054  6735 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:03.442847  6735 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:03.444777  6735 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:03.445946  4955 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.446772  6264 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:03.448535  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.448927  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:03.449548  4407 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:03.449760  6600 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:03.449885  6735 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:03.450311  6735 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:03.451215  6735 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.452459  6735 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:03.452637  6521 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:03.376015  4988 rpcz_store.cc:276] 0709 12:21:01.992436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.995459 (+  3023us) service_pool.cc:224] Handling call
0709 12:21:02.332015 (+336556us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:03.182950 (+850935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37412224}
I20260709 12:21:03.377837  6715 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.371225  4328 rpcz_store.cc:276] 0709 12:21:01.958641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.419612 (+460971us) service_pool.cc:224] Handling call
0709 12:21:02.505759 (+ 86147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.175932 (+670173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.202172 (+ 26240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:03.389809  6714 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.457939  6714 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:03.375867  6505 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.460569  6505 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:03.461158  6505 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:03.461615  6505 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:03.414062  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:03.375886  6657 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:03.360399  6701 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.433593  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2225) took 2280 ms. Trace:
I20260709 12:21:03.476537  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.463505  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:03.471374  4957 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.001s	sys 0.075s
W20260709 12:21:03.476240  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62300.7us
I20260709 12:21:03.476351  4407 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:03.362349  6615 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:03.478593  4957 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.002s	sys 0.075s
W20260709 12:21:03.479018  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.476917  4330 rpcz_store.cc:276] 0709 12:21:01.152887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.893569 (+740682us) service_pool.cc:224] Handling call
0709 12:21:01.893841 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.920426 (+ 26585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.920474 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.924069 (+  3595us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.083166 (+1159097us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:03.083224 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.083355 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.433384 (+350029us) raft_consensus.cc:1685] finished
0709 12:21:03.433404 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.433535 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19309,"raft.queue_time_us":20256,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7471,"thread_start_us":1050367,"threads_started":1,"wal-append.queue_time_us":1452212}
W20260709 12:21:03.464689  6671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.020s	sys 0.029s
W20260709 12:21:03.475860  6676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.024s	sys 0.051s
I20260709 12:21:03.426556  6553 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:21:03.482036  6721 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.159s	user 0.003s	sys 0.000s
I20260709 12:21:03.405050  6589 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.494707  6589 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:03.495579  6615 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.496272  6264 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:03.496114  6615 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.496925  6264 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:03.498060  6264 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:03.491482  6676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.024s	sys 0.051s
I20260709 12:21:03.482388  6517 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.499845  6694 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:03.499958  6676 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:03.500717  6676 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.501662  6715 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:03.462553  6505 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.480015  6386 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:03.480087  6542 raft_consensus.cc:697] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:03.506461  4151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.096s	sys 0.117s
W20260709 12:21:03.506878  4151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.096s	sys 0.117s
I20260709 12:21:03.502946  6690 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.541429  6676 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:03.546413  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 859) took 2606 ms. Trace:
I20260709 12:21:03.546820  4990 rpcz_store.cc:276] 0709 12:21:00.939572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.863869 (+924297us) service_pool.cc:224] Handling call
0709 12:21:01.864358 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.864764 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.864801 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.865791 (+   990us) log.cc:844] Serialized 487 byte log entry
0709 12:21:03.052237 (+1186446us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:03.186781 (+134544us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.194227 (+  7446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.194298 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.546199 (+351901us) raft_consensus.cc:1685] finished
0709 12:21:03.546218 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.546348 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7215,"raft.queue_time_us":60630,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":28567,"thread_start_us":1186105,"threads_started":1,"wal-append.queue_time_us":1502893}
I20260709 12:21:03.500046  6517 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:03.553215  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.526196  6715 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:03.545440  6690 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:03.505318  6657 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:03.573673  4371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.018s	sys 0.009s
W20260709 12:21:03.576092  4372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.022s
W20260709 12:21:03.576556  4372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.005s	sys 0.022s
W20260709 12:21:03.577214  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 513523us
W20260709 12:21:03.578964  4331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.019s
W20260709 12:21:03.579726  4371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.018s	sys 0.009s
I20260709 12:21:03.579934  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1903) took 2727 ms. Trace:
W20260709 12:21:03.580147  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 523278us
I20260709 12:21:03.560894  6386 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.582238  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:03.583534  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.584390  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:03.586544  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.580441  4331 rpcz_store.cc:276] 0709 12:21:00.852961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.809293 (+956332us) service_pool.cc:224] Handling call
0709 12:21:01.809646 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:01.809894 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:02.100268 (+290374us) log.cc:844] Serialized 14 byte log entry
0709 12:21:03.579438 (+1479170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:03.579514 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:03.579587 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.579695 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.579865 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2531,"prepare.queue_time_us":163913,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5658,"raft.queue_time_us":177270,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16707,"thread_start_us":1730364,"threads_started":3,"wal-append.queue_time_us":1304069}
I20260709 12:21:03.600198  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:03.557420  6715 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:03.605679  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 535441us
I20260709 12:21:03.606506  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:03.623378  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:03.625430  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.018s	sys 0.013s
W20260709 12:21:03.625869  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.013s
I20260709 12:21:03.599539  6631 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.602128  6501 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:03.625452  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.601466  6717 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:03.604486  6507 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:21:03.635349  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 48893.8us
I20260709 12:21:03.636098  4372 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:03.636469  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:03.637163  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.565641  6542 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:03.627790  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 550486us
W20260709 12:21:03.632169  4219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.044s
W20260709 12:21:03.640074  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.624080  6583 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:03.644164  4219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.003s	sys 0.044s
I20260709 12:21:03.626720  6490 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:03.644296  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.648123  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:03.638065  6495 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:03.653731  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:03.655035  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.655617  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:03.649343  4219 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:03.662456  4955 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.699s (SENT) [suppressed 9 similar messages]
I20260709 12:21:03.663120  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:03.663869  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:03.664793  4400 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:03.667676  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.644970  6598 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:03.642810  6501 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:03.671437  4334 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:03.645246  6583 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:03.646348  6713 raft_consensus.cc:2764] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:21:03.674913  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.681862  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:03.721659  4299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.014s
I20260709 12:21:03.657069  6694 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:03.656587  6717 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:03.638938  6631 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:03.657392  6517 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:03.799427  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:03.674952  6738 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.800700  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:03.818778  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:03.838634  4984 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.838912  4985 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:03.836016  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 173383us
I20260709 12:21:03.672686  6490 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:03.653921  6695 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 12:21:03.802719  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 158482us
I20260709 12:21:03.802971  4989 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:03.652429  6601 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:21:03.682670  6583 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:03.684916  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:03.842023  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 192746us
I20260709 12:21:03.838162  4992 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:03.836318  4299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.013s	sys 0.028s
I20260709 12:21:03.679133  6596 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:03.669314  6735 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
W20260709 12:21:03.866772  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 228119us
I20260709 12:21:03.836205  6507 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:03.834800  6712 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:03.835706  6713 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.795423  6408 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.861459  4984 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:03.862718  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.873932  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:03.801635  6745 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:03.875939  4992 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:03.834156  6747 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:03.791046  6600 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:03.837814  6563 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:03.864115  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:03.722939  6741 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.202s
I20260709 12:21:03.722645  6742 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.202s
I20260709 12:21:03.869086  6746 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:03.885001  6729 log.cc:927] Time spent T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 12:21:03.889755  6730 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:21:03.916647  4248 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:03.916566  4247 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:03.918081  4249 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:03.918139  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:03.918399  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:03.919557  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:03.920454  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:03.921391  4256 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:03.920358  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:03.888230  6517 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:03.994694  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.887861  6408 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.903733  6505 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.861304  6738 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.877509  6712 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:03.883833  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:03.908089  6755 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:04.011684  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.014881  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 152284us
I20260709 12:21:04.036149  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:04.031013  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:03.979589  6760 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:21:03.961792  6495 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.036952  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.037556  4248 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:04.038038  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:04.043267  4330 raft_consensus.cc:2410] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:03.900729  6563 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.040045  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:03.934221  6746 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.984161  6715 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.045946  6746 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.017570  6747 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:03.884016  6501 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:03.884377  6713 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.003417  6772 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.060288  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.025985  6598 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:04.090785  6775 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:04.092567  6771 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:04.092784  6631 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:04.093530  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.094795  6750 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:21:04.081439  6733 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.439s	user 0.001s	sys 0.001s
W20260709 12:21:04.097227  6630 consensus_meta.cc:287] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.000s
I20260709 12:21:04.013314  6517 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.074956  6747 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:04.077952  6753 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.034372  6505 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.081707  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:04.315773  4372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.006s
W20260709 12:21:04.316342  4372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.006s
W20260709 12:21:04.312549  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0046683909999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 12:21:04.198992  6408 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:04.314805  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 426974us
I20260709 12:21:04.056187  6495 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.360065  6495 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.031929  6507 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.088649  6521 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.042883  6596 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:21:04.427210  6780 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.428251  6780 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.428959  6671 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.429885  6671 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.430168  6521 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.431658  6701 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.432389  6671 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.433708  6521 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.085592  6598 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:04.437086  6598 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.438736  6657 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:04.194754  6615 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.137310  6631 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:04.470629  6517 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.471760  6631 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:04.197146  6690 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.126991  6695 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:04.477550  6695 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:04.479322  6695 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.480770  6695 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:04.134897  6712 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.484321  6712 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.265913  6713 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:04.098567  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:03.962306  6717 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.487912  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.489080  4333 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:04.490556  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:04.202524  6734 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.632s	user 0.001s	sys 0.007s
I20260709 12:21:04.491883  6408 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.492362  6630 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:04.272238  6738 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.492880  6630 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:04.494206  6601 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:04.494716  6601 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:04.496588  6601 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.141301  6747 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:04.133512  6748 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:21:04.479063  6715 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:04.143631  6752 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:04.153892  6753 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.133569  6766 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.202124  6768 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:04.431156  6780 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:04.512006  6768 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.099521  6772 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.128023  6775 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:04.314451  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.323941  6776 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:04.529433  6776 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:04.335359  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.530378  6521 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:04.131889  6771 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.361193  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.540488  4325 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:04.540879  6765 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.402599  6542 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:21:04.403785  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46867us
I20260709 12:21:04.543711  4331 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:21:04.544157  4331 pending_rounds.cc:85] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 4
I20260709 12:21:04.544457  4331 pending_rounds.cc:107] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:21:04.544768  4331 raft_consensus.cc:2889] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:04.541563  6765 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.547911  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:04.550721  6753 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.550882  6542 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:04.551466  6408 consensus_queue.cc:1059] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:04.539006  6771 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:04.416887  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.424739  6563 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.185516  6600 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:04.464057  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.562362  6600 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.563477  6542 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:04.564110  6601 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.564319  6542 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.458647  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 560) took 2504 ms. Trace:
I20260709 12:21:04.467257  4332 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:04.467151  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.468302  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.470062  4326 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:04.459748  4253 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:04.475601  6631 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.567888  4325 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:21:04.568336  4325 pending_rounds.cc:85] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 9
I20260709 12:21:04.568584  4325 pending_rounds.cc:107] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:21:04.568727  4407 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:04.568974  4986 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:04.490986  6701 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.492892  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.592113  4333 raft_consensus.cc:2410] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:04.591770  6701 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.500768  6752 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.594112  6701 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.594506  6752 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.499671  6715 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:04.596557  4252 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:21:04.464694  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.520648  6772 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.524395  6746 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.597991  4987 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:04.525310  6775 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.526310  4250 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:04.527796  6690 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:04.527765  6766 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.529737  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:04.401429  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 43862.8us
I20260709 12:21:04.532835  6776 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:04.534638  4988 consensus_meta.cc:287] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.003s
I20260709 12:21:04.535749  4983 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:04.551823  4221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.024s	sys 0.038s
W20260709 12:21:04.415726  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 378381us
I20260709 12:21:04.552898  6695 raft_consensus.cc:3055] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:04.620779  6695 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:04.568843  4325 raft_consensus.cc:2889] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:04.621655  4988 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:04.571621  4327 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:04.622053  6695 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.573916  4326 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:21:04.566236  4334 rpcz_store.cc:276] 0709 12:21:01.954339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.322922 (+368583us) service_pool.cc:224] Handling call
0709 12:21:02.323178 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:03.674081 (+1350903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.457999 (+783918us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002f35d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:04.458408 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100215040}
I20260709 12:21:04.583426  6598 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.596084  6715 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.445397  6505 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:04.494611  6630 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.605257  6768 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.623241  6676 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.624661  6676 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.625342  6715 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:04.605399  6746 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.606659  6690 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:04.627867  6690 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:04.607523  4257 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:04.608275  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:04.609673  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:04.610324  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:04.611569  6772 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.629312  6676 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:04.638016  6772 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.640604  6772 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.641733  4252 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 12:21:04.641929  6630 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.641983  6542 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.607580  6264 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.615602  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45326.5us
I20260709 12:21:04.616662  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:04.618189  6766 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.611631  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:04.620896  4221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.024s	sys 0.038s
I20260709 12:21:04.443164  4248 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:04.627508  4326 pending_rounds.cc:85] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 4
I20260709 12:21:04.645360  4326 pending_rounds.cc:107] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:21:04.645783  4407 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:04.646117  4401 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:04.645799  4326 raft_consensus.cc:2917] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:21:04.647965  4326 raft_consensus.cc:2889] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:04.648108  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:04.649120  4250 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.648907  6264 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.647126  4331 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:04.652423  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.656209  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.657383  4983 raft_consensus.cc:2393] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:04.660079  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.660499  6746 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.660806  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.661228  6746 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.629135  6690 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:04.664237  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:04.664513  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 135016us
I20260709 12:21:04.665746  6695 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:04.666155  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.666941  4327 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:04.667533  6768 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:04.667657  6712 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:04.668022  6768 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.669795  6768 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.672164  6747 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.674724  6747 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.660914  4331 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
W20260709 12:21:04.663571  6583 consensus_meta.cc:287] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.777s	user 0.004s	sys 0.008s
I20260709 12:21:04.695803  4988 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:04.695603  6583 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.697105  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:04.697590  6746 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.697810  4987 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.697933  6583 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.694005  4257 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:04.693897  6505 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.699430  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68732.2us
I20260709 12:21:04.699637  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:04.699853  6505 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.710110  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:04.676465  6264 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:04.711946  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:04.712186  4986 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:21:04.712373  6746 raft_consensus.cc:2764] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:04.712932  6772 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:04.717842  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:04.718163  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.719270  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.720007  4327 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:04.724262  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.723538  6765 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:04.730996  6553 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:04.806813  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.732556  4331 raft_consensus.cc:2410] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:04.767815  4987 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:04.816272  4218 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:04.794179  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.773072  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.734619  4255 consensus_meta.cc:287] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.008s
W20260709 12:21:04.867479  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:04.868115  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.775548  4332 pending_rounds.cc:85] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 1
W20260709 12:21:04.775141  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 47680.1us
I20260709 12:21:04.872412  4332 pending_rounds.cc:107] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:21:04.872825  4332 raft_consensus.cc:2889] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:04.876052  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.876368  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:04.876906  4991 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:04.877148  4248 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:04.731290  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.731945  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.878342  4992 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
W20260709 12:21:04.879582  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 152327us
I20260709 12:21:04.883615  6747 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:04.884941  6747 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:04.883692  4255 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:04.887480  6769 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.887122  6747 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.888036  6769 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:04.899111  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.900444  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.900990  4333 raft_consensus.cc:1813] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:04.901566  4333 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:04.902362  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:04.902863  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.902859  4333 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:04.913105  4333 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
W20260709 12:21:04.774760  6793 log.cc:927] Time spent T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:21:04.733827  6735 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 12:21:04.919600  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:04.920184  6676 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.922541  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:04.767707  6772 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.156s
W20260709 12:21:04.961807  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.923648  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:04.776495  6695 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:04.925284  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.927218  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:04.928620  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.939455  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:04.941479  4325 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:04.943086  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:04.733356  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.733898  6690 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:04.923578  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:04.923657  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:04.963142  4250 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:04.823247  6553 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.965020  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.965349  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:04.965381  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:04.965574  4256 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:04.970415  4254 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:04.971850  6772 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:21:05.032871  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.051344  4992 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:05.051821  4247 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.052476  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:05.055591  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.066198  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.089210  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.076529  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.075744  4249 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
W20260709 12:21:05.092036  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 127743us
I20260709 12:21:04.959417  6769 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:05.116804  4255 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 2: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:05.118088  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:05.094208  6553 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.126016  6264 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:05.126745  6553 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:05.137478  4252 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:05.138707  4250 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:05.080395  6772 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:05.142864  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.141911  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.142899  4249 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.139972  4987 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:05.148963  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:05.148281  4253 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:05.072762  6505 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:05.088037  6788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.012s	sys 0.035s
I20260709 12:21:05.122395  6676 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.180938  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.182497  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.167086  4986 raft_consensus.cc:2393] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:05.140744  4988 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:05.139937  6553 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:21:05.193255  4253 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:05.077939  6695 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:05.168032  6788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.012s	sys 0.035s
I20260709 12:21:05.196836  4256 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:21:05.147909  6630 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:21:05.184284  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:05.203831  6501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.023s	sys 0.075s
W20260709 12:21:05.209754  4371 connection.cc:256] RPC call timeout handler was delayed by -1.5796352160000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:21:05.210237  4371 connection.cc:256] RPC call timeout handler was delayed by -1.5794962640002268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 12:21:05.209949  6772 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.211349  6772 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.211608  6563 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:05.212280  6563 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:05.213611  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 80023.2us
W20260709 12:21:05.210527  4371 connection.cc:256] RPC call timeout handler was delayed by -1.4489962640000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:21:05.204433  6501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.023s	sys 0.075s
W20260709 12:21:05.215879  4371 connection.cc:256] RPC call timeout handler was delayed by -1.0853962640003374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:21:05.217170  4371 connection.cc:256] RPC call timeout handler was delayed by -1.0568192220002857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2788s for a response
I20260709 12:21:05.214342  6563 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:05.218900  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:05.224623  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 46721.6us
I20260709 12:21:05.225447  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:05.228884  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:05.232559  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.224974  4983 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:05.209955  6783 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.238494  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.229784  6732 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:05.238895  6738 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:05.250906  6768 consensus_meta.cc:287] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.581s	user 0.002s	sys 0.011s
I20260709 12:21:05.232792  6746 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:21:05.263986  4407 raft_consensus.cc:2410] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:21:05.265125  4219 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:05.273525  4401 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:05.281750  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.286751  4409 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:05.288537  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:05.265858  4247 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:05.270100  6769 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:05.290522  6769 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.290846  6769 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.292311  4248 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:05.293045  4249 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:05.269999  6738 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:05.302040  6738 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.302274  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:05.303133  4403 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:05.304256  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:05.304924  4406 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:05.263365  6732 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.309904  4402 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:21:05.310218  6732 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.311705  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.312351  4401 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:05.315680  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.316337  4402 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
W20260709 12:21:05.327204  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62162.2us
W20260709 12:21:05.337898  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.284343  6598 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.348217  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:05.352800  6695 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:05.365064  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.275908  6768 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:05.371874  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.386720  6789 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:05.389178  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.390130  4401 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:05.390799  4407 raft_consensus.cc:2376] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4. Re-sending same reply.
I20260709 12:21:05.398965  4406 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2.
I20260709 12:21:05.401741  4402 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:05.407846  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:05.349504  6783 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.418707  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:05.421653  4402 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:05.406878  6789 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:05.404387  6598 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:05.430675  4990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.018s	sys 0.047s
W20260709 12:21:05.455964  4990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.019s	sys 0.047s
I20260709 12:21:05.444856  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:05.445263  4330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.008s	sys 0.008s
W20260709 12:21:05.423202  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.460839  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.462849  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.457222  4330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.009s	sys 0.008s
W20260709 12:21:05.458220  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.518375  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.454106  4326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.008s	sys 0.010s
I20260709 12:21:05.509724  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:05.519997  4326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.009s	sys 0.010s
W20260709 12:21:05.444456  6761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.010s	sys 0.029s
W20260709 12:21:05.524857  6761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.010s	sys 0.029s
W20260709 12:21:05.489785  6631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.020s	sys 0.038s
W20260709 12:21:05.526113  6631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.020s	sys 0.039s
I20260709 12:21:05.445199  6630 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:05.527390  6630 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:05.529788  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:05.531286  4326 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
W20260709 12:21:05.435349  4328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.023s	sys 0.043s
W20260709 12:21:05.531931  4328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.024s	sys 0.044s
I20260709 12:21:05.532594  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:05.533056  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1920) took 1174 ms. Trace:
I20260709 12:21:05.533422  4326 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:05.445374  6717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.010s	sys 0.024s
W20260709 12:21:05.539634  6717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.010s	sys 0.024s
I20260709 12:21:05.543350  6783 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:05.544260  6630 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:05.545451  6598 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:05.546466  6768 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:05.551525  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.552109  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.551725  6789 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:05.454013  6766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.005s	sys 0.012s
I20260709 12:21:05.428507  6676 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:05.555778  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:05.558297  6738 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:05.555799  6766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.006s	sys 0.014s
I20260709 12:21:05.568424  6738 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:05.569453  6745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.015s	sys 0.022s
W20260709 12:21:05.569918  6745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.611s	user 0.015s	sys 0.022s
I20260709 12:21:05.570253  6745 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:05.570714  6738 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.571290  6738 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.571468  6745 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.573787  6738 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:05.576020  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.576318  6769 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:05.586760  6630 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:05.554718  6732 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.601554  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:05.559508  4328 rpcz_store.cc:276] 0709 12:21:04.359064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.366061 (+  6997us) service_pool.cc:224] Handling call
0709 12:21:04.402467 (+ 36406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.403060 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:04.403794 (+   734us) log.cc:844] Serialized 14 byte log entry
0709 12:21:05.532551 (+1128757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:05.532626 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:05.532704 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.532798 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:05.532952 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":362,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":77,"raft.queue_time_us":8929,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":1128114,"threads_started":1}
I20260709 12:21:05.602746  6631 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:05.603394  6631 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.604395  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:05.605293  4328 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:05.605414  6631 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:05.605887  6772 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:05.606300  6772 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.606632  6772 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:05.611439  4400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.020s	sys 0.024s
W20260709 12:21:05.611928  4400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.020s	sys 0.024s
W20260709 12:21:05.613569  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.616852  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.601643  6732 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:05.660946  6738 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.661659  6738 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.664078  6738 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:05.668403  6694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.566s	user 0.076s	sys 0.155s
W20260709 12:21:05.669039  6694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.805s	user 0.076s	sys 0.156s
I20260709 12:21:05.669469  6694 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:05.670918  6694 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.640360  6769 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:05.691483  6769 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.692171  6769 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:05.695282  6769 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:05.682874  4402 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
W20260709 12:21:05.720153  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.772318  4328 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:05.774114  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:05.798480  4218 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.061s	sys 0.102s
W20260709 12:21:05.803421  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 199682us
W20260709 12:21:05.804814  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.799211  4218 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.061s	sys 0.102s
W20260709 12:21:05.805727  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 660043us
W20260709 12:21:05.820217  4218 connection.cc:256] RPC call timeout handler was delayed by -1.8210780690001229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 12:21:05.820878  4218 connection.cc:256] RPC call timeout handler was delayed by -1.4034780689999025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:21:05.821395  4218 connection.cc:256] RPC call timeout handler was delayed by -1.165878068999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22599999999999998s for a response
W20260709 12:21:05.826241  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 270522us
I20260709 12:21:05.824883  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:05.802374  6746 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:05.843502  4328 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:05.851454  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.852321  4249 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:05.823724  6563 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:05.823307  6630 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:21:05.857815  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:05.853442  6746 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:05.869354  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:05.873797  4328 raft_consensus.cc:2393] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:05.874449  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:05.857867  6601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.005s	sys 0.031s
W20260709 12:21:05.876433  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.876461  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:05.877431  4249 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:05.877974  6601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.005s	sys 0.031s
I20260709 12:21:05.855180  6772 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:05.879274  6600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.025s	sys 0.071s
I20260709 12:21:05.877135  6563 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:05.919325  4249 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:05.920372  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.921728  4255 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:05.888229  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.927454  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:05.929458  4328 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:05.920413  6600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.354s	user 0.026s	sys 0.071s
I20260709 12:21:05.926661  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:05.926306  4327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.016s	sys 0.011s
W20260709 12:21:05.933900  4327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.016s	sys 0.011s
I20260709 12:21:05.932435  4252 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
W20260709 12:21:05.942576  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.942059  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.945218  4255 raft_consensus.cc:2368] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:05.925000  6742 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:05.939245  6507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.446s	user 0.008s	sys 0.043s
I20260709 12:21:05.946177  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:05.951768  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 97116.3us
I20260709 12:21:05.939513  6777 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:05.960927  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.973740  4252 raft_consensus.cc:2376] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5. Re-sending same reply.
W20260709 12:21:05.959578  6507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.540s	user 0.009s	sys 0.043s
W20260709 12:21:05.982507  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:05.959750  6386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.021s	sys 0.046s
W20260709 12:21:05.984297  4257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.269s	user 0.055s	sys 0.120s
I20260709 12:21:05.985996  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:05.989451  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.979957  6713 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:05.984561  6796 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:21:05.989238  6386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.478s	user 0.022s	sys 0.047s
W20260709 12:21:05.986515  4257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.056s	sys 0.120s
I20260709 12:21:05.997265  4404 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:05.997301  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:05.997473  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:05.997839  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:06.005599  4255 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:05.998260  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:05.998385  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:05.998950  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:06.006690  4253 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 3: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:05.999722  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:06.006629  4252 raft_consensus.cc:2376] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5. Re-sending same reply.
I20260709 12:21:06.011694  4249 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:05.959399  6742 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.014715  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:06.014907  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:06.015333  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:06.017771  4250 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:06.017659  4254 raft_consensus.cc:2376] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4. Re-sending same reply.
I20260709 12:21:06.021368  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1699) took 1299 ms. Trace:
I20260709 12:21:05.994525  6713 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.993309  6777 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:06.028510  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.012953  6507 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.028098  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.992776  6600 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:05.980509  6746 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:06.054301  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:06.026116  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:06.059121  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.061944  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.025702  6713 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:06.067082  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:06.068540  4248 raft_consensus.cc:2410] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:06.069556  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.069391  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:06.070714  4250 raft_consensus.cc:2410] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:06.070367  6777 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.072011  6801 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:21:06.073342  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 640) took 2276 ms. Trace:
I20260709 12:21:06.073688  4990 rpcz_store.cc:276] 0709 12:21:03.796928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.797053 (+   125us) service_pool.cc:224] Handling call
0709 12:21:03.797432 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.797862 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.797903 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.834198 (+ 36295us) log.cc:844] Serialized 26 byte log entry
0709 12:21:04.501367 (+667169us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b18003475c0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:05.539577 (+1038210us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:05.539649 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.539748 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.073060 (+533312us) raft_consensus.cc:1685] finished
0709 12:21:06.073076 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.073272 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6152,"raft.queue_time_us":48830,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":17913,"spinlock_wait_cycles":11632512,"thread_start_us":954831,"threads_started":1,"wal-append.queue_time_us":2073336}
I20260709 12:21:06.075769  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:06.076366  4250 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 2.
I20260709 12:21:06.076634  6761 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.077143  6761 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.079788  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:06.083436  6783 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:06.084028  6783 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:06.084142  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.022487  4257 rpcz_store.cc:276] 0709 12:21:04.713865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.714106 (+   241us) service_pool.cc:224] Handling call
0709 12:21:04.714526 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.714884 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:21:04.715327 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.013022 (+1297695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.013100 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:06.013174 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.013343 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.013513 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":904,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":8985,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6699,"thread_start_us":1288188,"threads_started":1}
I20260709 12:21:06.085050  6783 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.085845  6630 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.086417  6630 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.088809  6630 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:06.089721  6630 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.090299  6630 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.092523  6630 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:06.093246  6630 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.093809  6598 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:06.093750  6630 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.102821  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.016810  4247 raft_consensus.cc:2376] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6. Re-sending same reply.
I20260709 12:21:06.079216  6761 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:06.068380  6772 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.113317  4296 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.025s	sys 0.109s
I20260709 12:21:06.053994  6507 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.113806  4296 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.025s	sys 0.109s
W20260709 12:21:06.118450  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 1.0684e+06us
W20260709 12:21:06.116631  4989 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.011s	sys 0.029s
W20260709 12:21:06.120648  4989 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.011s	sys 0.029s
I20260709 12:21:06.110000  6598 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:06.012770  6563 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:06.127696  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.067015  6386 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 12:21:06.125692  4405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.037s	sys 0.031s
W20260709 12:21:06.154178  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.137562  4405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.037s	sys 0.031s
W20260709 12:21:06.142342  4956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.018s	sys 0.053s
W20260709 12:21:06.179590  4956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.018s	sys 0.053s
W20260709 12:21:06.179874  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 1.05964e+06us
W20260709 12:21:06.175464  4955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.008s	sys 0.036s
W20260709 12:21:06.187059  4955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.008s	sys 0.036s
W20260709 12:21:06.187721  4331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.029s	sys 0.033s
W20260709 12:21:06.189132  4987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.016s	sys 0.030s
W20260709 12:21:06.190701  4331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.029s	sys 0.033s
W20260709 12:21:06.190840  4987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.016s	sys 0.030s
I20260709 12:21:06.186417  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:06.185052  6732 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:06.139117  6598 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.208290  6812 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:21:06.219537  4332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.017s	sys 0.039s
I20260709 12:21:06.236207  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1931) took 1540 ms. Trace:
W20260709 12:21:06.233273  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.189962  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 964539us
W20260709 12:21:06.246806  4332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.017s	sys 0.041s
W20260709 12:21:06.249198  4325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.016s	sys 0.031s
W20260709 12:21:06.249673  4325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.016s	sys 0.031s
W20260709 12:21:06.250068  4334 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.017s	sys 0.035s
W20260709 12:21:06.251855  4334 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.017s	sys 0.035s
I20260709 12:21:06.208153  6732 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.239018  4984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.000s	sys 0.044s
W20260709 12:21:06.253449  4329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.491s	user 0.012s	sys 0.029s
W20260709 12:21:06.253738  4984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.000s	sys 0.044s
I20260709 12:21:06.251085  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1930) took 1555 ms. Trace:
W20260709 12:21:06.253809  4329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.635s	user 0.012s	sys 0.029s
I20260709 12:21:06.244379  4327 rpcz_store.cc:276] 0709 12:21:04.696224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.732819 (+ 36595us) service_pool.cc:224] Handling call
0709 12:21:04.868822 (+136003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.909800 (+ 40978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.909827 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.956961 (+ 47134us) log.cc:844] Serialized 26 byte log entry
0709 12:21:05.934313 (+977352us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:05.934355 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.934430 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.235891 (+301461us) raft_consensus.cc:1685] finished
0709 12:21:06.235922 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.236127 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37795,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":969370,"threads_started":1,"wal-append.queue_time_us":1269215}
W20260709 12:21:06.230933  6747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.038s	sys 0.058s
I20260709 12:21:06.264783  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 884) took 1066 ms. Trace:
I20260709 12:21:06.255071  4332 rpcz_store.cc:276] 0709 12:21:04.695890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.706180 (+ 10290us) service_pool.cc:224] Handling call
0709 12:21:04.775080 (+ 68900us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:04.775317 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.879742 (+104425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.879780 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.880285 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.249551 (+1369266us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:21:06.249669 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.249804 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.249910 (+   106us) raft_consensus.cc:1685] finished
0709 12:21:06.249923 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.251019 (+  1096us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18220416,"thread_start_us":1368806,"threads_started":1,"wal-append.queue_time_us":1339351}
I20260709 12:21:06.281569  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:06.282384  4327 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:06.315575  4221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.016s	sys 0.024s
I20260709 12:21:06.286875  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:06.277346  4984 rpcz_store.cc:276] 0709 12:21:05.188981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.189267 (+   286us) service_pool.cc:224] Handling call
0709 12:21:05.215911 (+ 26644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.250646 (+ 34735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.250676 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.251278 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.254481 (+1003203us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:06.254535 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.254630 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.254691 (+    61us) raft_consensus.cc:1685] finished
0709 12:21:06.254710 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.254861 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21056,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":47259,"thread_start_us":887544,"threads_started":1,"wal-append.queue_time_us":902863}
I20260709 12:21:06.317478  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.318344  4332 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
W20260709 12:21:06.279960  6747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.039s	sys 0.059s
I20260709 12:21:06.271761  6769 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:06.329753  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.278723  6630 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:06.276401  6742 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.323458  6745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.006s	sys 0.024s
W20260709 12:21:06.316170  4221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.016s	sys 0.024s
I20260709 12:21:06.319525  6772 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.277343  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:06.364452  4409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.007s	sys 0.038s
W20260709 12:21:06.371687  4409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.007s	sys 0.038s
W20260709 12:21:06.368122  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.285334  6798 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:06.283716  6800 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:06.320472  4326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.019s	sys 0.015s
W20260709 12:21:06.373564  4400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.015s	sys 0.025s
W20260709 12:21:06.382225  4326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.019s	sys 0.015s
W20260709 12:21:06.382377  4400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.016s	sys 0.025s
W20260709 12:21:06.361397  6789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.015s	sys 0.023s
W20260709 12:21:06.369926  6745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.006s	sys 0.024s
W20260709 12:21:06.375708  6694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.021s	sys 0.019s
I20260709 12:21:06.380313  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1927) took 1685 ms. Trace:
W20260709 12:21:06.405627  6694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.023s	sys 0.019s
I20260709 12:21:06.333326  6769 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:06.406837  6813 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
W20260709 12:21:06.420696  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 369540us
I20260709 12:21:06.403710  4330 rpcz_store.cc:276] 0709 12:21:04.694675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.700748 (+  6073us) service_pool.cc:224] Handling call
0709 12:21:04.776058 (+ 75310us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:04.776240 (+   182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.776546 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.776587 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.816336 (+ 39749us) log.cc:844] Serialized 26 byte log entry
0709 12:21:05.517386 (+701050us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:05.517425 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:05.517509 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.374462 (+856953us) raft_consensus.cc:1685] finished
0709 12:21:06.374480 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.380229 (+  5749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16773888,"thread_start_us":694451,"threads_started":1,"wal-append.queue_time_us":1071950}
I20260709 12:21:06.374039  6507 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.402886  6789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.015s	sys 0.023s
I20260709 12:21:06.414928  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 487) took 1775 ms. Trace:
I20260709 12:21:06.437314  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:06.442795  6794 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.006s	sys 0.027s
W20260709 12:21:06.454993  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.443234  6794 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.006s	sys 0.027s
I20260709 12:21:06.420136  6694 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.469323  4218 leader_election.cc:336] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Timed out: RequestConsensusVote RPC to 127.3.7.132:43853 timed out after 1.556s (SENT)
I20260709 12:21:06.436944  4400 rpcz_store.cc:276] 0709 12:21:04.608262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.611741 (+  3479us) service_pool.cc:224] Handling call
0709 12:21:04.612193 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:04.612564 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:05.612397 (+999833us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.383160 (+770763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.383244 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.383326 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.383410 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.383566 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97425,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":1141,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":2128,"thread_start_us":1769396,"threads_started":2}
I20260709 12:21:06.495697  4330 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:06.443663  6553 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:06.400235  6772 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.503652  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:06.508482  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 286612us
W20260709 12:21:06.508731  4333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 2244) took 1582 ms (client timeout 1622 ms). Trace:
W20260709 12:21:06.509275  4333 rpcz_store.cc:269] 0709 12:21:04.921280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.050286 (+129006us) service_pool.cc:224] Handling call
0709 12:21:06.503274 (+1452988us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540013d154. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:06.503459 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946343168}
I20260709 12:21:06.412411  6798 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.499893  6601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.043s	sys 0.054s
I20260709 12:21:06.479729  6598 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.550621  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 129006us
I20260709 12:21:06.417246  6800 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.497722  6507 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.498188  6732 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:06.500802  6553 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:06.571282  4374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.014s	sys 0.014s
I20260709 12:21:06.578150  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:06.578730  4374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.015s	sys 0.014s
W20260709 12:21:06.551183  6601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.044s	sys 0.054s
W20260709 12:21:06.580582  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 140992us
I20260709 12:21:06.478674  6745 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:21:06.582728  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2239) took 1838 ms. Trace:
I20260709 12:21:06.582216  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 883) took 1413 ms. Trace:
W20260709 12:21:06.598058  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 311244us
I20260709 12:21:06.574304  6789 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:06.602362  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:06.597638  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:06.582288  6553 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.504238  6694 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:06.552698  6818 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:06.602942  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:06.580406  6732 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:06.587436  6747 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.592087  4989 rpcz_store.cc:276] 0709 12:21:05.169268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.203381 (+ 34113us) service_pool.cc:224] Handling call
0709 12:21:05.203776 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.204109 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:06.124729 (+920620us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.576690 (+451961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.576758 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.581321 (+  4563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.581658 (+   337us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.582148 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1128008,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":1293114,"threads_started":2}
I20260709 12:21:06.592160  4331 rpcz_store.cc:276] 0709 12:21:04.744347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.144032 (+399685us) service_pool.cc:224] Handling call
0709 12:21:05.191220 (+ 47188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.214894 (+ 23674us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:05.215235 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.567063 (+1351828us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.567112 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:06.581242 (+ 14130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.581603 (+   361us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.582657 (+  1054us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":941,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":252286,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":1320372,"threads_started":2,"wal-append.queue_time_us":1197850}
I20260709 12:21:06.577466  6761 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:21:06.622413  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 375922us
I20260709 12:21:06.623239  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:06.619460  6507 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:06.606122  6600 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:06.622002  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:06.630575  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.652611  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.641551  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.617686  6810 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
W20260709 12:21:06.676754  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63359.5us
I20260709 12:21:06.615320  6818 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:06.689603  4373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.015s
W20260709 12:21:06.689982  4373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.017s	sys 0.015s
W20260709 12:21:06.691802  6825 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:21:06.674307  6747 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.651769  6789 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:06.695485  6747 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:06.695745  6789 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.698210  6789 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.700100  6823 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:21:06.703716  6834 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:21:06.704919  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.705480  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.706899  6694 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:06.707458  6807 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.260s	user 0.000s	sys 0.004s
W20260709 12:21:06.708032  6816 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:21:06.622884  6783 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:21:06.709865  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1932) took 2013 ms. Trace:
I20260709 12:21:06.710438  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 882) took 1553 ms. Trace:
I20260709 12:21:06.710844  4987 rpcz_store.cc:276] 0709 12:21:05.156834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.157027 (+   193us) service_pool.cc:224] Handling call
0709 12:21:05.175689 (+ 18662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.176165 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.176192 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.176725 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.193995 (+1017270us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.194059 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.194160 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.710234 (+516074us) raft_consensus.cc:1685] finished
0709 12:21:06.710254 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.710378 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15644,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5803,"thread_start_us":1014119,"threads_started":1,"wal-append.queue_time_us":1231305}
I20260709 12:21:06.709012  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 580) took 2247 ms. Trace:
I20260709 12:21:06.712845  4329 rpcz_store.cc:276] 0709 12:21:04.461299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.463905 (+  2606us) service_pool.cc:224] Handling call
0709 12:21:04.464394 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.465178 (+   784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.465220 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.467882 (+  2662us) log.cc:844] Serialized 26 byte log entry
0709 12:21:04.614632 (+146750us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b18002bb760. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:06.255363 (+1640731us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:06.255418 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.255503 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.706815 (+451312us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:06.708783 (+  1968us) raft_consensus.cc:1685] finished
0709 12:21:06.708803 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.708938 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1487,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":43011,"spinlock_wait_cycles":89922176,"thread_start_us":1640520,"threads_started":1,"wal-append.queue_time_us":1904008}
I20260709 12:21:06.714735  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2307) took 1429 ms. Trace:
I20260709 12:21:06.715623  6772 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.717325  6821 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:21:06.710269  4325 rpcz_store.cc:276] 0709 12:21:04.696526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.123461 (+426935us) service_pool.cc:224] Handling call
0709 12:21:05.128766 (+  5305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.129114 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.129152 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.129808 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.250014 (+1120206us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:06.250058 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.250124 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.709654 (+459530us) raft_consensus.cc:1685] finished
0709 12:21:06.709675 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.709807 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1119815,"threads_started":1,"wal-append.queue_time_us":1304145}
I20260709 12:21:06.719041  6800 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.722023  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.723795  6818 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.724229  6769 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:06.728940  6828 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:06.730712  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2308) took 1430 ms. Trace:
I20260709 12:21:06.687685  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:06.737869  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 109049us
I20260709 12:21:06.731104  4409 rpcz_store.cc:276] 0709 12:21:05.299916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.325986 (+ 26070us) service_pool.cc:224] Handling call
0709 12:21:05.352274 (+ 26288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.517417 (+165143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.517448 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.525081 (+  7633us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.380101 (+855020us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:06.407985 (+ 27884us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.408209 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.702478 (+294269us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b18003ea700. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:06.719826 (+ 17348us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b54002355d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:06.719871 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.728198 (+  8327us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:06.730494 (+  2296us) raft_consensus.cc:1685] finished
0709 12:21:06.730513 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.730644 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29848,"prepare.run_cpu_time_us":174,"prepare.run_wall_time_us":1433,"raft.queue_time_us":7966,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":31177,"spinlock_wait_cycles":318317312,"thread_start_us":852901,"threads_started":1,"wal-append.queue_time_us":1056675}
I20260709 12:21:06.715101  4405 rpcz_store.cc:276] 0709 12:21:05.299524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.325460 (+ 25936us) service_pool.cc:224] Handling call
0709 12:21:05.327017 (+  1557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.352784 (+ 25767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.352813 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.353320 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.159957 (+806637us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:06.187169 (+ 27212us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.188419 (+  1250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.188517 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.585108 (+396591us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18001cd500. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:06.714431 (+129323us) raft_consensus.cc:1685] finished
0709 12:21:06.714536 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.714675 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3146,"prepare.queue_time_us":27483,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2616,"raft.queue_time_us":12943,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":18866,"spinlock_wait_cycles":4380416,"thread_start_us":769387,"threads_started":1,"wal-append.queue_time_us":1007277}
W20260709 12:21:06.741286  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.757216  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.758534  4331 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
W20260709 12:21:06.762856  4218 leader_election.cc:336] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.613s (SENT)
W20260709 12:21:06.763455  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 172442us
I20260709 12:21:06.765112  4327 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:06.765514  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.745020  6843 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.771003  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:06.772018  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 148860us
I20260709 12:21:06.741838  6694 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:06.779713  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 150114us
I20260709 12:21:06.745708  6772 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.774745  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.780652  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:06.783044  4329 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:06.780244  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.786422  4332 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:06.793041  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:06.750959  6840 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:06.791886  4331 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:06.823571  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.824743  4325 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:06.827777  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:06.831333  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 86981.7us
I20260709 12:21:06.833636  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:06.839462  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:06.799077  6783 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:06.850062  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 61125.7us
I20260709 12:21:06.844750  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:06.854497  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.858124  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.861858  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 174287us
I20260709 12:21:06.864279  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:06.789491  6694 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.827138  6852 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:06.793562  6772 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:06.783656  6843 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:06.869515  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:06.870365  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:06.870780  4955 connection.cc:256] RPC call timeout handler was delayed by -1.7901068200003465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3086s for a response
I20260709 12:21:06.870666  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:06.874259  4955 connection.cc:256] RPC call timeout handler was delayed by -1.765251131000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 12:21:06.845721  6850 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:06.874589  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0644772119999288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:21:06.849787  6783 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:06.888288  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.864993  6745 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:06.898578  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:06.910064  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:06.909484  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.915871  4401 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.888471  6563 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:06.897598  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:06.917114  4408 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:06.908643  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:06.897279  4407 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:06.889981  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:06.872345  6852 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.917865  6553 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:06.936197  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.886292  6601 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:06.888741  6798 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:06.921348  6713 consensus_meta.cc:287] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
W20260709 12:21:06.956624  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 163678us
I20260709 12:21:06.898291  6840 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:06.920336  6745 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:06.890156  6783 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.922665  6859 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.969143  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:06.927103  6563 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:06.966204  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:06.956295  6789 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.951792  6852 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:06.982566  4407 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:06.961570  6822 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.955864  6601 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:06.977032  6830 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.299s	user 0.001s	sys 0.002s
I20260709 12:21:06.971531  6745 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:06.999850  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 130449us
I20260709 12:21:07.001704  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.006572  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:07.000896  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90614.9us
I20260709 12:21:07.008961  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:07.010551  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:07.012454  4987 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:07.013042  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.014745  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.015508  4989 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:07.017684  4989 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:07.019351  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.020251  6507 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:07.020651  6507 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:07.020854  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.021656  6507 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.022871  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:07.023223  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.023553  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:07.024081  4992 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.024168  4983 raft_consensus.cc:2410] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:07.025157  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.025785  4990 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:07.026124  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.026618  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:07.027120  4985 raft_consensus.cc:2410] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:07.027724  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.028074  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.029639  6507 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.030190  4985 raft_consensus.cc:2410] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:07.027209  4990 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:07.032022  4409 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:06.949869  6845 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:21:07.030936  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1928) took 2312 ms. Trace:
I20260709 12:21:06.992898  6601 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:06.968402  6713 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:06.992899  6742 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.047188  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:06.995566  6841 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:06.993423  6861 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:07.057395  4992 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:07.081741  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.086017  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:07.040984  4334 rpcz_store.cc:276] 0709 12:21:04.695103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.702067 (+  6964us) service_pool.cc:224] Handling call
0709 12:21:04.899967 (+197900us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:04.900150 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:05.232547 (+332397us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:06.253376 (+1020829us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.774265 (+520889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:06.774324 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:06.774377 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.007081 (+232704us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54003d4354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:07.007144 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.007262 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75611,"prepare.queue_time_us":17692,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":233882,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":23007,"spinlock_wait_cycles":756629760,"thread_start_us":1515772,"threads_started":3,"wal-append.queue_time_us":718187}
I20260709 12:21:07.087831  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.088824  4992 raft_consensus.cc:2410] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:07.047830  6563 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:06.997617  6789 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:06.987515  6859 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.091957  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:07.099138  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1933) took 1779 ms. Trace:
I20260709 12:21:07.105545  4992 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:07.105427  4252 raft_consensus.cc:2410] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:07.105073  4326 rpcz_store.cc:276] 0709 12:21:05.319788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.537145 (+217357us) service_pool.cc:224] Handling call
0709 12:21:05.537630 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.537838 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.537868 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.538352 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.382863 (+844511us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:06.382927 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.383032 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.098864 (+715832us) raft_consensus.cc:1685] finished
0709 12:21:07.098896 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.099060 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":844033,"threads_started":1,"wal-append.queue_time_us":1049912}
W20260709 12:21:07.120906  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.121829  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.137427  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:07.138116  4254 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:07.103735  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.087572  6840 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.149076  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:07.157111  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48111.3us
W20260709 12:21:07.158219  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.149470  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:07.148380  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.168143  4250 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:07.162878  4401 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:07.171357  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.171993  4401 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:07.168342  4992 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:07.099083  6845 raft_consensus.cc:2764] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:21:07.174547  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.174975  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:07.037197  6822 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.075598  6742 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:07.099285  6841 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:07.150364  6851 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:21:07.188524  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.189210  4992 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:07.189451  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:07.152268  6553 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:07.190032  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.108845  6849 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:07.153937  6842 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:21:07.155679  6850 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:07.094000  6861 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.189648  6800 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:07.190627  4992 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:07.191308  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.191980  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:07.114629  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:07.155460  6789 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.184517  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.260403  4990 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
W20260709 12:21:07.341526  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 152174us
I20260709 12:21:07.218183  4983 raft_consensus.cc:2368] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4.
I20260709 12:21:07.190528  6694 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:07.345638  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:07.354059  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 173104us
I20260709 12:21:07.224799  6553 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:07.356829  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.222234  6843 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:07.340888  6837 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.624s	user 0.002s	sys 0.003s
I20260709 12:21:07.377112  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:07.370149  6869 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:21:07.241537  6850 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:07.351007  6812 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:21:07.380990  4407 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
W20260709 12:21:07.258874  6732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.002s	sys 0.007s
I20260709 12:21:07.396770  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2248) took 1987 ms. Trace:
I20260709 12:21:07.397746  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.276798  6858 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:07.351130  6857 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:21:07.385679  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.337065  6800 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:07.386822  4992 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:07.355366  6713 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:07.398753  4409 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:07.356336  6873 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:07.397286  4328 rpcz_store.cc:276] 0709 12:21:05.409530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.954821 (+545291us) service_pool.cc:224] Handling call
0709 12:21:05.961192 (+  6371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.981087 (+ 19895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.981134 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.981692 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.408426 (+426734us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:06.409742 (+  1316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.409852 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:07.170847 (+760995us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:07.377881 (+207034us) raft_consensus.cc:1685] finished
0709 12:21:07.377903 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:07.396706 (+ 18803us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16869,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"spinlock_wait_cycles":35171072,"thread_start_us":412454,"threads_started":1,"wal-append.queue_time_us":629707}
I20260709 12:21:07.363835  6844 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:07.407150  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.381443  6553 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:07.396988  6732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.005s	sys 0.010s
I20260709 12:21:07.384479  6870 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.422302  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.410343  6858 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:07.429651  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.411211  6844 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:07.454936  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:07.414824  6553 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.219319  6849 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.410704  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.461227  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.459777  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:07.464917  6861 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:07.460697  6856 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:21:07.460131  6858 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.490998  4401 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:07.526366  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 98303.8us
I20260709 12:21:07.526880  6850 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.527225  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.527534  6850 raft_consensus.cc:2764] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:07.528232  6850 raft_consensus.cc:2764] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:21:07.528578  4955 leader_election.cc:400] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:07.528878  4955 leader_election.cc:403] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:07.530290  4989 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:07.457568  6844 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:07.489583  6818 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.005s
W20260709 12:21:07.490170  6874 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:21:07.468299  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.566959  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:07.493790  6835 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.778s	user 0.002s	sys 0.002s
I20260709 12:21:07.430195  4409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:07.388284  6841 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.574421  4403 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:07.574723  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:07.583967  4409 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.573397  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:07.600373  6882 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:21:07.583976  6876 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:07.555337  6822 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:07.468914  6873 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:21:07.431417  6870 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:07.607499  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 153241us
I20260709 12:21:07.574446  6888 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:07.586144  6856 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:07.569624  6859 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:07.617048  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 62870.9us
W20260709 12:21:07.624290  6872 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:21:07.570410  6818 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.638850  4407 raft_consensus.cc:1217] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 12:21:07.639607  4407 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:21:07.641108  6832 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.954s	user 0.004s	sys 0.000s
I20260709 12:21:07.642261  4985 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:21:07.645888  6772 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.647955  6742 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:07.635429  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:07.556418  6800 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:07.611487  6873 consensus_queue.cc:1243] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 0aa405b398df42edbf74ee643aeb18dc log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:07.662210  4984 raft_consensus.cc:1813] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:07.660953  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:07.662808  4984 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:07.670326  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:07.660475  6601 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
I20260709 12:21:07.649015  6856 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:07.669397  6843 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:07.648782  6553 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:07.683925  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 62136.4us
I20260709 12:21:07.671993  6694 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:07.678944  6800 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:07.680709  6783 consensus_meta.cc:287] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.000s
W20260709 12:21:07.690516  4371 connection.cc:256] RPC call timeout handler was delayed by -1.0053342589999374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 12:21:07.685799  6843 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:07.708680  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.716584  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.679800  6601 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.689582  6694 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:07.714391  6843 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.728269  4406 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:07.731134  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:07.700330  6783 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.723881  6849 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.725142  6694 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:07.740976  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 47957us
I20260709 12:21:07.729100  6873 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:07.752393  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:07.759707  4405 raft_consensus.cc:2368] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:21:07.757150  4371 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.753444  6871 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:07.776778  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52445.5us
I20260709 12:21:07.792343  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.772564  6861 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:07.799425  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.806061  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 49011.4us
I20260709 12:21:07.769460  6873 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:07.818023  6818 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.755367  6838 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:21:07.819377  6895 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.003s
W20260709 12:21:07.819201  6894 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:21:07.837980  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:07.822019  6900 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:21:07.845820  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53620.8us
I20260709 12:21:07.846755  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:07.830528  6871 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.750504  6856 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.853036  6783 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:07.853739  6601 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:07.841508  6893 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.162s	user 0.000s	sys 0.002s
I20260709 12:21:07.843917  6870 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.860505  6841 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:07.877182  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 206922us
W20260709 12:21:07.877784  6852 consensus_meta.cc:287] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.001s
I20260709 12:21:07.865474  6553 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.880332  6818 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:07.904538  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:07.928049  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 81414.5us
I20260709 12:21:07.929100  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.884889  6841 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:07.935186  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 50008.2us
I20260709 12:21:07.939311  6870 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:07.943642  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 99237.8us
I20260709 12:21:07.944378  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:07.934823  6841 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.916056  6852 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.949239  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:07.946302  6831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.009s	sys 0.014s
I20260709 12:21:07.958797  6563 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:07.959506  6898 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:21:07.962009  6846 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:07.962468  6846 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:07.963321  6846 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:07.964100  6897 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:21:07.964702  6846 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:07.963486  6858 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.966406  4990 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:07.967407  6858 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:07.969659  6507 consensus_meta.cc:287] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.939s	user 0.008s	sys 0.003s
I20260709 12:21:07.970212  6507 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:07.970280  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.970649  6507 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.971028  6507 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:07.971340  4983 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:07.971925  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.975409  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:07.983696  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:07.915231  6873 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:07.949847  6838 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:07.993952  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.995431  6772 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.996410  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:07.997118  4327 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:07.998512  4296 connection.cc:256] RPC call timeout handler was delayed by -2.9306252050000694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:21:07.998925  4296 connection.cc:256] RPC call timeout handler was delayed by -2.8001252049998584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:21:07.999220  4296 connection.cc:256] RPC call timeout handler was delayed by -2.5850252049999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:21:07.999513  4296 connection.cc:256] RPC call timeout handler was delayed by -2.4734252050002397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:21:07.956645  6831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.009s	sys 0.014s
W20260709 12:21:08.003328  4296 connection.cc:256] RPC call timeout handler was delayed by -2.3690252050000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 12:21:08.004763  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52093.9us
I20260709 12:21:08.001967  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:08.005336  4296 connection.cc:256] RPC call timeout handler was delayed by -2.365425205000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:21:08.005883  4296 connection.cc:256] RPC call timeout handler was delayed by -2.365425205000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:21:08.006213  4296 connection.cc:256] RPC call timeout handler was delayed by -2.3006252049999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
I20260709 12:21:08.007486  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.009080  6913 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:08.009413  4256 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:08.007534  6910 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.009718  6913 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.010967  6910 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.013047  6913 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:07.996148  6852 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:08.013643  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:08.013971  6913 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.013993  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.014248  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:08.014735  4256 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:08.014499  6913 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.015169  4987 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:08.015793  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.016078  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:08.016122  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.016382  4257 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
W20260709 12:21:08.016708  4296 connection.cc:256] RPC call timeout handler was delayed by -2.0945252050000818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24660000000000004s for a response
I20260709 12:21:07.995915  6772 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:08.017092  4296 connection.cc:256] RPC call timeout handler was delayed by -2.0945252050000818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24660000000000004s for a response
W20260709 12:21:08.017428  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8478360689996407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 12:21:08.017753  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7704360689995156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:21:08.018025  4296 connection.cc:256] RPC call timeout handler was delayed by -1.71463606899988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:21:08.018312  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5886360689996764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:21:08.018599  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5886360689996764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 12:21:08.018821  6772 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:08.019193  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5715360689996487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 12:21:08.019380  6858 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:08.020200  6858 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:08.021005  6913 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.021517  6858 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.022171  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:08.019562  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5328360689995861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:21:08.023890  4296 connection.cc:256] RPC call timeout handler was delayed by -1.4023360689998299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 12:21:07.953331  6908 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:21:08.024233  4296 connection.cc:256] RPC call timeout handler was delayed by -1.4023360689998299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 12:21:08.038627  4296 connection.cc:256] RPC call timeout handler was delayed by -1.329436068999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 12:21:08.009115  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:08.037211  4250 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:08.001750  6745 consensus_meta.cc:287] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.993s	user 0.009s	sys 0.004s
W20260709 12:21:08.039072  4296 connection.cc:256] RPC call timeout handler was delayed by -1.329436068999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:21:08.043545  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0279360689996793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24950000000000003s for a response
I20260709 12:21:08.046232  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:08.047886  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:08.048581  4990 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
W20260709 12:21:08.043208  4218 connection.cc:256] RPC call timeout handler was delayed by -1.1448796409999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:21:08.050607  4218 connection.cc:256] RPC call timeout handler was delayed by -1.1448796409999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:21:08.051064  4218 connection.cc:256] RPC call timeout handler was delayed by -1.1124796409999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2255s for a response
W20260709 12:21:08.051427  4218 connection.cc:256] RPC call timeout handler was delayed by -1.0827796409998882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2288s for a response
W20260709 12:21:08.051776  4218 connection.cc:256] RPC call timeout handler was delayed by -1.0827796409998882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2288s for a response
I20260709 12:21:08.018548  6694 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.055642  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.076658  4252 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:08.056712  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:08.060051  6901 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:21:08.060412  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 85175.9us
I20260709 12:21:08.079187  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:08.077669  4987 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:08.080372  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:08.061334  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.007807  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:08.066406  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:08.067171  6907 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:08.068718  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 495) took 1203 ms. Trace:
I20260709 12:21:08.071364  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1540) took 1173 ms. Trace:
I20260709 12:21:08.013172  6843 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.084401  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:08.085227  4406 rpcz_store.cc:276] 0709 12:21:06.865467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.870427 (+  4960us) service_pool.cc:224] Handling call
0709 12:21:06.908156 (+ 37729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:07.728690 (+820534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.068474 (+339784us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002a6cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:08.068654 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885623040}
I20260709 12:21:08.013198  6910 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:08.087641  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:08.087903  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 71904.4us
I20260709 12:21:08.081584  4249 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:08.086011  4407 rpcz_store.cc:276] 0709 12:21:06.897901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.461839 (+563938us) service_pool.cc:224] Handling call
0709 12:21:07.492440 (+ 30601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.640029 (+147589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.071094 (+431065us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002a80d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:08.071275 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336385920}
W20260709 12:21:08.093849  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.075256  6772 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:08.095191  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 141048us
I20260709 12:21:08.095220  4325 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:08.098356  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:08.102556  6769 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:08.043582  6908 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.083106  6852 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:08.082261  6818 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:08.106335  4219 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:08.106750  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.107419  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.111375  4409 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:08.113109  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.114730  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.094069  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.114672  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.149345  4247 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:08.150189  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.114945  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.082401  6913 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:21:08.119414  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.108837  6908 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.123548  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:08.111624  6844 consensus_meta.cc:287] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.003s
I20260709 12:21:08.152036  4409 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:08.127135  6905 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.057380  6745 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.132108  6507 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.133136  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.101766  6630 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.140792  6843 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.144889  6694 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.146689  6871 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:08.152652  6907 raft_consensus.cc:2764] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:08.124192  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:08.108973  6553 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:08.153393  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.128227  6914 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.153474  6910 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:08.153528  6870 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.165443  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1555) took 1185 ms. Trace:
I20260709 12:21:08.168522  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.223712  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.284515  4405 rpcz_store.cc:276] 0709 12:21:06.980060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.986418 (+  6358us) service_pool.cc:224] Handling call
0709 12:21:08.165188 (+1178770us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54002350d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:08.165353 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739785472}
W20260709 12:21:08.255246  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 131126us
I20260709 12:21:08.148334  6841 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.255606  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.162631  6920 consensus_queue.cc:1059] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:08.263954  4408 raft_consensus.cc:2376] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 2. Re-sending same reply.
I20260709 12:21:08.169662  6905 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:08.290936  6905 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.291730  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:08.285651  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.293691  4403 raft_consensus.cc:2368] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9.
I20260709 12:21:08.284548  6870 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.285976  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.288816  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:08.289395  4407 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.305474  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:08.269156  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 158255us
I20260709 12:21:08.308670  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:08.317440  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:08.318250  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.282913  6732 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:08.280849  6914 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.283582  6910 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:08.328480  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.346582  4401 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:08.358042  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:08.358767  4987 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.359869  4252 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:21:08.360338  4252 pending_rounds.cc:85] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 4
I20260709 12:21:08.360548  4252 pending_rounds.cc:107] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:21:08.362480  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.349054  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:08.327263  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.350896  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.355394  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:08.220288  6844 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.364171  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.364377  4334 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:08.365130  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:08.360859  4252 raft_consensus.cc:2889] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:08.376077  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.314179  6858 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:08.314437  6871 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:08.255483  6630 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.324326  6818 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:08.390475  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:08.390663  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 306326us
I20260709 12:21:08.344744  6772 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:08.345417  6732 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:08.469756  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 114487us
I20260709 12:21:08.366309  6863 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:08.356771  6917 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.492478  6917 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.357026  6914 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.378867  6563 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.499737  6563 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.501655  6924 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:08.502401  6563 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:08.502329  6924 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:08.504850  6924 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:08.411134  4257 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:08.391811  6841 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.395742  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:08.506098  6839 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.507705  4988 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:08.426965  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 320673us
W20260709 12:21:08.450991  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 142406us
I20260709 12:21:08.451721  4409 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:08.512336  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.410723  6925 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:08.517560  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:08.454321  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.459764  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.463374  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:08.463529  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 114562us
I20260709 12:21:08.480172  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.483690  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.521835  4955 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:08.490825  6892 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.830s	user 0.003s	sys 0.000s
W20260709 12:21:08.491849  6922 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:21:08.504379  6772 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.410495  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:08.549577  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 86276.1us
I20260709 12:21:08.511379  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:08.463186  6871 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:08.521095  4334 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.527124  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:08.528882  4400 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:08.475994  6732 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:08.453894  6920 consensus_queue.cc:1243] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:08.414350  4247 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:08.537465  4250 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:21:08.568061  4250 pending_rounds.cc:85] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 5
I20260709 12:21:08.568401  4250 pending_rounds.cc:107] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:08.568748  4250 raft_consensus.cc:2889] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:08.538455  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.571321  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.572497  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:08.573529  4405 raft_consensus.cc:2368] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:08.564352  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:08.576583  4329 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.546887  4987 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:08.540833  4408 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:08.469233  6852 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:08.556236  4325 raft_consensus.cc:2410] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:21:08.527812  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 147239us
I20260709 12:21:08.520797  6925 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:08.579840  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.552800  6917 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:08.548978  6924 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:08.634248  4409 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 2.
I20260709 12:21:08.435065  6910 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.477627  6818 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.555540  6871 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:08.653970  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:08.657127  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 185729us
I20260709 12:21:08.677397  4408 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:21:08.658234  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:08.656162  6856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.006s	sys 0.038s
I20260709 12:21:08.632385  6507 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.685279  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:08.698886  4400 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:08.698103  4325 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:08.551440  6932 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:08.632719  6925 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:08.705116  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.523573  6863 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.707341  4401 raft_consensus.cc:2393] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:08.654613  6920 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.657126  6850 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:08.710201  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:08.658303  6924 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:08.657903  6852 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:08.672823  6933 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:08.734212  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 163648us
I20260709 12:21:08.751412  4325 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:08.754920  4407 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 3.
I20260709 12:21:08.678020  6917 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:21:08.757537  4325 pending_rounds.cc:85] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 8
I20260709 12:21:08.711848  6932 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:08.762774  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52663.6us
I20260709 12:21:08.728106  6694 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:08.776074  4325 pending_rounds.cc:107] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:21:08.775475  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:08.773475  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:08.776436  4325 raft_consensus.cc:2889] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:08.739830  6924 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:08.785444  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 274142us
I20260709 12:21:08.786552  4330 raft_consensus.cc:2410] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:08.787842  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:08.788628  4325 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 2.
I20260709 12:21:08.770742  6936 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.791944  4218 leader_election.cc:400] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4.
I20260709 12:21:08.795035  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:08.797706  4218 leader_election.cc:403] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:08.798514  4325 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:08.784788  6855 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:08.798936  4372 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:08.805634  4325 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:08.739881  6920 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.771040  6507 consensus_queue.cc:1059] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:21:08.767513  6933 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:08.786548  6910 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:08.804240  6936 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.801357  6694 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:08.806645  6855 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:08.816601  4325 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:08.822597  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 282632us
I20260709 12:21:08.805136  6850 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:08.828234  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.817858  6630 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.882290  4325 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 12:21:08.886597  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61307.8us
I20260709 12:21:08.820780  6844 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:08.895978  4325 pending_rounds.cc:85] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:08.896638  4325 pending_rounds.cc:107] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:08.897490  4325 raft_consensus.cc:2889] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:08.880736  6923 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:21:08.820276  6941 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:21:08.901450  4992 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:08.905377  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 75629.4us
I20260709 12:21:08.902985  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:08.906817  4984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 641) took 1880 ms (client timeout 2288 ms). Trace:
W20260709 12:21:08.907250  4984 rpcz_store.cc:269] 0709 12:21:07.020441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.020570 (+   129us) service_pool.cc:224] Handling call
0709 12:21:08.900944 (+1880374us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400474854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:08.901094 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473416960}
I20260709 12:21:08.909018  4325 raft_consensus.cc:1240] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:08.896307  6917 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:21:08.933898  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 412126us
I20260709 12:21:08.937279  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:08.819762  6852 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.888753  6850 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.922487  6917 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:08.957321  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 167035us
W20260709 12:21:08.968364  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 176617us
I20260709 12:21:08.969632  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:08.944706  6921 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:21:08.972782  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:08.961725  6862 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:21:08.904562  6855 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:08.943861  6818 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:08.933156  6948 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:08.976052  4326 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:21:08.993518  4326 pending_rounds.cc:85] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 3
I20260709 12:21:08.993805  4326 pending_rounds.cc:107] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:21:08.994061  4326 raft_consensus.cc:2889] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:08.974782  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:08.990698  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 160612us
I20260709 12:21:08.948769  6944 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:08.965507  6917 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:08.998236  6870 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:08.946898  6942 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.001433  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 640) took 1982 ms. Trace:
I20260709 12:21:09.003700  4989 rpcz_store.cc:276] 0709 12:21:07.018843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.019008 (+   165us) service_pool.cc:224] Handling call
0709 12:21:09.001191 (+1982183us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54005a19d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:09.001361 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172857600}
I20260709 12:21:08.951023  6863 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:08.999002  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:08.971431  6933 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:08.971886  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.014204  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:09.072224  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 69438.7us
I20260709 12:21:08.895031  6932 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.093079  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:08.964445  6873 consensus_queue.cc:1059] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:09.074743  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.072333  6951 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:09.147939  6873 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:09.148489  6873 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:09.075857  4957 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.010s	sys 0.038s
W20260709 12:21:09.149159  4957 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.041s
I20260709 12:21:09.074478  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:09.149614  6873 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:09.152040  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 137909us
I20260709 12:21:09.005038  6948 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:09.098219  6929 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.263s	user 0.000s	sys 0.003s
W20260709 12:21:09.131867  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.097373  6881 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260709 12:21:09.103586  6943 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 12:21:09.108031  6939 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:21:09.141956  4256 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:09.147096  6601 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:09.148070  6951 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:09.095834  6931 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
W20260709 12:21:09.160408  4334 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 12:21:09.162006  4329 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
W20260709 12:21:09.179998  4955 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 2.291s (SENT) [suppressed 35 similar messages]
I20260709 12:21:09.184783  4334 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:09.170368  6953 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.170629  6870 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:09.071913  6844 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:09.180658  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 282428us
I20260709 12:21:09.181849  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 553) took 1166 ms. Trace:
I20260709 12:21:09.132861  6933 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:09.078536  6944 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:09.173501  6694 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:09.169487  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 94833.7us
I20260709 12:21:09.198562  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:09.199712  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.154350  6941 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.151222  6873 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:09.193954  4256 rpcz_store.cc:276] 0709 12:21:08.015798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.092697 (+1076899us) service_pool.cc:224] Handling call
0709 12:21:09.181775 (+ 89078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:09.163944  6948 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.204200  6870 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.218197  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.218855  4984 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:09.188645  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 655) took 2002 ms. Trace:
I20260709 12:21:09.240849  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.243944  6933 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:21:09.221947  6944 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.250710  6958 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:09.252689  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1716) took 2157 ms. Trace:
I20260709 12:21:09.244166  4991 rpcz_store.cc:276] 0709 12:21:07.181850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.944087 (+1762237us) service_pool.cc:224] Handling call
0709 12:21:09.184007 (+239920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:09.253893  6936 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.253108  4248 rpcz_store.cc:276] 0709 12:21:07.095106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.095325 (+   219us) service_pool.cc:224] Handling call
0709 12:21:07.170199 (+ 74874us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:07.206379 (+ 36180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.206430 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:08.167272 (+960842us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b2c00028038. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbaf677a11 00007fdbaf687372 00007fdbb0db9a01 00007fdbb0d7e43a 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2
0709 12:21:08.168005 (+   733us) log.cc:844] Serialized 52 byte log entry
0709 12:21:08.426673 (+258668us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:08.553976 (+127303us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.911343 (+357367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.911565 (+   222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.252343 (+340778us) raft_consensus.cc:1685] finished
0709 12:21:09.252452 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.252590 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14420,"prepare.queue_time_us":285499,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":390808,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":52664,"spinlock_wait_cycles":146764160,"thread_start_us":720011,"threads_started":3,"wal-append.queue_time_us":307425}
W20260709 12:21:09.267725  6935 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.438s	user 0.002s	sys 0.000s
I20260709 12:21:09.269474  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2324) took 1164 ms. Trace:
W20260709 12:21:09.269915  6925 consensus_meta.cc:287] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 12:21:09.270650  6925 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:09.271944  6914 consensus_meta.cc:287] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.000s
I20260709 12:21:09.272369  6914 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:09.272882  6839 consensus_meta.cc:287] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.000s
I20260709 12:21:09.273288  6839 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.273676  4406 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:09.275617  6925 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:09.278307  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 47523.8us
W20260709 12:21:09.226593  6927 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.548s	user 0.000s	sys 0.005s
I20260709 12:21:09.265230  6841 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.281641  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.282353  4986 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:09.287398  6630 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:09.207969  6945 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:09.279076  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:09.291337  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67691.8us
I20260709 12:21:09.297266  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.225924  6870 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.208627  6920 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.269845  4402 rpcz_store.cc:276] 0709 12:21:08.105559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.105696 (+   137us) service_pool.cc:224] Handling call
0709 12:21:08.115544 (+  9848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:08.309492 (+193948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:08.309538 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:08.315786 (+  6248us) log.cc:844] Serialized 26 byte log entry
0709 12:21:08.652939 (+337153us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:08.808462 (+155523us) log.cc:844] Serialized 14 byte log entry
0709 12:21:08.824554 (+ 16092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:08.824628 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:09.264137 (+439509us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:09.269214 (+  5077us) raft_consensus.cc:1685] finished
0709 12:21:09.269296 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:09.269417 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41507,"prepare.queue_time_us":253376,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":10527,"raft.queue_time_us":191610,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":206,"spinlock_wait_cycles":124936576,"thread_start_us":402268,"threads_started":2,"wal-append.queue_time_us":454043}
I20260709 12:21:09.241477  6881 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.205336  6694 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:09.250121  6944 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.306365  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.241580  6850 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.296545  6945 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.311911  6841 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.291059  6958 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.312860  6951 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:09.298215  6908 consensus_meta.cc:287] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.056s	user 0.012s	sys 0.000s
I20260709 12:21:09.311550  4984 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:09.321213  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.314949  6694 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.313800  6881 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:09.335239  6955 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:21:09.317401  6958 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:09.338716  6871 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.000s
I20260709 12:21:09.339198  6954 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:09.316740  6945 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:09.353613  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:09.346871  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 166881us
I20260709 12:21:09.351259  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.355834  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.356186  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:09.357887  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:09.359555  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.359619  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:09.361801  4955 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.364202  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:09.363575  4327 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:21:09.365091  4327 pending_rounds.cc:85] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 3
I20260709 12:21:09.365326  4327 pending_rounds.cc:107] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:21:09.365558  4327 raft_consensus.cc:2889] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.326490  6844 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.369352  4296 leader_election.cc:400] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:21:09.369787  4296 leader_election.cc:403] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.347921  6920 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.376827  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:09.348389  6960 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:09.274449  6914 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.379726  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:09.363340  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.638s	user 0.015s	sys 0.017s
W20260709 12:21:09.375344  6905 consensus_meta.cc:287] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.079s	user 0.007s	sys 0.006s
I20260709 12:21:09.364477  6951 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.375423  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.318439  6908 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.364589  6850 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.367367  6954 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.397081  6954 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.398605  6908 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.399386  4328 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:09.400475  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.401710  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:09.402210  4329 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.403443  6920 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:09.403710  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.370572  6944 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:09.404493  6944 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:09.404884  6944 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.405784  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.406564  4332 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
W20260709 12:21:09.396220  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:09.391203  6732 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 12:21:09.408520  6732 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.414065  4219 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:09.391338  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 241364us
I20260709 12:21:09.415958  4329 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
W20260709 12:21:09.388221  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.676s	user 0.015s	sys 0.017s
I20260709 12:21:09.424057  4219 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.432893  6920 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:09.433459  6920 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:09.434538  6920 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.384793  6925 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.375613  6948 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.436518  6950 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.437577  6948 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.393702  6960 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.353411  6871 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.384629  6844 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5.
I20260709 12:21:09.439810  6844 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.440002  6960 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.430840  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.441756  4990 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:21:09.371461  6947 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:21:09.444689  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 69326.4us
I20260709 12:21:09.394466  6905 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.452241  6934 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:21:09.453208  6921 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4.
I20260709 12:21:09.416996  6908 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.461760  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.454161  6905 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:09.458415  6963 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:21:09.458495  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:09.462767  6921 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.431095  4991 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:09.428442  6772 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:09.464255  6772 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.464639  6772 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.416687  6964 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.467686  6964 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.438831  6954 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.486606  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:09.454219  6871 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:09.475435  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 44694.6us
I20260709 12:21:09.504396  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:09.505658  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 311883us
W20260709 12:21:09.474736  6924 consensus_meta.cc:287] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 12:21:09.509433  6948 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.499678  6908 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.520237  6870 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.520766  6870 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.521435  6908 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.449504  6881 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.522764  6870 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:09.522822  6881 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.526496  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.447126  6910 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:21:09.475553  6732 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.513758  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.475675  6840 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:09.474614  6772 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.512853  6969 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:21:09.488307  6964 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:09.533881  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:09.540736  6954 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.511947  6921 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.542348  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:09.529835  6908 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.546476  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.560521  4329 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:09.543895  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:09.547771  6919 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 1.438s	user 0.007s	sys 0.000s
I20260709 12:21:09.548003  6970 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:09.512964  6972 consensus_queue.cc:1059] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:21:09.513692  6960 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:21:09.552439  6917 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:09.553609  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:09.553978  6968 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:09.554774  6841 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.532398  6947 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:09.580128  6772 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.547837  6868 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:09.581478  4334 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:09.583725  6972 raft_consensus.cc:3055] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.584260  6972 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:09.585354  6972 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.587527  6868 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:09.587781  6970 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:09.528083  6924 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.567998  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:09.567957  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.532891  6958 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.573187  6921 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.587087  6972 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:09.579532  6918 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 1.395s	user 0.004s	sys 0.014s
I20260709 12:21:09.556229  6945 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.564340  6840 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.576303  4218 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:09.602627  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.588793  6868 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.566496  6908 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.594386  6601 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:09.603596  6840 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:09.589079  6970 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.609354  6947 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:09.622073  6745 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.611878  6601 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:09.628959  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52732.2us
I20260709 12:21:09.630092  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.634126  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:09.635994  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 256525us
I20260709 12:21:09.636819  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.638949  6926 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:09.639529  6926 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:09.640427  6908 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.641002  6908 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.643214  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 891) took 2552 ms. Trace:
I20260709 12:21:09.643777  4992 rpcz_store.cc:276] 0709 12:21:07.090733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.414931 (+324198us) service_pool.cc:224] Handling call
0709 12:21:08.901269 (+1486338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:08.902294 (+  1025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.642941 (+740647us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400474850. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:09.643135 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3417548672}
I20260709 12:21:09.643625  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.649096  4296 leader_election.cc:400] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4.
I20260709 12:21:09.650315  6958 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.650426  6745 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:09.632078  6601 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.660679  6840 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.655856  6958 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.636034  6921 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.642648  6947 raft_consensus.cc:697] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:09.627851  6694 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.651041  6745 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.698040  4326 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:09.705068  6917 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:09.640648  6926 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:09.704640  6944 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.697332  6694 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.707862  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:09.713196  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.706559  6745 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.699098  6908 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.713850  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.717401  4992 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
W20260709 12:21:09.715134  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81259.9us
I20260709 12:21:09.719708  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.720396  4992 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:09.721779  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.727648  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.716565  6926 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.714035  6981 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:09.731057  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:09.731758  4254 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.731922  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.732283  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.729377  4992 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:09.732474  4987 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.730127  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.734088  4333 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:09.734761  4250 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:09.735042  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.735711  4248 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:09.720257  6975 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:09.736703  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:09.737340  4257 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:09.737434  4256 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:09.738595  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.740662  4252 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:09.740257  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.741811  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.741904  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.742170  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.743696  4252 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:09.739403  6975 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:09.744509  4985 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:21:09.744694  6975 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.728788  6924 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.745483  6598 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:09.748222  6966 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:09.748414  6598 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:09.720162  6908 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.735626  6981 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.749977  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.750864  4984 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:09.745151  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.752323  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.752586  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:09.752944  4984 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.753574  4985 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:09.745615  6905 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.754930  6940 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:09.755425  6940 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:09.748917  6598 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:09.765056  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:09.763571  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.766289  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:09.766935  4325 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:09.768164  4331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 603) took 2200 ms (client timeout 2038 ms). Trace:
I20260709 12:21:09.751549  6981 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:09.750319  6945 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:09.768608  4331 rpcz_store.cc:269] 0709 12:21:07.564128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.574494 (+ 10366us) service_pool.cc:224] Handling call
0709 12:21:09.762455 (+2187961us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5400330ca0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cf5dc0 00007fdbb0d81e18 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:09.764728 (+  2273us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400166f54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:09.764821 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2648895616}
I20260709 12:21:09.769644  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.741011  6947 consensus_queue.cc:237] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.773018  4252 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:09.774917  4992 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:09.775283  4987 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:09.778439  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:09.784345  4218 leader_election.cc:336] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.532s (SENT)
I20260709 12:21:09.784714  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.786414  4331 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:09.781983  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.787088  4984 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:09.789999  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:09.790781  4252 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:09.791647  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.792961  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:09.794720  4333 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:09.791654  6694 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:09.785739  6905 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:21:09.793967  6907 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:21:09.785610  6855 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:09.795300  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:09.800352  6908 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:09.803436  6844 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.803987  6917 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:09.796855  6841 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:21:09.804927  6917 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.795732  6694 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:09.805982  6694 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:09.804968  6907 consensus_queue.cc:1243] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:09.808887  4257 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:09.809242  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:09.805349  6917 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:09.804971  6783 consensus_queue.cc:1059] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:09.814467  4254 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:09.785912  6945 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:09.832262  6983 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:09.757503  6940 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.833667  6940 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:09.785831  6924 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:21:09.844429  6601 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.845975  6981 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.846936  6601 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:09.852144  6981 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:09.853597  6905 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:09.881476  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.855523  6908 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:09.864825  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 893) took 2758 ms. Trace:
I20260709 12:21:09.816897  6844 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:09.874656  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.886445  4984 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:09.880318  4252 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:09.841295  6944 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:09.854820  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45663.5us
I20260709 12:21:09.882345  4985 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
W20260709 12:21:09.880414  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 82921.8us
I20260709 12:21:09.886246  4331 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:09.868537  6948 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:09.912177  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:09.912012  4218 connection.cc:256] RPC call timeout handler was delayed by -1.2461034510001809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.401s for a response
I20260709 12:21:09.912902  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.914813  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:09.917827  4984 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:09.919224  6932 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:09.919858  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:09.920363  6932 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:09.920786  6932 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:09.921739  6932 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:09.923452  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.921751  6981 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:09.924417  6981 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:09.924669  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.924855  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:09.925170  4252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:09.925568  4257 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:09.925725  4986 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:09.925758  4252 raft_consensus.cc:606] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.926553  4252 raft_consensus.cc:614] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:09.929803  4985 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:21:09.881922  6905 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:09.934100  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.932442  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:09.949040  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.937525  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:09.883816  6908 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:09.985087  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:09.986725  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 54414.4us
I20260709 12:21:09.987823  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.986742  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:09.923194  6932 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:09.992369  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 48924.8us
I20260709 12:21:09.924898  6981 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.994725  4250 pending_rounds.cc:85] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 5
I20260709 12:21:09.881628  6907 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:21:09.996138  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:09.999904  4250 pending_rounds.cc:107] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:10.000285  4250 raft_consensus.cc:2889] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.998164  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.005026  4257 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:10.006044  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:09.997578  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.008788  4255 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.935164  6844 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:10.017910  4252 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:09.992101  6908 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:10.019237  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:10.024725  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.007421  6871 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:10.039714  4257 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:10.043473  6905 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:09.941344  6924 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:21:10.046926  6924 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:10.014753  6553 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:09.992394  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.016712  6844 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:10.054104  6844 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.020195  6944 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:21:10.063195  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:10.064060  4326 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:10.064795  4247 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:10.065085  4326 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.067597  6945 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:10.068248  4253 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:10.067472  4988 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:10.070457  4984 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:10.070719  4988 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:21:09.886262  4983 rpcz_store.cc:276] 0709 12:21:07.106614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.575378 (+468764us) service_pool.cc:224] Handling call
0709 12:21:07.971093 (+395715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:07.971741 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:09.864496 (+1892755us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540071e8d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:09.864727 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909379328}
I20260709 12:21:09.998955  6951 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.072119  6951 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.074232  6951 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:09.885757  6917 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:10.076593  4256 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:10.088204  4325 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:10.091830  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.092640  4256 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
W20260709 12:21:10.076256  6881 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 12:21:10.097537  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:10.033681  4254 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:10.098464  4331 raft_consensus.cc:2410] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:10.095500  4219 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.088598  6917 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.075346  6873 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:10.103715  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.107964  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.111770  4256 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:10.108732  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.108992  4255 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:10.097246  6951 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.117800  4254 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.102574  6966 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:10.123690  4255 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:21:10.126088  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 204622us
I20260709 12:21:10.127307  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.090232  6694 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.128813  4253 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:10.110992  6932 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.133759  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.097607  6598 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.134487  4252 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.137456  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.138103  4257 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:10.128360  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:10.142760  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.143203  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:10.144021  4256 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:10.145874  6993 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:10.146308  6993 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.146559  6598 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:10.146642  6993 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.151777  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.157155  4252 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:10.157593  4254 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:10.169032  4253 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:10.170974  4256 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:10.138243  6932 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:10.122197  6951 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.142298  6966 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:10.176694  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.177546  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.179705  4255 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:10.181187  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:10.189148  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46013.8us
I20260709 12:21:10.193477  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.201687  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.203147  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.177735  6992 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:10.182767  6966 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.234285  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.235275  4256 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:10.240106  6553 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:10.242388  6855 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:10.245203  6975 consensus_meta.cc:287] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 12:21:10.245649  6975 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:10.247404  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.256824  4326 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:10.270175  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 68564.9us
I20260709 12:21:10.271826  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.274971  4984 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:21:10.275259  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.213973  6966 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.195448  6844 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:10.278561  4296 leader_election.cc:336] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.823s (SENT)
I20260709 12:21:10.279208  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:10.281250  4257 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:10.281937  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.282058  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.286288  6855 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:10.283243  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.290395  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:10.291011  4984 raft_consensus.cc:1813] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:10.291510  4984 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:10.290503  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.292707  4253 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:10.294849  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:10.297955  6948 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:10.299490  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.300181  6981 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:10.302244  6981 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:10.303643  6951 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:10.304631  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:10.310895  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.289076  7001 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.306443  6769 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:10.319983  4330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1956) took 1606 ms (client timeout 1866 ms). Trace:
W20260709 12:21:10.322741  4330 rpcz_store.cc:269] 0709 12:21:08.713402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.754150 (+ 40748us) service_pool.cc:224] Handling call
0709 12:21:10.311339 (+1557189us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b54002030d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:10.319902 (+  8563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21050624}
I20260709 12:21:10.326956  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.318360  6958 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:10.331568  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.332677  6945 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:21:10.335975  6945 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:10.336354  6945 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:10.337157  6945 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.338352  6945 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.340150  4983 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:10.330436  6769 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.347669  6769 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.353736  6844 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:10.277109  6932 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:10.317018  7006 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:10.319653  6694 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:10.287281  6855 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:10.413722  4325 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:10.355731  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:10.411666  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 898391us
I20260709 12:21:10.483500  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:10.330526  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.355546  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:10.424623  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:10.420703  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.485033  4331 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 3: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:10.484810  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 132950us
I20260709 12:21:10.414408  4330 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.484840  4403 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.356144  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:10.420717  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 906) took 2106 ms. Trace:
I20260709 12:21:10.487030  4408 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:10.459533  4401 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.424243  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2323) took 2319 ms. Trace:
I20260709 12:21:10.414856  4329 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
W20260709 12:21:10.423666  4407 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1561) took 2070 ms (client timeout 1823 ms). Trace:
I20260709 12:21:10.486949  4990 rpcz_store.cc:276] 0709 12:21:08.314626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.314779 (+   153us) service_pool.cc:224] Handling call
0709 12:21:08.361499 (+ 46720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:09.442284 (+1080785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.420339 (+978055us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54006aefd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:10.420639 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483628928}
W20260709 12:21:10.489145  4407 rpcz_store.cc:269] 0709 12:21:08.353704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.459414 (+105710us) service_pool.cc:224] Handling call
0709 12:21:10.423467 (+1964053us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400286754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:10.423565 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536611584}
I20260709 12:21:10.483902  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:10.491556  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:10.491719  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:10.488202  4406 rpcz_store.cc:276] 0709 12:21:08.105223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.105348 (+   125us) service_pool.cc:224] Handling call
0709 12:21:10.423988 (+2318640us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400277754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:10.424144 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662888064}
I20260709 12:21:10.379200  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:10.494212  6951 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:10.331840  7001 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:10.496919  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 166459us
I20260709 12:21:10.331441  6926 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:10.395587  6745 consensus_meta.cc:287] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.003s
I20260709 12:21:10.503572  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.321589  6975 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:10.503909  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:10.404387  6905 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.502954  6958 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:10.508817  6861 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:10.496145  6934 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:21:10.512390  6881 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:10.496294  6940 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:10.513281  6873 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:21:10.498106  6944 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:10.516990  4325 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.525894  6858 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:10.397156  6908 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.416875  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:10.347198  6993 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.521270  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:10.378824  6977 log.cc:927] Time spent T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:21:10.540582  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:10.548609  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.496531  6553 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:21:10.578521  4986 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:10.579205  6553 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:10.579595  6553 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:10.580776  6553 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.577410  4331 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:10.584754  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63613.1us
I20260709 12:21:10.585577  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.539041  6944 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.592252  6553 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.554509  6858 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:10.592788  6769 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.593544  6858 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.595402  6871 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:10.574868  6839 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:10.595825  6871 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:10.596091  6839 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:10.596352  6871 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.596645  6993 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:10.597081  6839 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.598359  7001 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.595206  6769 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:10.602358  4325 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:10.518451  6745 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:10.553843  6940 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:10.606794  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 328243us
W20260709 12:21:10.604257  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 109061us
I20260709 12:21:10.571869  6992 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:10.584040  6959 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:10.611677  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:10.609810  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 101482us
I20260709 12:21:10.602224  6944 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:10.624533  4255 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.626238  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.631189  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.634923  4402 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.636018  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.605993  6873 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:10.659808  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.661972  4990 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:10.668489  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:10.690194  4990 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:10.630571  6932 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:10.637595  7005 consensus_queue.cc:1059] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:21:10.706158  7005 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:10.706614  7005 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:10.675837  6873 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:10.708582  6873 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:10.709738  7010 log.cc:927] Time spent T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:21:10.659538  6958 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:10.711402  6958 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.713889  6745 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:10.676283  6868 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.716495  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.719173  4990 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.720710  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:10.721485  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.721561  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.725693  4255 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:10.723263  4256 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:10.714815  6868 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:10.738694  4990 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:10.739770  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:10.748051  7014 log.cc:927] Time spent T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:10.620172  6966 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:10.754109  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.734388  6992 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.758445  4333 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:10.734831  7016 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.707669  7005 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.755762  7021 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:10.760809  4328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 614) took 2759 ms (client timeout 1557 ms). Trace:
I20260709 12:21:10.633327  6959 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:10.777302  4328 rpcz_store.cc:269] 0709 12:21:08.001557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.001687 (+   130us) service_pool.cc:224] Handling call
0709 12:21:10.760604 (+2758917us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540013cc54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:10.760744 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3204758400}
I20260709 12:21:10.751688  6972 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:21:10.742517  7020 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:10.767885  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.748605  6838 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:10.738448  6970 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.721580  6940 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.771072  4992 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:10.791742  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:10.771627  7008 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.773259  4249 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:21:10.773661  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.793973  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:10.795665  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 210180us
I20260709 12:21:10.795818  4249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1748) took 1064 ms. Trace:
I20260709 12:21:10.796268  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.796509  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.761006  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:10.774152  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:10.775149  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.762105  6713 raft_consensus.cc:3055] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:10.782501  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 61884.8us
W20260709 12:21:10.783852  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.835873  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:10.837391  4990 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:10.787669  6932 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:10.786844  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:10.794220  6970 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:10.796271  4249 rpcz_store.cc:276] 0709 12:21:09.731835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.731947 (+   112us) service_pool.cc:224] Handling call
0709 12:21:10.772789 (+1040842us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:10.773019 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.795552 (+ 22533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.795753 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765056}
W20260709 12:21:10.814630  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.818887  6868 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:10.819489  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.840075  4256 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.823391  7008 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:10.824455  7009 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:10.825201  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:10.795926  7005 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.825582  6871 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.797231  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.781854  7016 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.826164  4403 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:10.830891  4331 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:10.858116  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:10.858814  4331 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:10.825362  6959 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:10.842011  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 97526.7us
I20260709 12:21:10.866779  4249 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.837529  7001 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:10.786207  6951 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:10.843741  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47310.5us
I20260709 12:21:10.849815  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.888167  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:10.850983  4987 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:10.852151  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 78076.5us
W20260709 12:21:10.854070  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 56918.4us
I20260709 12:21:10.849885  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:10.891232  4328 raft_consensus.cc:2410] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:21:10.842676  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:10.834717  6713 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:10.868003  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:10.905426  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:10.871318  7024 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.856330  6873 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:10.871855  6912 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:10.872646  6838 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:10.873533  6972 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:10.874277  7013 log.cc:927] Time spent T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:10.851642  7026 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:10.879624  7011 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:21:10.879809  4988 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:10.865571  6844 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:10.880434  6932 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.921171  6858 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.882454  6970 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:10.886981  6994 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.678s	user 0.001s	sys 0.000s
I20260709 12:21:10.888403  4257 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:10.778251  6908 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:10.897053  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.887620  6955 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:10.909323  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:10.911682  4987 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:10.909998  6936 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:10.910177  6951 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.916869  6713 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.917631  6944 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:10.919010  4331 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:10.923432  4328 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:10.865414  6761 raft_consensus.cc:2764] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:21:11.009171  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.920974  6981 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
W20260709 12:21:11.150104  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 243602us
W20260709 12:21:11.152390  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 264323us
I20260709 12:21:11.152899  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:11.153395  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:11.154621  4956 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:11.154752  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:11.158179  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.160712  4985 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:11.162259  4985 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.192864  4987 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:21:11.202072  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.228232  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 75402us
I20260709 12:21:11.228849  6845 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:11.229048  6905 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.229364  6845 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.229876  6845 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:11.229645  6905 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.230741  6907 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.231247  6907 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.231952  6905 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.233263  6907 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.229234  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:10.971944  7001 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:10.971915  7024 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:11.235740  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 81058.9us
I20260709 12:21:11.235404  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:11.144513  4359 heartbeater.cc:646] Failed to heartbeat to 127.3.7.190:34185 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.7.190:34185 timed out after 15.000s (SENT)
I20260709 12:21:11.120486  7016 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.289227  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:11.288167  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.254665  4990 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:11.286749  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:11.294399  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.294735  4989 raft_consensus.cc:2368] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7.
I20260709 12:21:11.296195  4403 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:11.295189  4256 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:11.286875  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.032603  6844 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:10.910287  6911 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:11.320240  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.033123  6858 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:11.095739  6904 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:11.311874  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.323637  4400 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: [3.4-5.5]
I20260709 12:21:11.312875  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:11.324090  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:11.236747  6873 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:11.324256  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:11.328006  4257 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:11.235600  7008 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:11.314982  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.253203  6910 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:11.252498  6843 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:11.286455  6912 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.318806  6997 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:11.252655  6855 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.287482  6553 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:11.251600  6907 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:11.335408  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.333441  4402 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:21:11.355315  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:11.339627  4404 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:11.312969  6868 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:11.340634  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:11.252327  6905 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:21:11.311790  6713 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:11.316699  6871 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:11.341809  4407 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:11.341753  6843 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.326429  6904 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:11.343077  4400 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:11.344357  6951 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:11.345790  7001 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.234601  6970 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:21:11.235392  6992 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:21:11.348017  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.152650  6936 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:11.349853  4403 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:11.237417  6972 consensus_queue.cc:1059] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:21:11.356110  4331 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:21:11.358152  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:11.362934  4407 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:11.404071  4256 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:11.374202  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:11.405341  4402 raft_consensus.cc:606] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:11.405774  4402 raft_consensus.cc:614] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:11.346902  6858 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.350265  6873 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:11.366719  4988 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:21:11.410096  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.407158  4257 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:21:11.409861  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 912) took 2259 ms. Trace:
I20260709 12:21:11.419869  4331 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:11.419113  4991 rpcz_store.cc:276] 0709 12:21:09.150513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.253845 (+103332us) service_pool.cc:224] Handling call
0709 12:21:09.254155 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.463657 (+209502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.374872 (+1911215us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400512a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:11.409796 (+ 34924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359412608}
I20260709 12:21:11.421244  4331 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:11.423206  7037 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:11.424052  6992 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:11.424472  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1756) took 1143 ms. Trace:
I20260709 12:21:11.424662  6992 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.424854  4252 rpcz_store.cc:276] 0709 12:21:10.281503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.284385 (+  2882us) service_pool.cc:224] Handling call
0709 12:21:10.284721 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.294307 (+  9586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.294337 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.881002 (+586665us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b2c00028038. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbaf677a11 00007fdbaf687372 00007fdbb0db9a01 00007fdbb0d7e43a 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2
0709 12:21:10.881395 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 12:21:11.152110 (+270715us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:11.152146 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.152227 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.424170 (+271943us) raft_consensus.cc:1685] finished
0709 12:21:11.424200 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.424417 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3051,"raft.queue_time_us":12680,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":94,"spinlock_wait_cycles":25987968,"thread_start_us":270336,"threads_started":1,"wal-append.queue_time_us":436990}
I20260709 12:21:11.426818  4252 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:11.427083  6992 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.429036  6992 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.429572  6992 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.401926  6908 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:11.431635  6908 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:11.433166  6843 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:11.433924  6973 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 1.947s	user 0.009s	sys 0.004s
I20260709 12:21:11.434333  6944 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:11.358093  6855 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.437000  6855 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.412802  7024 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.447013  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1944) took 3128 ms. Trace:
I20260709 12:21:11.447665  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.449051  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.450228  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.451453  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.451642  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.452708  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.454074  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.455497  6844 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.458804  4329 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.458904  6904 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.459969  6904 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.460137  4329 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:11.402359  6871 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:11.461395  6871 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.461740  6871 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:11.462184  4329 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:11.463796  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 620) took 1607 ms. Trace:
I20260709 12:21:11.464154  4326 rpcz_store.cc:276] 0709 12:21:09.864890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.065794 (+200904us) service_pool.cc:224] Handling call
0709 12:21:10.066022 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.257394 (+191372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.463594 (+1206200us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540017be54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:11.463742 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430705024}
I20260709 12:21:11.465624  4326 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:11.409657  4405 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:11.455945  4247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1744) took 1732 ms (client timeout 1836 ms). Trace:
I20260709 12:21:11.404327  4407 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:11.447425  4327 rpcz_store.cc:276] 0709 12:21:08.319128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.319282 (+   154us) service_pool.cc:224] Handling call
0709 12:21:08.377704 (+ 58422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:09.372380 (+994676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.446786 (+2074406us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540013db54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:11.446945 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227991296}
I20260709 12:21:11.482563  4256 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:11.375571  6907 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:11.494676  4257 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:11.495350  4407 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:11.367919  6868 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:11.525753  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:11.483470  4247 rpcz_store.cc:269] 0709 12:21:09.723074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.727123 (+  4049us) service_pool.cc:224] Handling call
0709 12:21:11.455765 (+1728642us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400121454. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:11.455863 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717660032}
I20260709 12:21:11.354058  6912 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.354938  6910 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.529722  4402 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:11.533200  6912 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.535578  6873 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.539007  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.537949  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:11.540891  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.541400  4256 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:11.541450  4402 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:11.543011  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 388435us
I20260709 12:21:11.543965  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:11.545312  4407 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:11.548594  4252 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:11.552343  4403 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:11.376184  6951 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:11.357659  7026 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:11.536706  6845 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.577608  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.542114  6992 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.551719  6553 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:11.553682  6944 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:11.606417  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.584793  7026 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:11.641680  4328 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:11.646255  4253 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:11.596632  6951 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.652503  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1969) took 1240 ms. Trace:
I20260709 12:21:11.699756  4333 rpcz_store.cc:276] 0709 12:21:10.411727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.413873 (+  2146us) service_pool.cc:224] Handling call
0709 12:21:10.414179 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.758931 (+344752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.652157 (+893226us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400265cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:11.652426 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791043456}
I20260709 12:21:11.657459  6910 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:11.663576  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.701911  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.671986  4409 raft_consensus.cc:2410] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:11.629943  7021 consensus_meta.cc:287] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
I20260709 12:21:11.615970  6944 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.593065  6907 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.748225  6868 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:11.753743  4405 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:11.713856  7021 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:11.749289  7005 consensus_meta.cc:287] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.895s	user 0.007s	sys 0.004s
I20260709 12:21:11.814459  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:11.814769  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.815135  4402 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:11.815363  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 271494us
I20260709 12:21:11.816375  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.817113  4407 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 3: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:11.817893  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.818382  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:11.819775  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:11.820648  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.820638  7005 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.821456  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.858999  4405 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:11.824927  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 538889us
I20260709 12:21:11.860658  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:11.714881  6951 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:11.825649  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 222555us
W20260709 12:21:11.864374  4218 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.800s (SENT)
I20260709 12:21:11.864773  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:11.816524  4326 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:11.827118  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:11.830961  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.831439  6960 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:11.831718  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.831758  6839 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:11.833570  4254 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:11.834348  6944 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:11.834544  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:11.833323  6845 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.840165  6841 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:11.840291  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:11.840737  4331 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:21:11.876382  4331 pending_rounds.cc:85] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:11.876641  4331 pending_rounds.cc:107] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:11.876855  4331 raft_consensus.cc:2889] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:11.842581  7018 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.880236  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:11.881136  4256 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:21:11.843786  6917 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:21:11.822178  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:11.861665  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.867334  4255 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:11.873172  4218 leader_election.cc:336] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.888s (SENT)
W20260709 12:21:11.879086  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.872495  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:11.879398  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:11.874573  4327 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:11.852062  4249 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:11.883601  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 561) took 1949 ms. Trace:
I20260709 12:21:11.858001  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:11.860287  6904 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:11.858490  6928 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:11.886986  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:11.895618  4407 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:11.911422  4218 leader_election.cc:336] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.965s (SENT)
I20260709 12:21:11.911963  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:11.887971  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.896034  4330 raft_consensus.cc:2410] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:11.870750  7042 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.892462  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.888361  4405 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:11.917274  4405 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:21:11.900369  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:11.918623  4255 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:21:11.902504  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:11.903625  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.903764  4254 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:11.869899  7024 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:11.921288  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:11.874572  6948 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.915966  4408 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:11.888156  4250 rpcz_store.cc:276] 0709 12:21:09.934376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.934610 (+   234us) service_pool.cc:224] Handling call
0709 12:21:09.994520 (+ 59910us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:10.078172 (+ 83652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.078219 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:10.078856 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:21:10.269571 (+190715us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:11.536797 (+1267226us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003f75a0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb47763c7 00007fdbb0d889a7 00007fdbb0d980bf
0709 12:21:11.536929 (+   132us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.848726 (+311797us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.857165 (+  8439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.857366 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.883122 (+ 25756us) raft_consensus.cc:1685] finished
0709 12:21:11.883186 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.883480 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567,"prepare.queue_time_us":133750,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":11531,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":10026,"spinlock_wait_cycles":2992512,"thread_start_us":507424,"threads_started":4,"wal-append.queue_time_us":221626,"wal-append.run_cpu_time_us":2375,"wal-append.run_wall_time_us":1082098}
I20260709 12:21:11.825719  6553 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.879972  6841 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:11.935441  4985 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:11.869606  7005 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:11.924701  4407 raft_consensus.cc:606] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:11.935334  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:11.927165  4255 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:11.928113  7042 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.941414  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1758) took 1327 ms. Trace:
I20260709 12:21:11.926611  4256 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:21:11.871284  6868 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:21:11.948284  4255 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:11.941794  4253 rpcz_store.cc:276] 0709 12:21:10.613770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.613924 (+   154us) service_pool.cc:224] Handling call
0709 12:21:10.635419 (+ 21495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.646808 (+1011389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.941218 (+294410us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540001f4d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:11.941364 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324160384}
I20260709 12:21:11.905543  6917 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:11.950845  4405 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:21:11.946650  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:11.884547  6713 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:21:11.922739  7016 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.874775  6960 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:11.927528  6947 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:11.953034  4985 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:11.960435  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49059.1us
W20260709 12:21:11.956126  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 135526us
I20260709 12:21:11.889029  6944 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:21:11.922966  6862 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.945464  6926 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:11.964241  4250 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
W20260709 12:21:11.965865  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 105303us
I20260709 12:21:11.967602  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:11.899904  7040 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:21:11.921187  6904 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:11.889115  7018 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:11.950871  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 684) took 1313 ms. Trace:
I20260709 12:21:11.955113  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:11.915940  6861 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:21:11.939939  6948 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:11.966230  6871 consensus_meta.cc:287] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.002s
I20260709 12:21:11.968421  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:11.932065  6928 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:11.993348  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 920) took 1222 ms. Trace:
I20260709 12:21:11.982777  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:11.995846  4985 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:11.963410  6921 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:21:11.991039  4325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 1976) took 1571 ms (client timeout 1981 ms). Trace:
W20260709 12:21:11.993348  4249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1743) took 1152 ms (client timeout 1530 ms). Trace:
I20260709 12:21:11.951929  6970 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:21:11.999553  6921 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.001600  6921 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.983788  4983 rpcz_store.cc:276] 0709 12:21:10.637040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.639925 (+  2885us) service_pool.cc:224] Handling call
0709 12:21:11.847409 (+1207484us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:11.947892 (+100483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18746624}
I20260709 12:21:12.002558  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:12.002900  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:12.003091  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:11.998906  4249 rpcz_store.cc:269] 0709 12:21:10.841405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.908984 (+ 67579us) service_pool.cc:224] Handling call
0709 12:21:11.993186 (+1084202us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54002b52d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:11.993298 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507091200}
I20260709 12:21:11.952922  7041 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:21:11.992306  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 629) took 1226 ms. Trace:
I20260709 12:21:12.011519  4331 rpcz_store.cc:276] 0709 12:21:10.765811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.422144 (+656333us) service_pool.cc:224] Handling call
0709 12:21:11.422461 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.877237 (+454776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.992058 (+114821us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54002f35d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:11.992250 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961043840}
I20260709 12:21:11.963510  7016 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.013213  6601 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:12.013614  6601 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:12.014423  6601 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.015020  7016 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.015754  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 508) took 3047 ms. Trace:
I20260709 12:21:12.016126  4401 rpcz_store.cc:276] 0709 12:21:08.967946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.968239 (+   293us) service_pool.cc:224] Handling call
0709 12:21:10.432218 (+1463979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:10.488045 (+ 55827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.015544 (+1527499us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400277750. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:12.015673 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3315827584}
I20260709 12:21:12.003759  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:12.018539  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:11.998412  6871 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.021458  6871 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:12.022320  4990 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:21:11.975626  6862 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.023561  6841 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.025030  6862 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:11.985764  6912 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:21:12.025521  6960 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:12.025713  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 62787.8us
I20260709 12:21:11.975667  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:12.026264  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.026578  4988 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:12.027455  6856 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.027853  4988 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:12.027976  6856 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.028908  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.029923  6856 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.030453  6951 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.030975  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 674) took 1396 ms. Trace:
I20260709 12:21:12.031347  4989 rpcz_store.cc:276] 0709 12:21:10.634308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.634449 (+   141us) service_pool.cc:224] Handling call
0709 12:21:12.030774 (+1396325us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54005a19d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:12.030903 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425890176}
I20260709 12:21:12.031807  7042 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.006975  6948 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.007711  4983 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:12.034132  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1978) took 1613 ms. Trace:
I20260709 12:21:11.994288  4984 rpcz_store.cc:276] 0709 12:21:10.770944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.875531 (+104587us) service_pool.cc:224] Handling call
0709 12:21:10.875856 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.876231 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.876259 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:11.152873 (+276614us) log.cc:844] Serialized 26 byte log entry
0709 12:21:11.487824 (+334951us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:11.528389 (+ 40565us) log.cc:844] Serialized 14 byte log entry
0709 12:21:11.528644 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.528735 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.993097 (+464362us) raft_consensus.cc:1685] finished
0709 12:21:11.993126 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.993281 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49315,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":6677,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":9278,"thread_start_us":188006,"threads_started":1,"wal-append.queue_time_us":635985}
I20260709 12:21:11.988613  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:21:11.998754  4325 rpcz_store.cc:269] 0709 12:21:10.419446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.483241 (+ 63795us) service_pool.cc:224] Handling call
0709 12:21:11.990832 (+1507591us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b54002f2bd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:11.990964 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75206016}
I20260709 12:21:12.028324  6844 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:12.035717  4986 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:12.036070  6844 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.007141  6934 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:12.037462  6934 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:12.038221  6844 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.038303  6934 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.039681  6934 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:12.040385  4255 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:12.034507  4328 rpcz_store.cc:276] 0709 12:21:10.420234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.150547 (+730313us) service_pool.cc:224] Handling call
0709 12:21:11.151625 (+  1078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.642284 (+490659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.033906 (+391622us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54002044d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:12.034076 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126526208}
W20260709 12:21:12.046643  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.996956  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:12.049520  4328 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:11.973313  6838 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:11.986434  4991 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:12.066840  6601 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:12.068241  7018 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.068444  7059 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.069005  7059 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.073323  4330 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:12.074913  6966 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.075495  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.076308  6862 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:12.076799  6862 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:12.078068  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.078598  4325 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:12.082396  4326 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:12.052472  4402 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
W20260709 12:21:12.059263  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 114458us
I20260709 12:21:12.071082  7059 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.085500  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:12.059450  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 114501us
I20260709 12:21:12.062140  6745 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:12.090843  4331 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:12.093068  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.096369  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:12.065908  6871 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.063107  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.077589  6951 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:12.108906  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.030475  6856 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:21:12.085109  7046 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.029961  7005 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.105568  4992 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:12.107045  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.108088  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.144212  4326 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:12.077905  7042 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:12.107261  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:12.120656  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.088447  6745 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.119174  4328 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:12.093384  7018 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:12.089938  6769 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:21:12.141546  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.146452  4985 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:12.139163  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.136703  6713 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.090301  6921 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:21:12.125720  7062 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.124432  4988 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:12.126327  6966 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:12.178510  4330 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:12.154278  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.094235  6947 consensus_queue.cc:1059] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:21:12.100232  6959 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:21:12.181830  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:12.183283  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:12.137713  7016 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:21:12.136888  6911 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:21:12.210763  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.171970  7005 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.289808  4255 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:12.188773  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:12.126189  6871 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.174391  7018 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.174374  6745 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:12.293215  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 324879us
I20260709 12:21:12.295507  4984 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:12.148416  6926 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 12:21:12.315557  4987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.032s	sys 0.030s
W20260709 12:21:12.239770  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.300817  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:12.348760  4987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.039s	sys 0.034s
I20260709 12:21:12.136726  6907 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:21:12.151226  7046 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.349661  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:12.172643  7060 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:12.184517  6930 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:12.187103  6844 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:12.184842  6966 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.298179  6553 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.176793  6713 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.153044  7042 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.187593  6845 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.303906  7018 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:12.379369  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:12.350219  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.294238  7005 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:12.297192  6840 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.362922  7060 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:12.302917  7066 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.350680  6769 raft_consensus.cc:3055] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.185238  6868 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 12:21:12.303493  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:12.411010  7067 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:21:12.419122  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:12.292258  6838 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:21:12.388931  7070 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:12.370697  7016 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:21:12.353468  7040 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:12.423158  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 284085us
I20260709 12:21:12.466676  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.296943  6960 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:21:12.186391  7062 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.370347  6844 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.373404  6966 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.366750  6930 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:12.388072  6713 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.389233  6940 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:12.437064  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 285141us
W20260709 12:21:12.440824  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 298720us
I20260709 12:21:12.426317  7005 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.184926  6862 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:12.433554  7047 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:21:12.524889  7071 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:12.525441  7071 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.525854  7071 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:12.464550  4983 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:12.386878  6553 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.529377  6553 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:12.529953  6553 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.530431  6553 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:12.531873  7054 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:21:12.494316  7040 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.537751  7040 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.538344  7040 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:12.429827  6873 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:21:12.427184  7060 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.544757  6553 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.545612  6553 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:12.429936  6769 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:12.500615  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.374159  7065 consensus_queue.cc:1059] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:21:12.389413  6845 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.548025  6769 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.549096  6769 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.549738  6845 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.550356  7071 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.460568  7070 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.435055  7066 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:12.516842  7077 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:12.512156  6940 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:12.484534  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 65493us
I20260709 12:21:12.585886  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:12.551863  7005 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.472563  6948 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.510965  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:12.494429  7064 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:12.506018  6844 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.538708  7040 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:12.591266  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.603375  4326 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:12.588878  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:12.609197  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 98318.8us
I20260709 12:21:12.617684  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:12.585115  7070 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.628386  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.597489  7073 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.650496  6761 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.651183  6761 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.578689  6507 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:21:12.624547  6598 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:12.645187  6601 consensus_meta.cc:287] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:21:12.646106  7059 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:12.653175  7059 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:12.653219  6926 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:12.645776  6772 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.654242  6772 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.598119  7040 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.660125  7042 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.661984  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:12.663591  7018 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.664647  6911 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:12.665035  6911 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:12.665988  6921 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:12.666606  6921 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.667050  6921 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.669034  6921 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.669507  6921 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:12.669834  6921 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:12.670064  6947 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:12.670447  6947 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:12.672963  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:12.659173  4254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1760) took 2043 ms (client timeout 1918 ms). Trace:
I20260709 12:21:12.654157  7059 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.646668  7066 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.674417  4326 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:21:12.674707  4254 rpcz_store.cc:269] 0709 12:21:10.615700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.615827 (+   127us) service_pool.cc:224] Handling call
0709 12:21:12.658978 (+2043151us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400120054. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:12.659093 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760868608}
I20260709 12:21:12.650571  7073 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:12.673338  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.598950  7072 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:12.648629  7071 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:12.677024  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 48693.9us
W20260709 12:21:12.672958  7074 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:21:12.679973  7059 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:12.672343  7062 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:12.680833  6999 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 2.466s	user 0.000s	sys 0.013s
I20260709 12:21:12.681160  6507 consensus_queue.cc:1243] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:12.684535  7005 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.684671  6928 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.611622  7064 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:12.613744  7041 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.012s	sys 0.010s
I20260709 12:21:12.699659  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:12.708273  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:12.709566  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:12.702140  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:12.598625  6948 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.607487  6713 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.699191  6840 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:21:12.712437  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 204967us
I20260709 12:21:12.678325  6871 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:12.674470  7083 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:12.711216  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:12.723990  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.704654  6601 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:21:12.728349  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.705368  7072 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:12.729187  4330 raft_consensus.cc:2410] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:21:12.729560  7072 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.673681  7080 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 12:21:12.712709  7041 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.013s	sys 0.010s
W20260709 12:21:12.728550  6839 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.001s
I20260709 12:21:12.724690  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:12.721186  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.714184  6598 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:12.695037  7060 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.609063  6930 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.695628  6908 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.733922  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.702111  7016 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:21:12.737030  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.678143  6940 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.703601  6960 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:21:12.670692  6921 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.733019  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.671273  6947 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.727119  6868 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:12.711398  7040 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.714071  7089 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.733915  7086 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.759419  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:12.760911  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 559) took 2836 ms. Trace:
I20260709 12:21:12.766588  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.742870  7080 consensus_queue.cc:1243] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:12.738165  7091 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.768273  4248 rpcz_store.cc:276] 0709 12:21:09.924890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.941133 (+ 16243us) service_pool.cc:224] Handling call
0709 12:21:10.007420 (+ 66287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.007674 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.007703 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.008233 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:21:10.167595 (+159362us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:10.167650 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.167747 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:12.680252 (+2512505us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:12.755766 (+ 75514us) raft_consensus.cc:1685] finished
0709 12:21:12.755786 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.760846 (+  5060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45591296,"thread_start_us":64384,"threads_started":1,"wal-append.queue_time_us":84101}
W20260709 12:21:12.775216  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 65739.9us
I20260709 12:21:12.775954  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:12.755456  7005 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.732484  7046 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.749171  6838 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.759537  7068 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:12.781067  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.782872  4334 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:21:12.748915  6904 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.751392  7041 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:12.751588  7085 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:21:12.799678  4334 pending_rounds.cc:85] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:12.800087  4334 pending_rounds.cc:107] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:21:12.800386  4334 raft_consensus.cc:2889] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.753087  6840 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:21:12.801533  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:12.805794  7093 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.807627  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:12.808657  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:12.787143  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.810668  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:12.761773  6601 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 12:21:12.849557  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.762113  7084 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:12.910960  4403 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:12.774394  6908 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:12.917937  4406 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:12.781301  6839 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:12.919461  4326 raft_consensus.cc:2393] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:12.767729  7088 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:12.924335  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 335545us
I20260709 12:21:12.789229  6947 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:12.788833  6921 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:12.938443  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 162553us
I20260709 12:21:12.911010  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:12.941473  6769 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:12.942389  7099 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:12.943594  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.945741  6598 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:12.960350  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:12.811942  6838 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.946779  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:12.782294  7065 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
W20260709 12:21:12.930446  6745 consensus_meta.cc:287] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.572s	user 0.015s	sys 0.009s
I20260709 12:21:12.770500  7082 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 12:21:12.777434  7086 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:12.930466  7095 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.107s	user 0.000s	sys 0.005s
I20260709 12:21:12.953027  4328 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:12.734051  7073 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.955813  6713 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:12.922253  7005 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:12.958747  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.925827  7088 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:12.946403  7070 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.963604  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:12.964375  7094 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:12.947511  7087 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:21:12.950181  6948 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:12.771067  7064 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.991840  4248 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:21:12.950974  6839 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:12.952392  6904 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:12.777266  7089 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.919826  7093 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:12.968667  7084 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:12.970031  7065 consensus_queue.cc:1243] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0aa405b398df42edbf74ee643aeb18dc log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:12.992542  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:12.994033  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2283) took 3148 ms. Trace:
I20260709 12:21:12.986557  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:12.986212  6769 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:21:12.920324  7041 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:12.983853  7088 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:12.972554  6745 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.002347  4332 rpcz_store.cc:276] 0709 12:21:09.845798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:09.845962 (+   164us) service_pool.cc:224] Handling call
0709 12:21:10.311550 (+465588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:10.317658 (+  6108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.317701 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:10.325974 (+  8273us) log.cc:844] Serialized 26 byte log entry
0709 12:21:10.499105 (+173131us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:10.499158 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:10.499248 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.132616 (+633368us) raft_consensus.cc:1685] finished
0709 12:21:11.132644 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:12.989884 (+1857240us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54002030d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:12.993962 (+  4078us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5650,"raft.queue_time_us":21906,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10739,"spinlock_wait_cycles":1069916928,"thread_start_us":137595,"threads_started":1,"wal-append.queue_time_us":193901,"wal-append.run_cpu_time_us":3407,"wal-append.run_wall_time_us":1573465}
I20260709 12:21:12.997720  7099 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.018492  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:13.026809  4332 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.002602  7073 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.000795  6904 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.005209  6928 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.036329  7086 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:13.037971  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.038082  7070 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.009341  7040 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.039708  7016 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.011168  7084 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:13.042944  4334 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:12.989522  7094 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.029583  7060 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.011497  7103 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:13.082772  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 107744us
I20260709 12:21:13.043860  6928 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.056327  7016 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.066591  7104 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:13.071566  7103 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:13.146085  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 153661us
I20260709 12:21:13.116920  4218 leader_election.cc:400] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7.
I20260709 12:21:13.154120  4218 leader_election.cc:403] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:13.154850  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 71262.1us
I20260709 12:21:13.072140  6844 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.054908  7005 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.058657  6839 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.154832  7108 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.187774  7107 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.193387  4332 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:13.150731  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 915) took 2532 ms. Trace:
I20260709 12:21:13.195819  4325 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:21:13.156504  7103 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:13.201946  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.200112  7041 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.201049  7093 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.204119  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:13.205176  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:13.211226  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:13.217900  4332 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:21:13.220031  4409 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:13.220845  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.201867  6904 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.214717  6912 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:13.234516  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:13.235162  4332 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:13.237998  7110 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:13.158632  7104 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.234225  6912 raft_consensus.cc:697] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:13.217615  7091 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:13.188613  7107 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.231757  6745 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.246398  7096 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.198457  4986 rpcz_store.cc:276] 0709 12:21:10.618241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.622087 (+  3846us) service_pool.cc:224] Handling call
0709 12:21:12.035257 (+1413170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.036215 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.125633 (+1089418us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54005a19d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:13.147243 (+ 21610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036621568}
I20260709 12:21:13.157521  7084 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.262560  7114 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.263166  7114 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.264087  7107 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.259577  6912 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.194310  7105 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
W20260709 12:21:13.270174  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.249763  7096 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.274623  7111 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:13.275098  7059 consensus_meta.cc:287] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 12:21:13.278587  6970 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:13.279142  6970 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:13.280233  6970 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.281756  6970 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.290331  4254 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:21:13.275218  7111 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.348567  4255 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:21:13.271586  6928 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.357566  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.357712  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.270673  7089 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.360838  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.363404  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.381635  4257 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:13.367882  4247 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:21:13.370594  6745 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.371626  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 931) took 1406 ms. Trace:
I20260709 12:21:13.360953  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.275766  7094 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.391937  4248 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 4: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:13.347529  7016 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:13.395854  6966 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 12:21:13.405120  6966 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.406240  4332 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:21:13.412988  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.347790  7114 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.420424  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.428462  4254 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.432402  7104 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:13.433472  7100 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:21:13.440541  4254 raft_consensus.cc:2410] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:13.403781  7065 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.442281  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.453365  4254 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:13.454949  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.411659  6844 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:13.477064  7109 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:21:13.458817  6921 consensus_meta.cc:287] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 12:21:13.407449  6745 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.482371  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:13.482681  4254 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:13.403111  4988 rpcz_store.cc:276] 0709 12:21:11.966628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.028798 (+ 62170us) service_pool.cc:224] Handling call
0709 12:21:12.077470 (+ 48672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.177769 (+100299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.371405 (+1193636us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54006018d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:13.371560 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85379968}
I20260709 12:21:13.412050  7088 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.356220  7091 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.490844  6966 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.498811  4331 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:21:13.499217  4331 pending_rounds.cc:85] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:21:13.499449  4331 pending_rounds.cc:107] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:21:13.499694  4331 raft_consensus.cc:2889] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:13.484999  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.505607  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:13.515102  4333 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:13.542382  7029 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:13.543447  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 394050us
I20260709 12:21:13.499470  6921 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:13.537549  4247 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:13.546674  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.564420  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:13.478989  7065 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.578536  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:13.542990  7029 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.582227  6966 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:13.549423  6921 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.582695  6966 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.585276  6966 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.585745  7029 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.590035  7030 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:13.590544  7030 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:13.591981  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.593691  7030 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.595847  7030 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.596212  7111 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.579835  7114 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.608793  7088 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.585767  6921 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.596570  7104 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.621595  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:13.624910  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.591387  7096 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.628681  6761 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.630410  6862 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.632433  7018 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.632992  6861 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:13.620651  7108 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7.
W20260709 12:21:13.623080  7073 consensus_meta.cc:287] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.011s
W20260709 12:21:13.635092  7085 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.024s	sys 0.036s
W20260709 12:21:13.650398  6947 consensus_meta.cc:287] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.004s
I20260709 12:21:13.648589  6761 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:13.669168  6761 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:13.669592  6761 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.670377  6959 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:13.670806  6959 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:13.671674  6959 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:13.651916  7085 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.024s	sys 0.036s
I20260709 12:21:13.627281  7104 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.668692  6940 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.674896  6861 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:13.680107  6861 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.681453  6861 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.651315  4247 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:13.638136  6948 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.016s	sys 0.046s
W20260709 12:21:13.700413  4296 connection.cc:256] RPC call timeout handler was delayed by -1.248302920000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 12:21:13.704000  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1511029200000849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 12:21:13.707538  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:13.687490  6948 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.017s	sys 0.046s
I20260709 12:21:13.712370  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:13.673144  7103 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.646044  6966 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:13.718976  7065 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.726239  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:13.727407  6908 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:13.717080  7102 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:13.736325  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:13.711117  7090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.014s	sys 0.032s
I20260709 12:21:13.723311  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.731340  7005 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:13.720134  6845 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:21:13.768627  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 144388us
I20260709 12:21:13.774061  4325 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:21:13.741269  7090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.014s	sys 0.033s
I20260709 12:21:13.781715  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.786234  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.786819  4252 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:13.787729  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.788523  4252 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:13.730623  7094 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:21:13.789793  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.795166  4252 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:13.795481  6936 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.796940  6936 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.796124  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.793427  7120 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:21:13.800285  4252 raft_consensus.cc:2410] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260709 12:21:13.773952  6944 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.010s	sys 0.007s
I20260709 12:21:13.768523  7102 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:13.794183  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2359) took 2445 ms. Trace:
I20260709 12:21:13.772205  7005 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:13.809369  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.816238  4252 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:21:13.813090  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:13.808493  7099 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.009s
W20260709 12:21:13.820094  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.823513  7099 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:13.811067  4404 rpcz_store.cc:276] 0709 12:21:11.348434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.364901 (+ 16467us) service_pool.cc:224] Handling call
0709 12:21:11.365269 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:11.540422 (+175153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:11.540450 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:11.548053 (+  7603us) log.cc:844] Serialized 26 byte log entry
0709 12:21:11.885024 (+336971us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:12.086036 (+201012us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.086300 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.788188 (+1701888us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400375fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:13.788236 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.788277 (+    41us) raft_consensus.cc:1685] finished
0709 12:21:13.793976 (+  5699us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.794126 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35908,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4249,"raft.queue_time_us":89,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4261,"spinlock_wait_cycles":402287488,"thread_start_us":459863,"threads_started":2,"wal-append.queue_time_us":489596,"wal-append.run_cpu_time_us":2406,"wal-append.run_wall_time_us":1084215}
W20260709 12:21:13.810108  6944 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.825s	user 0.010s	sys 0.007s
I20260709 12:21:13.801121  6908 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:13.810928  7102 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:13.818449  7005 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.837934  4333 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:13.824842  7119 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.822525  6507 consensus_queue.cc:1059] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:21:13.834224  7102 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:13.837350  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.836720  7104 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.837054  7064 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 12:21:13.854796  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 112624us
I20260709 12:21:13.855650  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:13.857532  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:13.847808  7103 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.863844  7084 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:13.864269  7084 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.864622  7084 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:13.854928  7122 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:21:13.868376  4325 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:13.871538  6966 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.873819  6761 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.879499  6772 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:13.866021  6908 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.886346  6934 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:13.886837  6934 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:13.887799  7133 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:13.887746  6934 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.863092  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:13.899058  7103 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:13.894688  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:13.844775  7119 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:13.903636  7126 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:21:13.905341  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1754) took 2080 ms. Trace:
I20260709 12:21:13.899576  7103 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.858450  7091 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:13.908883  4256 rpcz_store.cc:276] 0709 12:21:11.824790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.949070 (+124280us) service_pool.cc:224] Handling call
0709 12:21:11.949476 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:11.984987 (+ 35511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:11.985020 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:11.986636 (+  1616us) log.cc:844] Serialized 52 byte log entry
0709 12:21:12.006793 (+ 20157us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b48002a0558. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:21:12.661259 (+654466us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b180036b0e0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:12.766083 (+104824us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:12.941088 (+175005us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.084734 (+143646us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.085625 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.905049 (+819424us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b540019a854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:13.905093 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.905134 (+    41us) raft_consensus.cc:1685] finished
0709 12:21:13.905146 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.905286 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61218,"prepare.queue_time_us":215869,"prepare.run_wall_time_us":36,"raft.queue_time_us":53120,"raft.run_cpu_time_us":2147,"raft.run_wall_time_us":48476,"spinlock_wait_cycles":112685312,"thread_start_us":378408,"threads_started":3,"wal-append.queue_time_us":979905}
I20260709 12:21:13.912566  7103 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.915004  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.915745  4256 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:13.909669  7131 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:13.928351  4256 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:13.928514  7119 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:13.914947  7135 raft_consensus.cc:2764] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:13.929070  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.932878  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:13.934657  7084 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:13.901178  7129 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:21:13.933382  4255 raft_consensus.cc:2376] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6. Re-sending same reply.
I20260709 12:21:13.938669  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:13.939841  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.932704  6761 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:13.940500  4256 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:13.942150  6911 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.942703  4256 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:21:13.944383  4256 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:13.930959  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.945163  6907 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:13.948062  6907 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:13.949501  6907 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:13.952679  6970 consensus_meta.cc:287] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.670s	user 0.016s	sys 0.001s
I20260709 12:21:13.953423  4247 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:13.956900  7132 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.957453  7132 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.945734  6911 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:13.946530  6966 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:13.974597  6951 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:13.975076  6951 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:13.976059  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 1999) took 1233 ms. Trace:
I20260709 12:21:13.975888  6951 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:13.976444  4332 rpcz_store.cc:276] 0709 12:21:12.742208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.249983 (+507775us) service_pool.cc:224] Handling call
0709 12:21:13.250325 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.406627 (+156302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.975817 (+569190us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001d51d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:13.976000 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358049664}
I20260709 12:21:13.977042  4401 raft_consensus.cc:2410] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:13.977114  6951 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:13.978906  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.979545  4249 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:13.980540  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:13.980593  4255 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:21:13.981647  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.982992  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.984685  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.985991  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:13.986882  4249 raft_consensus.cc:2410] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:21:13.995570  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:14.000496  6598 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:14.001072  6598 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:14.006907  6841 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:14.007648  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.003571  6761 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.009852  6761 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:14.014775  6871 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:14.015205  6871 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:14.004793  6970 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.016167  6871 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.016753  6970 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.017232  6871 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.019935  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:14.022382  4249 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:14.023553  6601 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.025350  6761 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:14.027621  6745 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.028349  4249 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:21:14.027486  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:14.029330  7085 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:14.029685  7085 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:14.029915  7129 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.030309  7129 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.030702  7129 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.030457  7085 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.035626  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:14.036931  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:14.035598  7114 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.043697  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:13.970571  7103 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.044792  6601 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.053109  6601 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.052929  7114 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:14.047194  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.048399  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1758) took 2185 ms. Trace:
I20260709 12:21:14.054442  7085 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.055465  4327 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:21:14.049362  6960 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:14.051693  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.058780  4332 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:14.059480  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:14.045418  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.061107  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:14.052660  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.061872  4407 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:14.044044  6761 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.053634  6601 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.054338  4250 rpcz_store.cc:276] 0709 12:21:11.863165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.981866 (+118701us) service_pool.cc:224] Handling call
0709 12:21:11.990262 (+  8396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.043898 (+ 53636us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:12.044192 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.151284 (+107092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:12.151658 (+   374us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:12.151706 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.047529 (+1895823us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b1800103cc0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc5f2a6 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419
0709 12:21:14.048149 (+   620us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5400085cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:14.048193 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.048338 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2887,"prepare.queue_time_us":10661,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":3097,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":19786,"spinlock_wait_cycles":125229312,"thread_start_us":103813,"threads_started":1,"wal-append.queue_time_us":386423,"wal-append.run_cpu_time_us":1403,"wal-append.run_wall_time_us":1116614}
I20260709 12:21:14.055639  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.045260  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 678) took 1942 ms. Trace:
I20260709 12:21:13.947495  7091 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:21:14.057299  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.057924  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:14.129251  4325 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:14.129539  4328 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:14.062140  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.131402  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.129261  4330 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:14.132120  4408 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:14.132684  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.135619  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:14.136184  4333 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:14.064924  4249 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:14.111496  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.112304  4405 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:21:14.082450  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.138748  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.051210  7046 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:14.111110  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.056321  7040 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.143806  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.147142  7084 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:14.147486  4247 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:14.154224  4402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1574) took 2705 ms (client timeout 1963 ms). Trace:
W20260709 12:21:14.154731  4402 rpcz_store.cc:269] 0709 12:21:11.448404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.816125 (+367721us) service_pool.cc:224] Handling call
0709 12:21:12.002798 (+186673us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b58001c3298. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59eee 000000000036eb39 00007fdbb5ccd1e0 00007fdbb5d960c4 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:14.154006 (+2151208us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54000bb3d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:14.154141 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119458432}
I20260709 12:21:14.156067  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.156919  4402 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:14.127547  4991 rpcz_store.cc:276] 0709 12:21:12.102559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.118664 (+ 16105us) service_pool.cc:224] Handling call
0709 12:21:12.172508 (+ 53844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:12.188392 (+ 15884us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:12.370268 (+181876us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.739055 (+368787us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.802031 (+ 62976us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18001c5880. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:14.038540 (+1236509us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b18001c5880. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc0bc0a 00007fdbb734b219 00007fdbb4c5258f 00007fdbadc91571 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd
0709 12:21:14.044838 (+  6298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:14.044899 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:14.044957 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.045034 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.045189 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1332701,"prepare.queue_time_us":73584,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":2757,"raft.queue_time_us":1303425,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":7316,"spinlock_wait_cycles":10378368,"thread_start_us":287248,"threads_started":1,"wal-append.queue_time_us":382839,"wal-append.run_cpu_time_us":7474,"wal-append.run_wall_time_us":1253039}
I20260709 12:21:14.157823  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.158658  4402 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:21:14.160027  4403 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:14.163000  7072 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.164899  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.173133  4988 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:14.172832  7072 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.174248  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.162043  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.162043  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:14.166996  4990 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:14.194541  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:14.064061  6970 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.167778  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.168556  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:14.131424  7112 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:14.194231  4403 raft_consensus.cc:2376] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6. Re-sending same reply.
I20260709 12:21:14.178329  4333 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:14.065670  7068 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.143s
I20260709 12:21:14.115864  7129 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.373708  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:14.232030  4328 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
W20260709 12:21:14.297286  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.395161  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 928) took 3622 ms. Trace:
W20260709 12:21:14.393769  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:14.175534  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.322940  4255 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:14.169150  4992 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:14.463075  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:14.169622  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.167418  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:14.481017  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.165808  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:14.249894  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.165877  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.488588  4407 raft_consensus.cc:2376] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5. Re-sending same reply.
I20260709 12:21:14.166548  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.477523  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.166744  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:14.194244  4250 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.270008  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.493783  4329 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:14.489734  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:14.491561  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:14.171337  4409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1572) took 2723 ms (client timeout 2158 ms). Trace:
W20260709 12:21:14.495661  4409 rpcz_store.cc:269] 0709 12:21:11.447859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.839921 (+392062us) service_pool.cc:224] Handling call
0709 12:21:14.171155 (+2331234us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003c73d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:14.171250 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533123968}
I20260709 12:21:14.480248  4400 raft_consensus.cc:2376] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5. Re-sending same reply.
I20260709 12:21:14.501401  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.501963  4407 raft_consensus.cc:2376] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5. Re-sending same reply.
I20260709 12:21:14.058441  6960 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:14.502774  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:14.507740  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 341061us
I20260709 12:21:14.508018  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.508332  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.508522  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:14.508656  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.508935  4402 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:14.509339  4407 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.509709  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.504369  4990 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:14.510262  4402 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:14.510282  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:14.506328  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:14.351410  7005 consensus_meta.cc:287] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.001s
I20260709 12:21:14.521093  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.511103  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.511454  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.523412  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.519701  6858 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:14.524966  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.165040  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.558544  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.558676  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.526840  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.525771  4333 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:14.561837  4989 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.535516  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:14.343641  4991 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:14.217162  6951 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.523984  4402 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:14.568085  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.501091  7021 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:14.560480  6917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.595s	user 0.004s	sys 0.018s
I20260709 12:21:14.164619  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.287941  7020 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:14.163938  6838 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.250739  7040 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.222872  7080 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.571395  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:14.572934  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.479082  4987 rpcz_store.cc:276] 0709 12:21:10.772940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.194126 (+421186us) service_pool.cc:224] Handling call
0709 12:21:11.236050 (+ 41924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.294060 (+ 58010us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:11.723281 (+429221us) log.cc:844] Serialized 14 byte log entry
0709 12:21:12.358977 (+635696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:12.359066 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:12.359137 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.394744 (+2035607us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b540049eb54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:14.394828 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.395068 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10521,"prepare.queue_time_us":170791,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":159630,"raft.run_cpu_time_us":3685,"raft.run_wall_time_us":16191,"spinlock_wait_cycles":132700544,"thread_start_us":1026318,"threads_started":2,"wal-append.queue_time_us":738189,"wal-append.run_cpu_time_us":5500,"wal-append.run_wall_time_us":1225847}
I20260709 12:21:14.624439  4402 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:14.583531  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:14.176836  7046 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.217082  7042 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.525488  6944 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:14.602262  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:14.605536  4250 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:14.606159  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:14.519881  7073 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.567252  6871 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:14.614392  6917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.645s	user 0.005s	sys 0.018s
I20260709 12:21:14.170104  6926 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:14.618721  7075 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 2.191s	user 0.005s	sys 0.000s
I20260709 12:21:14.232502  7102 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.621341  4400 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:14.574357  7059 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:14.614776  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.620183  7103 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.576778  7034 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.625480  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.651062  4402 raft_consensus.cc:2410] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:14.651650  4330 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:21:14.634473  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52019.1us
I20260709 12:21:14.613704  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.654304  4405 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:14.638616  6761 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.558633  7005 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.657168  6761 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.657524  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.658502  7005 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.521428  7112 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.658722  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.653682  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:14.659701  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1757) took 2801 ms. Trace:
I20260709 12:21:14.660653  4247 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:14.660895  7112 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.641361  4250 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:14.193112  6873 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.575750  4983 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:14.586659  7021 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.527487  7060 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:21:14.668016  4250 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:14.632480  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.623816  7072 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:14.642228  6917 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:14.655684  7068 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.649645  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.662452  4325 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:14.640205  6871 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.633817  6944 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.585677  6951 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.663424  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.643095  6960 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:14.642649  7066 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:14.645772  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.644763  7059 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.623590  7020 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:14.631891  7080 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.642894  7073 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.639533  7042 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.647719  6926 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.663643  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:14.665539  4247 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:21:14.660075  4253 rpcz_store.cc:276] 0709 12:21:11.858099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:11.973149 (+115050us) service_pool.cc:224] Handling call
0709 12:21:11.983686 (+ 10537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:11.990575 (+  6889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:11.990610 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:11.991094 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:21:12.316135 (+325041us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:12.316194 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:12.316293 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.414124 (+2097831us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:14.659379 (+245255us) raft_consensus.cc:1685] finished
0709 12:21:14.659405 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.659641 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3668,"raft.queue_time_us":7746,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":6860672,"thread_start_us":324587,"threads_started":1,"wal-append.queue_time_us":397673}
W20260709 12:21:14.864338  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 200676us
I20260709 12:21:14.664726  4330 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:14.867633  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 203159us
I20260709 12:21:14.869159  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.680878  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.873412  4330 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:21:14.876209  4371 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.132:43853 timed out after 1.716s (SENT) [suppressed 22 similar messages]
I20260709 12:21:14.685869  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:14.880558  4400 raft_consensus.cc:2410] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:14.718048  4989 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:14.882218  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.882767  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.701429  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.884263  4989 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.885492  4983 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:14.885759  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.886574  4986 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.886837  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:14.688643  4988 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:14.888998  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:14.883134  4400 raft_consensus.cc:2410] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:14.892148  4991 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:14.720911  6911 consensus_meta.cc:287] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.002s
I20260709 12:21:14.893821  6911 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:14.894302  4991 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:14.894682  6911 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.685573  6838 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.211s
I20260709 12:21:14.897883  6839 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:14.898451  6839 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:14.898747  6838 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.899276  6911 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.899718  6871 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.900333  7041 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:14.901618  7066 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:14.662117  6873 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.915258  7059 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.917429  6873 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:14.902909  6944 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.917829  7020 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:14.919071  7112 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:14.722223  7021 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.902081  6917 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.917472  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:14.927759  7042 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:14.923861  7086 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:14.665833  7034 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.676848  6940 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.259s
I20260709 12:21:14.933559  7041 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:14.935614  7060 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:14.936108  7060 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:14.937724  7080 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:14.937559  7060 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:14.938236  4334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 643) took 2184 ms (client timeout 2675 ms). Trace:
I20260709 12:21:14.944968  6940 consensus_queue.cc:1243] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:14.924700  7066 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:14.945727  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2300) took 2274 ms. Trace:
I20260709 12:21:14.945855  6911 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:14.946497  6911 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:14.946364  4331 rpcz_store.cc:276] 0709 12:21:12.671669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.680651 (+  8982us) service_pool.cc:224] Handling call
0709 12:21:12.680964 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.500141 (+819177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.945130 (+1444989us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540013d154. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:14.945511 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880072960}
W20260709 12:21:14.939406  4334 rpcz_store.cc:269] 0709 12:21:12.753501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.973793 (+220292us) service_pool.cc:224] Handling call
0709 12:21:14.937758 (+1963965us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b540011add4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:14.938021 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82592000}
I20260709 12:21:14.948786  7073 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:14.950186  4404 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:14.951040  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.951879  6839 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.952533  6911 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.953372  6839 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.954490  6911 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:14.956995  4986 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:14.959195  6926 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.952932  7068 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:14.962311  6951 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:14.962803  7068 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:14.963088  6761 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.953368  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.963800  4985 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:21:14.983963  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 117898us
I20260709 12:21:14.969002  6598 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:14.979316  4984 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:14.669008  7138 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:14.711591  7102 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.724217  7046 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:14.720916  7085 consensus_meta.cc:287] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260709 12:21:14.710088  7040 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:14.722844  7129 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:14.981954  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:14.982558  6960 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:14.969945  4986 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:21:15.006827  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 130673us
I20260709 12:21:15.012885  7021 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.013671  7021 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.014776  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.015730  4406 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:15.016047  7060 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.016637  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.017765  4405 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:15.022717  7142 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260709 12:21:15.023379  4254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 584) took 1724 ms (client timeout 2181 ms). Trace:
W20260709 12:21:15.023842  4254 rpcz_store.cc:269] 0709 12:21:13.298923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.454282 (+155359us) service_pool.cc:224] Handling call
0709 12:21:15.022947 (+1568665us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54000866d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:15.023137 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62144896}
I20260709 12:21:15.024600  6908 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:15.025327  6908 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:15.028296  7061 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:15.028735  4986 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.028947  7061 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:15.030412  7061 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.031381  4990 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:15.032702  7061 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.033504  7112 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.034147  7112 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.035367  4257 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:21:15.036727  7112 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:15.037576  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.039867  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:15.040702  4253 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.044878  6944 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.046286  4988 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:15.002314  6838 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.048441  6944 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.058082  4406 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:15.053612  7138 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:15.064206  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.063378  6598 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.066291  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.071863  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.072721  7138 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.080718  7034 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.081825  4153 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 5 to 7, VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) evicted. New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:21:15.082894  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.084259  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.087025  4153 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 2 to 6, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.089063  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2293) took 3016 ms. Trace:
I20260709 12:21:15.089558  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:15.091497  6838 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:15.074844  7132 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.075706  7090 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:15.096988  7112 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:15.097254  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:15.097802  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.097663  4401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1594) took 2303 ms (client timeout 1582 ms). Trace:
I20260709 12:21:15.089471  7114 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.074298  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.060388  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:15.078552  4151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 368) took 19030 ms (client timeout 15000 ms). Trace:
I20260709 12:21:15.098675  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:15.116086  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.026824  6908 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:21:15.105650  7142 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:15.117179  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.105862  4327 rpcz_store.cc:276] 0709 12:21:12.072736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.074191 (+  1455us) service_pool.cc:224] Handling call
0709 12:21:12.074443 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.055789 (+1981346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.088649 (+1032860us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001d56d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:15.088909 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4555192704}
I20260709 12:21:15.102689  6930 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.121227  7021 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.124133  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.125646  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.126425  4329 raft_consensus.cc:1813] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:15.126668  7143 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.432s	user 0.002s	sys 0.000s
I20260709 12:21:15.127050  4329 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:15.078123  6601 consensus_meta.cc:287] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.008s
I20260709 12:21:15.164765  6601 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.166380  4407 raft_consensus.cc:2393] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:15.110878  4401 rpcz_store.cc:269] 0709 12:21:12.793618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.793859 (+   241us) service_pool.cc:224] Handling call
0709 12:21:15.097165 (+2303306us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000aee54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:15.097424 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451991424}
I20260709 12:21:15.168157  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.168088  7152 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:15.169106  4401 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:15.169188  7152 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:15.169703  7152 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:15.169893  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.170110  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.170895  4401 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:15.143327  7059 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.144963  4153 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 2 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.119913  7066 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.150835  4403 raft_consensus.cc:2410] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:15.156599  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.157140  4252 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:15.158190  4989 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:15.159955  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 85898.3us
I20260709 12:21:15.162005  7086 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:15.162930  4990 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:15.078583  7106 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:15.056123  6871 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.117136  7090 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:15.164247  6934 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:15.114293  4151 rpcz_store.cc:269] 0709 12:20:56.047557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.076868 (+ 29311us) service_pool.cc:224] Handling call
0709 12:21:15.078220 (+19001352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:03.653881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:03.907672 (+253791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:03.912737 (+  5065us) write_op.cc:435] Acquired schema lock
0709 12:21:03.931641 (+ 18904us) tablet.cc:662] Decoding operations
0709 12:21:04.130613 (+198972us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:04.143388 (+ 12775us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:04.148030 (+  4642us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:04.217085 (+ 69055us) tablet.cc:701] Row locks acquired
0709 12:21:04.217666 (+   581us) write_op.cc:260] PREPARE: finished
0709 12:21:04.233835 (+ 16169us) write_op.cc:270] Start()
0709 12:21:04.234004 (+   169us) write_op.cc:276] Timestamp: P: 1783599664233758 usec, L: 0
0709 12:21:04.234036 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:21:04.234902 (+   866us) log.cc:844] Serialized 1289 byte log entry
0709 12:21:05.540645 (+1305743us) op_driver.cc:464] REPLICATION: finished
0709 12:21:06.620377 (+1079732us) write_op.cc:301] APPLY: starting
0709 12:21:06.676386 (+ 56009us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:06.689716 (+ 13330us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:06.689857 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:06.690484 (+   627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:06.690783 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:21:06.690824 (+    41us) write_op.cc:312] APPLY: finished
0709 12:21:06.691165 (+   341us) log.cc:844] Serialized 35 byte log entry
0709 12:21:06.708753 (+ 17588us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7b32a 00007fdbb0d00f14 00007fdbb0d00ec3 00007fdbb0d00e38 00007fdbb0d00df3 00007fdbb0d000dc 00007fdbb0d29e16 00007fdbb0d11cbb 00007fdbb0cfc39d 00007fdbb0cffd75
0709 12:21:07.920652 (+1211899us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbadc740ac 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b
0709 12:21:08.052330 (+131678us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:08.089554 (+ 37224us) write_op.cc:454] Released schema lock
0709 12:21:08.096929 (+  7375us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:08.127821 (+ 30892us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:08.127850 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111930,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":1030460,"apply.run_cpu_time_us":27222,"apply.run_wall_time_us":1533689,"num_ops":3,"prepare.queue_time_us":1132266,"prepare.run_cpu_time_us":7360,"prepare.run_wall_time_us":677991,"raft.queue_time_us":1033824,"raft.run_cpu_time_us":41290,"raft.run_wall_time_us":1278373,"replication_time_us":1306344,"spinlock_wait_cycles":239505920,"thread_start_us":4161875,"threads_started":5,"wal-append.queue_time_us":1436071,"wal-append.run_cpu_time_us":53118,"wal-append.run_wall_time_us":3041976}]]}
I20260709 12:21:15.182641  4406 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
W20260709 12:21:15.187732  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.188114  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.185164  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.202494  6772 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.203229  6772 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.204617  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.205406  4992 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:15.185424  7106 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.207656  7106 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.208720  6959 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:15.216687  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 119544us
I20260709 12:21:15.216578  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.218111  4254 raft_consensus.cc:2410] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:21:15.190091  7090 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:15.196240  6601 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.211992  4991 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.215660  4153 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:15.197037  7086 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:15.229570  7086 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.233928  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.235690  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.238504  6930 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:15.239560  6930 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.239982  6930 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:15.239882  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.240932  4327 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:15.241113  6930 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.242440  6930 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.243877  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.242235  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.245121  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.245805  4408 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:15.246472  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.248284  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.248493  6871 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.248939  4331 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 3.
I20260709 12:21:15.235208  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.249435  4408 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:15.258224  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.262257  4253 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:15.269236  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1598) took 1211 ms. Trace:
I20260709 12:21:15.269655  4404 rpcz_store.cc:276] 0709 12:21:14.057384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.057512 (+   128us) service_pool.cc:224] Handling call
0709 12:21:14.057796 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.950606 (+892810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.265885 (+315279us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54003aeb54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:15.269141 (+  3256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948138368}
I20260709 12:21:15.270435  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.267760  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.271216  4329 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:15.273227  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.274654  4401 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:15.274947  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.280987  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.282084  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2007) took 1095 ms. Trace:
I20260709 12:21:15.282272  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.283522  4328 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:15.283288  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.283202  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.277699  4986 raft_consensus.cc:1217] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 12:21:15.286283  4986 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:21:15.282987  4153 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:15.287729  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.275692  7059 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.289232  6772 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.296617  4330 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:15.297166  4401 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:21:15.298156  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.299830  7087 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.300225  7090 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.300542  7087 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.301695  7090 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.301160  4153 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.302747  7087 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.300338  4329 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:15.303715  4402 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:15.303685  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.302793  4153 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 2 to 4, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.310289  4405 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:15.315230  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1781) took 1710 ms. Trace:
I20260709 12:21:15.315670  4252 rpcz_store.cc:276] 0709 12:21:13.604583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.168318 (+563735us) service_pool.cc:224] Handling call
0709 12:21:15.315003 (+1146685us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400120554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:15.315166 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556667264}
I20260709 12:21:15.317140  4255 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:15.317494  7106 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.318783  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1772) took 1344 ms. Trace:
I20260709 12:21:15.298262  7020 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:21:15.391898  4403 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:21:15.392318  4403 pending_rounds.cc:85] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 6
I20260709 12:21:15.392560  4403 pending_rounds.cc:107] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:21:15.282510  4326 rpcz_store.cc:276] 0709 12:21:14.163723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.507591 (+343868us) service_pool.cc:224] Handling call
0709 12:21:14.519615 (+ 12024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.520643 (+  1028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:14.520671 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:14.521140 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.093601 (+572461us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b18000c72a0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:15.192865 (+ 99264us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:15.212524 (+ 19659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.218570 (+  6046us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.226077 (+  7507us) raft_consensus.cc:1685] finished
0709 12:21:15.226096 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.259013 (+ 32917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":647,"raft.queue_time_us":760,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":40741,"spinlock_wait_cycles":14531456,"thread_start_us":21778,"threads_started":1,"wal-append.queue_time_us":686109}
I20260709 12:21:15.392853  4403 raft_consensus.cc:2889] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.345099  4407 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:15.319159  4255 rpcz_store.cc:276] 0709 12:21:13.974506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.491908 (+517402us) service_pool.cc:224] Handling call
0709 12:21:15.316611 (+824703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:15.317514 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.318573 (+  1059us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400120550. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:15.318712 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729703296}
I20260709 12:21:15.345702  4402 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:21:15.397217  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.398036  4986 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:15.399803  4403 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.346124  7066 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.347795  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.349771  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.354919  4400 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.356318  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2309) took 1293 ms. Trace:
I20260709 12:21:15.366039  4956 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.403206  4327 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.368944  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.403692  4408 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.404055  4984 raft_consensus.cc:2393] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:15.370003  4992 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:21:15.370272  4990 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:15.371335  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:15.371263  4406 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.372454  4988 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:15.403231  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.375806  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.406193  4987 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:15.384240  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 685) took 1219 ms. Trace:
I20260709 12:21:15.385823  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.388188  4405 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:21:15.408181  4405 pending_rounds.cc:85] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 6
I20260709 12:21:15.408502  4405 pending_rounds.cc:107] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:21:15.408766  4405 raft_consensus.cc:2889] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.403306  4325 rpcz_store.cc:276] 0709 12:21:14.063245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.136853 (+ 73608us) service_pool.cc:224] Handling call
0709 12:21:14.137170 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.867153 (+729983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.355795 (+488642us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54002f26d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:15.356072 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207632640}
I20260709 12:21:15.408231  4986 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [3.6-5.7]
W20260709 12:21:15.402227  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 102638us
I20260709 12:21:15.368284  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.407465  4985 rpcz_store.cc:276] 0709 12:21:14.164375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.167105 (+  2730us) service_pool.cc:224] Handling call
0709 12:21:15.384002 (+1216897us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400512054. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:15.384162 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107778304}
I20260709 12:21:15.312633  4332 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:15.400461  7135 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.410502  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44582.5us
W20260709 12:21:15.416098  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 104889us
I20260709 12:21:15.416800  4992 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:15.426348  4409 raft_consensus.cc:2410] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:15.425870  7135 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.430912  7041 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:15.431581  4988 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:21:15.436017  7135 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.439554  4334 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:15.446390  4329 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.429109  4991 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:15.434144  7041 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:15.447418  4218 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.525s (SENT)
I20260709 12:21:15.452409  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:15.464100  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.464619  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.464879  4400 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:15.466032  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.466192  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.467031  7146 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.467643  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.467748  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.468482  4403 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:15.466529  4405 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.470191  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.459753  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.432351  7020 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:15.468992  4153 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:15.475629  4401 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:21:15.477058  4327 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
W20260709 12:21:15.478526  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.478564  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2363) took 1011 ms. Trace:
I20260709 12:21:15.450351  7041 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:21:15.479139  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:15.480187  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.481338  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.476014  4401 pending_rounds.cc:85] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 5
I20260709 12:21:15.482247  4401 pending_rounds.cc:107] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:15.482498  4401 raft_consensus.cc:2889] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.479135  4409 rpcz_store.cc:276] 0709 12:21:14.467044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.507762 (+ 40718us) service_pool.cc:224] Handling call
0709 12:21:15.455379 (+947617us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54003ae654. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:15.478505 (+ 23126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099548032}
I20260709 12:21:15.484140  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:15.481696  6959 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.486259  7107 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.484764  7135 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:21:15.486630  6959 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:15.488629  4955 leader_election.cc:336] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.557s (SENT)
I20260709 12:21:15.489153  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.489928  4406 raft_consensus.cc:2410] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:21:15.490742  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:15.491333  4400 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:15.493468  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.498997  4408 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:15.467588  7146 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.476573  6934 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:15.510548  6930 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:15.511154  6930 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.507643  6601 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.511826  6930 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.512562  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.512758  6601 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:15.511072  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 63727.3us
I20260709 12:21:15.498656  7106 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.513906  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:15.515954  7135 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:15.510967  7066 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:15.524973  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.525154  7129 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:15.545974  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:15.526535  7016 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:15.527619  6970 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.551035  6772 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:15.551563  6772 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.551512  6970 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.552287  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:15.553661  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:15.553783  6601 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.554242  6970 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.533542  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.554572  6926 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.535216  4253 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:15.555424  6926 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.532060  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.556420  4986 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:21:15.558096  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.536299  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.559147  4988 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:15.546847  7107 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:15.560580  7087 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:15.534853  4257 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:15.535576  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:15.562572  4252 raft_consensus.cc:2410] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:21:15.537051  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.537786  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.538543  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.563639  4985 raft_consensus.cc:1813] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:15.538249  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.546237  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:15.565280  4985 raft_consensus.cc:2368] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6.
W20260709 12:21:15.565879  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.509088  6959 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.546164  7129 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.552211  6772 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.547327  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.539162  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.575196  4984 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:15.491833  7152 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.549309  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.561058  7087 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:15.565040  4153 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.573320  4405 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
W20260709 12:21:15.573762  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.554338  7135 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:15.575268  6960 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:21:15.604030  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.603353  4990 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
W20260709 12:21:15.605248  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 92030.7us
I20260709 12:21:15.611559  4249 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.615053  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.587476  4983 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:15.580022  6598 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.617228  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 68137.7us
I20260709 12:21:15.620271  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:15.582532  7106 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.593813  7086 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:15.617228  4955 connection.cc:256] RPC call timeout handler was delayed by -1.1808913049999319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 12:21:15.623435  7091 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:15.628069  4992 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:15.624408  7087 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.604095  6934 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:15.627022  4252 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:15.606244  6960 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:15.630815  4955 connection.cc:256] RPC call timeout handler was delayed by -1.1574913049998941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 12:21:15.629823  4153 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.635167  7099 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.582780  7042 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:21:15.644485  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:15.647469  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.644241  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.653100  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.654512  4329 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:15.655853  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.656111  4254 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:21:15.656450  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 129177us
I20260709 12:21:15.655653  7091 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.632040  7016 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:15.660329  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 146611us
I20260709 12:21:15.653354  6598 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.661630  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.661767  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.666205  6960 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.669196  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:15.679018  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.667100  6598 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:15.680291  6960 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.681975  4153 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.683513  4326 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:15.684649  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.685382  4325 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.686988  4334 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:15.691390  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1618) took 1226 ms. Trace:
I20260709 12:21:15.692258  4249 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:15.691828  4404 rpcz_store.cc:276] 0709 12:21:14.465163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:15.270823 (+805660us) service_pool.cc:224] Handling call
0709 12:21:15.271232 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:15.289965 (+ 18733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:15.289996 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.295631 (+  5635us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.492734 (+197103us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:15.492780 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.492866 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.691177 (+198311us) raft_consensus.cc:1685] finished
0709 12:21:15.691199 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.691331 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3232,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":17582,"thread_start_us":150641,"threads_started":1,"wal-append.queue_time_us":378377}
I20260709 12:21:15.678584  4219 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.697481  6926 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:15.697999  6926 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.698417  6926 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.701330  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1785) took 1713 ms. Trace:
I20260709 12:21:15.697574  7060 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:15.656139  7135 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.711732  7060 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:15.712106  7152 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.712857  7060 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.713696  6930 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.704831  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.701762  4256 rpcz_store.cc:276] 0709 12:21:13.867051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.945403 (+ 78352us) service_pool.cc:224] Handling call
0709 12:21:13.945676 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.946046 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:21:13.996796 (+ 50750us) log.cc:844] Serialized 14 byte log entry
0709 12:21:15.283242 (+1286446us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18000bc920. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e23a 00007fdbb0d88a2a
0709 12:21:15.453080 (+169838us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:15.507822 (+ 54742us) log.cc:844] Serialized 26 byte log entry
0709 12:21:15.523281 (+ 15459us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:21:15.523367 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.564065 (+ 40698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:15.564114 (+    49us) raft_consensus.cc:1685] finished
0709 12:21:15.568288 (+  4174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:15.580287 (+ 11999us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21838,"prepare.queue_time_us":47796,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3520,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":20555,"spinlock_wait_cycles":15710976,"thread_start_us":156189,"threads_started":1,"wal-append.queue_time_us":1501542}
I20260709 12:21:15.706364  7059 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:15.706502  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:15.635790  7086 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.721611  7016 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:15.706928  4986 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:15.707700  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:15.709002  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.710546  4984 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:21:15.710465  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.694049  6934 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:15.752172  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.725608  7129 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:15.733227  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:15.736325  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.739210  4400 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:15.726976  4987 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:15.727489  4984 pending_rounds.cc:85] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 5
I20260709 12:21:15.759093  4984 pending_rounds.cc:107] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:21:15.759375  4984 raft_consensus.cc:2889] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.657500  7106 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.761353  4372 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.766619  6908 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.761770  6772 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.768467  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.769239  4331 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:15.723920  7087 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:15.770861  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 73702.8us
W20260709 12:21:15.773768  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 78834.6us
I20260709 12:21:15.775247  4253 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:15.776041  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 166482us
I20260709 12:21:15.751127  7152 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:15.776942  4218 leader_election.cc:336] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.968s (SENT)
I20260709 12:21:15.764374  6934 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:15.787958  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.789218  4333 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:15.775595  7016 raft_consensus.cc:2764] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:15.779345  7152 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.792920  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:15.782366  7061 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:15.782927  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:15.800434  4256 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:15.800151  6934 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.811431  4325 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:15.812819  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:15.815793  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 119013us
I20260709 12:21:15.794826  7061 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:15.821406  6926 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.821856  7061 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.822974  7106 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.823137  7061 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.823365  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:15.823645  7146 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.823835  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.823998  4248 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.824747  4331 raft_consensus.cc:2410] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:15.824990  4372 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:15.826226  7129 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:15.826674  7129 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.826911  7016 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.827078  7129 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.827502  7016 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.829623  4372 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:15.831121  6959 raft_consensus.cc:2764] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:21:15.796851  7152 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.835778  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:15.836505  4331 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:15.812381  6930 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.839849  7016 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.840420  7091 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.816990  7107 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:15.846895  7107 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:15.848258  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.848013  7107 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:15.848461  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:15.848758  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.850073  7059 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.850445  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.812863  4983 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:15.851473  7099 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:15.851914  7099 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:15.852347  7099 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:15.852952  7091 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:15.856163  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.856441  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.856870  4256 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:15.857966  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.858665  4992 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:15.818832  6772 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:15.850623  7059 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.860764  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:15.845186  4248 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:15.864344  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.878286  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.878911  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.883558  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:15.866220  6908 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.886446  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:15.890751  7066 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:15.891283  7066 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:15.863399  7059 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.861982  4983 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:15.902547  4252 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:15.903509  4256 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:15.902366  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:15.913611  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 69121.9us
I20260709 12:21:15.864107  7041 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:15.895615  6926 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.896068  7066 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:15.874521  7135 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:21:15.902261  6772 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:15.915814  6908 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.947517  7179 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.948201  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.904742  7106 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.921104  7020 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.965643  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:15.966897  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 52348.6us
I20260709 12:21:15.937413  7086 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:15.948712  7016 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:15.928864  7091 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.982002  4331 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:15.979255  7021 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:15.984825  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 86925.7us
I20260709 12:21:15.964190  7060 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:15.994441  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46331.6us
I20260709 12:21:16.013774  4218 leader_election.cc:400] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6.
I20260709 12:21:16.014384  4218 leader_election.cc:403] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:15.983202  4991 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:21:16.018394  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:16.020399  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 190821us
I20260709 12:21:16.021510  7060 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:16.026684  7060 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:16.033142  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 47617.2us
I20260709 12:21:15.992602  7021 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:16.041699  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:16.044030  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48856.2us
I20260709 12:21:16.044203  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.044703  6930 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:21:16.045845  7176 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:16.051004  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:15.975670  6908 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.051541  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:16.052114  4257 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:16.053076  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.054742  4333 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:21:16.058353  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.984645  7106 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:16.059928  4326 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:16.060283  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:15.992296  7020 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.049746  7021 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.068013  7020 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.069758  6908 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:16.072011  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.992704  7091 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.074767  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.082552  4332 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:16.083348  4327 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:16.051393  7016 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.094820  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:16.100939  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 51717.7us
I20260709 12:21:16.107920  4219 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.092911  7185 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.115477  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:16.129313  7171 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:21:16.100632  6772 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:21:16.131474  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.136960  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.097705  7020 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:16.127339  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:16.152938  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 43736us
I20260709 12:21:16.154914  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:16.156462  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 132554us
W20260709 12:21:16.158766  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.103066  7146 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:16.178905  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.109858  7060 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:16.113734  7087 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:16.216674  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.131261  6772 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:21:16.218482  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 338682us
I20260709 12:21:16.098572  7016 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.166747  6926 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:16.219466  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 64461.6us
I20260709 12:21:16.131652  6601 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.148339  7041 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:16.226081  7181 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:21:16.229070  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:16.232004  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 77450us
I20260709 12:21:16.213007  6598 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:16.166643  6960 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:16.222170  6772 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.184078  7059 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:21:16.183678  6970 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:21:16.155717  7185 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.256683  6959 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:16.258155  7152 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.243763  6598 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:16.246057  6960 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.255661  7060 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:16.273579  7185 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.274300  7106 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:16.275635  7177 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:21:16.243942  7021 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.270687  6926 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:16.265017  7090 consensus_meta.cc:287] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.963s	user 0.015s	sys 0.001s
W20260709 12:21:16.272033  7189 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:21:16.267796  7172 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:21:16.259145  7183 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:16.240222  6601 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.284893  6930 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6.
I20260709 12:21:16.249982  6934 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.290089  6960 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.287590  6598 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:16.302244  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 124734us
I20260709 12:21:16.311878  6930 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:16.312408  6926 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.313683  7198 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.314182  7198 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.316802  7196 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:16.317313  7196 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:16.307425  7185 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:16.319716  7185 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:16.320801  7185 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.322036  7185 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.278512  7129 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.323259  6934 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.325165  7183 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.328488  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.329282  4334 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:16.301611  7060 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:16.336485  7060 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.318361  7196 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.352926  7199 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.372047  4325 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:16.316845  7021 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.290160  7099 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.413087  4330 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:16.414196  7099 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.411842  7138 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.414951  7138 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.416712  7021 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.417315  7021 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:16.321210  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 94946.6us
W20260709 12:21:16.435053  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 156000us
W20260709 12:21:16.451748  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 222813us
W20260709 12:21:16.440490  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 198963us
I20260709 12:21:16.454417  4330 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:16.454813  4330 pending_rounds.cc:85] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 8
I20260709 12:21:16.465643  4330 pending_rounds.cc:107] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 12:21:16.465960  4330 raft_consensus.cc:2889] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:16.437422  6959 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.481715  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.439316  7016 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.481292  6959 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.484481  7021 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.485292  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:16.485936  4257 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:16.486364  7196 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:16.486663  6959 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.439133  7041 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:21:16.463765  7129 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.436764  7059 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:21:16.492151  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:16.484591  4253 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:16.494508  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 261572us
I20260709 12:21:16.499020  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.464797  6970 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.500521  4249 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:16.454058  7087 raft_consensus.cc:697] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:16.477700  7091 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.508546  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:16.511706  4332 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:16.514060  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:16.511029  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.515283  4329 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.513173  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.521967  4255 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:16.437783  7199 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.500092  7187 raft_consensus.cc:2764] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 12:21:16.538386  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.536159  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:16.542289  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.554700  7138 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.555150  7042 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:21:16.555447  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50868.9us
I20260709 12:21:16.558506  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:16.558656  6970 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:16.561079  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67324.4us
I20260709 12:21:16.562889  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.563446  7041 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:16.563733  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:16.564141  7198 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.564435  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:16.567289  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:16.570246  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.519464  7059 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:16.573644  4326 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:16.588814  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.591189  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:16.591859  4990 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.592329  7199 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.593137  7087 consensus_queue.cc:237] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.595983  6772 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.536167  7183 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:16.599321  7066 consensus_meta.cc:287] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.009s
W20260709 12:21:16.599448  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 100526us
I20260709 12:21:16.599613  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:16.599766  7066 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.600338  4983 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:16.600747  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.522655  6934 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:16.603839  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.607501  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:16.607578  7205 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:21:16.608654  7209 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:16.573189  7059 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:16.611196  6598 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.574285  4986 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.612406  7059 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.613481  6598 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.613665  7059 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.606580  7152 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.617373  6960 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.604391  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.602927  7020 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.625509  7020 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.625986  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.627431  7203 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.627974  7203 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.628762  7107 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:16.629196  7107 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.629534  7107 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.630020  7203 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.631559  7091 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:16.632166  7091 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:16.633040  7091 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.633904  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:16.634954  4329 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:16.607914  4991 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:16.636077  6601 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.629922  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:16.643643  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.647346  4329 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:16.648277  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.648699  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:16.652740  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:16.653652  4984 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.654179  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:16.655288  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:16.656054  4987 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.659612  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.627123  6970 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.630986  7203 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:21:16.680787  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.683768  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.667192  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:16.671921  7152 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:16.675457  7202 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:16.676404  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 75727.4us
I20260709 12:21:16.685205  4989 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:16.683208  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.686088  4326 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:16.686024  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.683600  4990 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:16.666330  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.695871  4984 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:16.698002  6930 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:16.648028  7021 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:21:16.683147  6960 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.701020  6960 consensus_queue.cc:1059] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:16.701330  7209 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:16.702932  6930 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:16.705232  6930 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.708706  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.696465  4332 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:16.697448  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.714695  4330 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 4: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:16.694591  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:16.719054  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 73158.2us
I20260709 12:21:16.719726  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.720356  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.684464  7197 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:16.691890  7152 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.737943  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.696036  6908 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:16.695690  7202 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.671442  7066 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:16.737703  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.702263  7203 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:16.660912  7199 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:16.702880  7146 raft_consensus.cc:3055] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:16.748253  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.761978  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.767051  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.702544  6601 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:21:16.702723  7201 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:21:16.774856  4332 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:16.739331  6772 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.740782  7021 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:16.762988  7199 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.787842  7199 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.746780  7197 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.791558  7197 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.793473  7107 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.774003  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.780572  7198 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:16.795637  7198 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.795684  4331 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.796082  7198 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:16.797449  7203 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:16.798568  7203 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.799482  7201 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.799978  6772 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.800485  6772 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.802587  6772 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:16.781483  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:16.784847  7210 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:16.803439  7021 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:16.804390  7021 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.806137  6908 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:16.785018  6601 consensus_queue.cc:1243] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:21:16.785017  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 270993us
I20260709 12:21:16.753110  7152 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:16.810372  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.812532  4986 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:16.702251  6959 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:21:16.752640  6934 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:16.753366  7202 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:16.817850  6960 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:16.764762  7146 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:16.821086  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:16.826627  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:16.826938  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.826960  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:16.826659  7207 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 12:21:16.828051  4404 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:16.832541  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:16.833808  4331 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:16.817445  6601 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:16.834949  4404 pending_rounds.cc:85] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 3
I20260709 12:21:16.839133  4404 pending_rounds.cc:107] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:16.839447  4404 raft_consensus.cc:2889] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:16.836867  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.842000  4986 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:16.842012  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:16.844977  4401 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:21:16.835583  7185 consensus_meta.cc:287] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.007s
I20260709 12:21:16.820534  6934 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.849743  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:16.848925  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:16.825592  7020 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:16.855813  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:16.859361  6970 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:16.845157  7215 raft_consensus.cc:2764] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:21:16.859937  6970 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:16.860515  7213 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:21:16.860954  6970 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:16.861701  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.863180  7060 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:16.863603  7060 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.864097  7060 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.863765  7146 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.865204  7146 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:16.867404  7042 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:16.868178  7042 consensus_queue.cc:1243] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 0aa405b398df42edbf74ee643aeb18dc log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:16.868733  7042 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:16.870608  7042 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:16.863637  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:16.841259  6601 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.889984  4987 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:16.895929  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:16.896790  4405 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:16.871026  7042 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:16.901110  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:16.853230  6934 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.914906  7107 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:16.914707  7187 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:16.916687  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:16.917439  7187 raft_consensus.cc:2764] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:21:16.917959  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:16.918705  7187 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:16.836833  7183 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:21:16.878540  7203 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:16.924376  4401 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:16.898829  6601 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.944299  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:16.908003  7066 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:16.949864  4405 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:16.855799  7198 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.957094  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:16.956113  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55090.8us
I20260709 12:21:16.906349  7185 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.950651  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:16.970752  4401 raft_consensus.cc:2410] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:21:16.908560  7199 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:16.964332  7203 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.958781  7041 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:16.987799  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:16.988422  4408 raft_consensus.cc:1813] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Handling vote request from an unknown peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:16.988852  4408 raft_consensus.cc:2368] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6.
I20260709 12:21:16.956697  6908 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:16.991961  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:16.967211  7187 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:16.979048  7203 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.023610  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.029351  4405 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:17.033345  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.034240  4405 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:17.034442  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51380.9us
I20260709 12:21:16.979737  7185 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.048054  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.048269  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.048779  4408 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:17.048992  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.049549  4401 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.033324  7187 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:17.051383  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.052354  4406 raft_consensus.cc:2393] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:17.039463  7183 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:16.993069  7042 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:17.076144  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 84298.8us
I20260709 12:21:17.076900  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:17.080793  7223 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:21:17.083694  7042 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:17.084295  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:17.086225  7196 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.004s
I20260709 12:21:17.087517  4256 raft_consensus.cc:2410] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:17.092166  7199 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.094521  7060 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.095727  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.096414  4405 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:17.086274  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.098361  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:17.101074  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.101642  4406 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.056058  7183 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:17.055789  7210 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.109220  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.109818  4405 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:17.111195  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:17.106510  7233 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:21:17.114960  4403 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:17.115206  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.117111  4407 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:17.115713  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.118800  4409 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:17.107218  7061 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.107394  7183 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:17.122241  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 77808.6us
I20260709 12:21:17.125487  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:17.128280  7217 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.264s	user 0.003s	sys 0.000s
W20260709 12:21:17.131826  7228 log.cc:927] Time spent T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:17.132124  7185 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.136143  4407 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:17.137162  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.137302  6934 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.137719  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:17.121728  7198 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.140031  7196 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.140585  7196 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.111629  7197 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:17.142521  7196 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.142755  4408 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:17.143630  7197 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:17.146129  7203 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.148610  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.151782  4403 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:17.152443  6934 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:17.167914  7226 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:17.169643  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:17.171844  7201 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.176141  7060 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:17.175882  4401 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:17.176774  7060 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:17.177556  4409 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:17.170987  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.182212  7202 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.185293  7041 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.185701  7059 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:17.186167  7041 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:17.187091  7059 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:17.187546  7059 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:17.188338  7059 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.189172  7152 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.187007  7041 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:17.190364  7041 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:17.190712  7041 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:17.192229  7203 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.191854  7061 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:17.189558  7059 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.195408  7041 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.196648  7041 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.205462  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.206148  4253 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:17.191156  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.211829  4406 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:17.213704  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.214543  4401 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.222519  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.223702  4989 raft_consensus.cc:2410] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:17.229868  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 104462us
I20260709 12:21:17.231876  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.233239  4984 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:17.233542  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.237033  4401 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:17.240398  4253 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:17.241420  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50354us
I20260709 12:21:17.241698  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.242038  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.242331  4255 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:17.242386  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.242743  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.243469  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.244072  4249 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:17.244264  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:17.245608  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.229840  7091 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:17.264430  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:17.265199  4252 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.253693  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.254840  4984 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [7.10-9.11]
I20260709 12:21:17.255398  7232 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.255244  7099 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:17.256054  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.256883  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.257795  4989 pending_rounds.cc:85] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 5
I20260709 12:21:17.273556  4989 pending_rounds.cc:107] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:17.273841  4989 raft_consensus.cc:2889] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.259574  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.259865  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:17.274188  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.261395  4247 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:17.262251  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.278908  4983 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:17.233024  7060 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:21:17.281247  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.263458  7042 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:17.218813  7187 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.268478  4990 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:17.274665  4985 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.260438  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:17.274276  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.286161  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:17.287012  4988 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:21:17.291200  4988 pending_rounds.cc:85] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 6
I20260709 12:21:17.291636  4988 pending_rounds.cc:107] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:21:17.290860  4255 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.283051  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:17.292073  4988 raft_consensus.cc:2889] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.294927  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:17.297461  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.239813  7183 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.294576  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:17.304879  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:17.300745  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:17.313714  7210 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.314201  7210 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.314520  7210 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.315815  7061 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.317082  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:17.292212  7059 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.317691  4983 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.318888  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.319360  7152 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.289456  7197 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:17.320164  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:17.320557  7197 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:17.321352  4984 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:17.322410  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:17.322675  7197 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:17.289119  4991 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:17.323807  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:17.294919  7205 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.324393  4991 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:17.292694  7202 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.285006  7042 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.331756  4984 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:17.348353  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 47702.7us
I20260709 12:21:17.348484  4255 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:17.353554  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.300302  7232 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.355551  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.285131  6601 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:17.373971  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 537529us
I20260709 12:21:17.378398  4983 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:17.381215  7183 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.382135  7183 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:17.384941  6601 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.385774  4400 raft_consensus.cc:2368] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7.
W20260709 12:21:17.392113  7221 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.527s	user 0.000s	sys 0.002s
I20260709 12:21:17.374078  7239 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:21:17.347571  7042 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.410558  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:17.411001  4252 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:17.412477  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:17.416640  4333 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:17.417224  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:17.417634  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:17.418270  4333 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:17.418535  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:17.419557  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:17.420163  4328 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.421767  4983 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:17.357178  7232 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:17.403172  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:17.425010  7232 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.426896  4330 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:17.401310  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:17.408195  7198 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.427675  7198 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.428031  7198 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.407969  7203 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.411201  4326 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:17.432235  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 76769.2us
I20260709 12:21:17.433862  4218 leader_election.cc:400] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6.
I20260709 12:21:17.351455  7107 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.351176  6934 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:17.434810  4333 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:21:17.413744  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 49391.9us
I20260709 12:21:17.471338  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:17.404486  4985 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:17.478555  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:17.482353  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.489018  7199 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.489506  7199 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.489817  4991 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:17.489868  7199 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.491858  4328 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:17.493403  7210 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.362216  7202 consensus_queue.cc:1059] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:21:17.495574  4334 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:17.498629  7197 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.499102  7197 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.499500  7197 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.502893  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:17.506994  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 73879.9us
I20260709 12:21:17.508328  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:17.508453  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.506232  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.505018  6934 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:17.519902  6934 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.506765  7209 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:17.527124  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.528157  4328 raft_consensus.cc:1275] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:17.529613  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.532256  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:17.530678  7107 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.541270  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:17.536876  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 201102us
I20260709 12:21:17.552614  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:17.553694  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.551618  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:17.553334  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:17.596217  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:17.596925  4252 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.597469  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.598392  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:17.598979  4248 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.531049  6598 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.550184  7209 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.613375  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.616268  7239 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.616338  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.617060  7239 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:17.617609  4404 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:17.618481  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.619369  7239 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:17.619818  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.620502  4403 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.620846  4405 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:17.552645  6960 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.625314  4400 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:17.625362  4248 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:17.637352  4252 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:17.583820  7129 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.643754  4250 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:21:17.646201  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 360132us
I20260709 12:21:17.647261  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.647487  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.648455  4406 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:17.601801  7231 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:17.652901  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.655292  4409 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.613245  7202 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.605367  7196 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:17.605350  6970 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.622220  7209 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.579865  6959 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:21:17.650851  7091 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.672423  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.674474  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.612040  7146 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:21:17.725059  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50665.6us
I20260709 12:21:17.727064  4955 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.661595  7210 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:17.663763  7196 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.665556  6960 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:17.731236  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.666075  7209 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.669584  7129 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:17.758634  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 206084us
I20260709 12:21:17.665102  7242 raft_consensus.cc:2764] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:17.788117  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.790613  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:17.792307  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 239060us
W20260709 12:21:17.793978  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67002.7us
W20260709 12:21:17.801208  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 187944us
I20260709 12:21:17.729131  7231 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:17.755975  6934 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.730404  7138 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.803177  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:17.762276  7196 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:17.756877  7066 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:17.791939  7202 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:17.806715  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.831722  4401 raft_consensus.cc:2368] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:17.809393  4400 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:17.807333  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.815455  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:17.728045  7198 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:17.834199  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.792454  6960 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:17.801334  7020 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:17.844130  4406 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:17.848237  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:17.848348  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:17.849431  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55301.2us
I20260709 12:21:17.857825  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.856980  4404 raft_consensus.cc:2376] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11. Re-sending same reply.
I20260709 12:21:17.860924  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:17.861886  4401 raft_consensus.cc:2368] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:17.864004  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:17.865891  4955 connection.cc:256] RPC call timeout handler was delayed by -1.5826346369999555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 12:21:17.803584  7235 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:17.830926  7202 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.870103  4955 leader_election.cc:400] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:17.906720  4955 leader_election.cc:403] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.905781  4408 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:17.808564  7232 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.814579  7185 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 12:21:17.915012  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 99193.4us
I20260709 12:21:17.918208  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.916339  4407 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:17.859138  7020 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.908746  7202 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.921445  4406 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:17.858855  6959 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:17.921418  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.815639  6934 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:17.930392  4329 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:17.931937  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 600) took 1438 ms. Trace:
I20260709 12:21:17.935714  4256 rpcz_store.cc:276] 0709 12:21:16.493487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.494248 (+   761us) service_pool.cc:224] Handling call
0709 12:21:17.928630 (+1434382us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54000852d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:17.931875 (+  3245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322428800}
I20260709 12:21:17.919018  7138 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:17.915567  7235 raft_consensus.cc:697] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:17.949108  6960 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:17.952055  7255 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:17.952667  7232 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:17.944867  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 77960.8us
W20260709 12:21:17.925063  7240 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 12:21:17.954332  4955 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:17.946259  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:17.924716  7020 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:17.955746  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:17.910284  6970 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:21:17.971833  4252 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:21:17.973771  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.974120  4955 leader_election.cc:400] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:17.976606  4955 leader_election.cc:403] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.975762  4409 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
W20260709 12:21:17.960278  7250 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:21:17.961787  7249 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:17.988435  4248 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:21:17.988844  4248 pending_rounds.cc:85] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 2
I20260709 12:21:17.989135  4248 pending_rounds.cc:107] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:21:17.989367  4248 raft_consensus.cc:2889] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.971946  7059 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:21:17.912753  7254 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:21:17.972477  7198 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:17.998720  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:17.947554  7263 consensus_queue.cc:1059] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:17.999140  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:17.952625  7255 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:18.001368  4255 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:17.992002  7066 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.002271  6934 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.003572  7242 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:18.003652  7215 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:18.023622  4334 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:18.026850  7197 consensus_meta.cc:287] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.002s
W20260709 12:21:18.004842  7253 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:21:18.008872  4249 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:17.998517  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:18.032976  6926 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:18.033457  6926 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:17.979887  7146 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:17.982990  6959 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:18.034294  6926 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:18.038595  4403 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:17.987560  4409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:18.010592  7257 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:18.050096  7066 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:18.058199  7257 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:18.059631  7246 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:21:17.948333  7235 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:18.063385  7216 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 1.198s	user 0.006s	sys 0.000s
I20260709 12:21:18.056533  7198 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:21:18.064664  7267 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.055083  7020 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:18.055728  6598 raft_consensus.cc:2764] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:18.065208  7267 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.066296  7268 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:18.014736  7199 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.001s
I20260709 12:21:17.965371  7231 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.083173  7268 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.086104  7268 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.086361  7138 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
W20260709 12:21:18.019333  7247 log.cc:927] Time spent T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 12:21:18.049685  7244 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.260s	user 0.002s	sys 0.001s
I20260709 12:21:18.072976  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:18.054402  7202 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:18.076282  7197 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:18.073809  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 216068us
I20260709 12:21:18.079564  7020 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:18.082644  7270 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:18.086613  7262 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:21:18.116954  7209 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.118227  4405 raft_consensus.cc:2368] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:18.118674  7270 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.057591  4409 raft_consensus.cc:606] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:18.120184  4409 raft_consensus.cc:614] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:18.056742  7274 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:18.121074  7270 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.121238  4247 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:18.121594  7274 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:18.101575  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:18.125798  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:18.126869  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:18.087927  4252 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:18.127854  7129 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:18.128211  4218 leader_election.cc:400] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7.
I20260709 12:21:18.128561  4218 leader_election.cc:403] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.129873  7255 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:18.089372  4325 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:18.115612  4400 raft_consensus.cc:2368] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:18.117048  7197 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.129415  7274 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:18.056938  7260 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:21:18.009851  7041 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:21:18.069196  7196 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:18.138413  7254 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:18.148921  7059 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:18.149955  7202 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:18.084686  7201 consensus_queue.cc:1059] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:21:18.157735  4296 connection.cc:256] RPC call timeout handler was delayed by -2.0707015140001204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:21:18.158674  4296 connection.cc:256] RPC call timeout handler was delayed by -1.4230391690002762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:21:18.159101  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3880900429999201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2898s for a response
I20260709 12:21:18.100224  7199 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.161636  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.157840  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.166033  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:18.169392  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:18.169742  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:18.170321  4988 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:18.172545  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.148269  7209 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.185246  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:18.187805  4983 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:18.201251  4408 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:18.201526  4990 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.152519  7059 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:18.163004  7138 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:18.201304  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 73209.1us
I20260709 12:21:18.210237  4987 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:18.210311  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.210976  4329 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:18.211910  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45998.7us
W20260709 12:21:18.207657  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.247634  4988 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:21:18.248418  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.249078  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.186319  7187 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:18.253979  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:18.260121  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49293.2us
W20260709 12:21:18.262039  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 225861us
I20260709 12:21:18.262662  4986 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:18.202250  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.265193  4987 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 12:21:18.209522  7202 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:18.251817  7042 consensus_meta.cc:287] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.000s
W20260709 12:21:18.269490  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 275364us
I20260709 12:21:18.276479  4219 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:18.239115  4985 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:18.278577  4329 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:18.279520  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:18.280555  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 316061us
I20260709 12:21:18.281746  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:18.283257  4401 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:18.284749  4403 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:21:18.100695  7257 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.292930  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:18.254977  7187 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:18.299108  4990 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:18.292121  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:18.307139  4252 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:18.309044  4988 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:21:18.262833  7271 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:18.308904  4405 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:18.254108  7255 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:21:18.252826  7138 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.323153  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:18.326576  4256 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.287024  7203 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7.
I20260709 12:21:18.327996  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:18.331931  4249 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:18.311590  7187 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:18.287364  7042 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.278908  7091 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:21:18.325862  7278 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.333103  7185 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:18.315212  7254 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:21:18.381772  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.396382  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:18.397488  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 118066us
I20260709 12:21:18.397944  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.398270  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:18.398691  4988 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.403790  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.404582  4985 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:18.366912  7203 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:18.397492  4990 raft_consensus.cc:2393] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:18.358165  7185 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:18.419767  4988 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:18.373488  7199 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.377645  7272 raft_consensus.cc:2764] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:21:18.441691  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 161360us
I20260709 12:21:18.436300  7283 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:18.437004  7059 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.392370  4247 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:18.359791  7188 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:21:18.435096  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:18.390683  7267 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.463091  7042 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:18.464378  7059 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:18.468024  7275 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:21:18.468506  7268 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:18.470876  7268 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:18.368466  7278 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.417353  7196 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:18.477959  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 183791us
I20260709 12:21:18.418962  7203 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.483536  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.491716  4985 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:18.496150  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:18.497768  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.503531  4329 raft_consensus.cc:2393] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:18.503674  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:18.504729  4985 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:21:18.470068  7138 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:18.506628  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:18.513813  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.512934  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.519318  4990 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:18.519501  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.521370  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:18.523412  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:18.507359  7203 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.492627  7202 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:18.513480  7271 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:18.527504  4328 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:18.533130  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:18.513497  7283 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:18.513754  7231 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:18.542693  4990 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:18.478601  7183 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:21:18.560961  4990 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:18.506671  7267 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:21:18.517498  7232 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:21:18.530828  7239 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:21:18.517357  7185 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:18.728543  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.055557  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:18.598878  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:19.062733  4409 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:18.599805  4256 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
W20260709 12:21:19.063251  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 447367us
I20260709 12:21:18.681232  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:18.692036  4408 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:19.064627  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:18.597687  4989 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:21:18.698446  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.610595  4955 leader_election.cc:400] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:19.066825  4955 leader_election.cc:403] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.574736  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:18.672391  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:18.571756  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:19.083460  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:18.592482  7243 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:21:18.590981  7281 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:21:19.109992  7091 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:19.110342  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 570) took 1070 ms. Trace:
I20260709 12:21:19.110548  7091 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:19.055063  7282 log.cc:927] Time spent T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:19.111344  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:19.111543  7091 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.112206  4247 raft_consensus.cc:2368] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:19.110739  4406 rpcz_store.cc:276] 0709 12:21:18.040290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.040429 (+   139us) service_pool.cc:224] Handling call
0709 12:21:18.040851 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.057217 (+ 16366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.057267 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.057856 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.272341 (+214485us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:18.272378 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.272450 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.110134 (+837684us) raft_consensus.cc:1685] finished
0709 12:21:19.110152 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.110282 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15872,"raft.queue_time_us":17255,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":214118,"threads_started":1,"wal-append.queue_time_us":420405}
I20260709 12:21:18.596336  7202 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:18.591187  7276 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:18.592864  7277 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.618s
I20260709 12:21:18.739416  7272 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:19.115484  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 540842us
I20260709 12:21:19.115633  7272 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.117745  7272 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.118005  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:19.118378  7257 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:19.104650  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 494204us
I20260709 12:21:18.607009  7285 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.107551  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:19.108121  4252 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:21:19.110944  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:19.107426  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:18.548858  7268 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.554s
I20260709 12:21:18.558310  7263 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:18.592584  7278 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:18.687600  7066 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.105527  6970 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:19.129472  4257 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:19.081143  7235 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.130280  4955 leader_election.cc:400] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:19.136237  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:19.137110  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:19.128759  4253 raft_consensus.cc:2410] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:19.193940  4249 raft_consensus.cc:2410] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:19.184768  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 66832.2us
I20260709 12:21:19.151661  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:19.105353  7099 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.154785  4256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
W20260709 12:21:19.138214  7300 log.cc:927] Time spent T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 12:21:19.124467  4409 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:18.677887  6960 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.452s
I20260709 12:21:18.591379  7287 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.634s
I20260709 12:21:19.119231  7041 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
I20260709 12:21:19.197304  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.158420  4252 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:19.202643  4256 raft_consensus.cc:606] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:18.856931  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:19.203464  4987 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:21:18.705317  7265 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.758s	user 0.002s	sys 0.001s
I20260709 12:21:18.595250  7269 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:18.818094  7293 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:18.965265  7187 consensus_meta.cc:287] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 12:21:19.204427  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:19.206128  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 86318.1us
I20260709 12:21:19.240357  4990 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:18.743180  6934 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:18.854065  7201 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:18.707527  7291 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:21:18.853657  6926 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:19.119010  7232 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 12:21:19.222357  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 365486us
I20260709 12:21:19.245263  4249 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:21:19.229578  7020 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:19.197547  6970 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:19.203722  4991 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.011s
I20260709 12:21:19.184935  7263 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.244057  6934 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:19.234370  4252 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:21:19.229557  7269 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:19.197721  7305 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:21:18.899854  7283 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.195736  7066 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.129966  7276 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:18.910876  7271 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.244623  7198 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:19.233487  7293 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:19.207849  7099 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:19.276474  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.262745  4255 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:19.198032  7235 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:19.263371  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 157217us
I20260709 12:21:19.257249  7020 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:19.263176  4991 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.003s	sys 0.011s
I20260709 12:21:19.268361  4252 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:19.137974  7285 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.246636  7231 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:21:19.270325  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 974) took 2013 ms. Trace:
I20260709 12:21:19.260648  7232 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:19.243860  7187 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.135389  7292 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 12:21:19.248626  7201 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { replace: true } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.292520  7276 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.265789  7257 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:19.281977  7020 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.283540  7307 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:19.337358  4330 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:19.285372  4992 rpcz_store.cc:276] 0709 12:21:17.254796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:17.258115 (+  3319us) service_pool.cc:224] Handling call
0709 12:21:17.258516 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:17.258984 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:17.259025 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:17.277954 (+ 18929us) log.cc:844] Serialized 26 byte log entry
0709 12:21:17.350762 (+ 72808us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:17.469475 (+118713us) log.cc:844] Serialized 14 byte log entry
0709 12:21:17.469876 (+   401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:17.469940 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:18.028243 (+558303us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b1800441d60. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91522 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:18.480861 (+452618us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b1800441d60. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:19.267980 (+787119us) raft_consensus.cc:1685] finished
0709 12:21:19.268000 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.268117 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5708,"prepare.queue_time_us":83532,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":26779,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7614,"spinlock_wait_cycles":104437504,"thread_start_us":72386,"threads_started":1,"wal-append.queue_time_us":197923}
I20260709 12:21:19.339906  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2058) took 1193 ms. Trace:
I20260709 12:21:19.300076  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:19.288642  7232 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.276007  7310 consensus_queue.cc:1059] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:21:19.342080  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:19.343806  4325 rpcz_store.cc:276] 0709 12:21:18.146220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.146528 (+   308us) service_pool.cc:224] Handling call
0709 12:21:18.146913 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.149313 (+  2400us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:18.150185 (+   872us) log.cc:844] Serialized 14 byte log entry
0709 12:21:18.478845 (+328660us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.493346 (+ 14501us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.493536 (+   190us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:18.493585 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:18.493680 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.339606 (+845926us) raft_consensus.cc:1685] finished
0709 12:21:19.339637 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.339829 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139011,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":141384,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":14080,"thread_start_us":188988,"threads_started":1,"wal-append.queue_time_us":366717}
I20260709 12:21:19.343986  4252 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:19.342219  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:19.351042  4255 raft_consensus.cc:2410] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:19.371658  4252 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:19.342983  7307 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:19.344552  7232 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.350538  7302 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:19.291623  6970 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:19.393086  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 152434us
W20260709 12:21:19.397542  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 194642us
I20260709 12:21:19.398792  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:19.337410  6934 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.334571  7269 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:19.412330  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 132789us
I20260709 12:21:19.415227  7231 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.411700  7198 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:19.414356  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:19.425220  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:19.359583  7293 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.419656  6934 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:19.433441  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:19.421758  7285 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:19.427137  7303 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:21:19.429205  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:19.422487  7066 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.419314  7239 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:21:19.428437  7255 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:19.417408  7091 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:21:19.470260  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:19.439914  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 983) took 1046 ms. Trace:
I20260709 12:21:19.436225  7099 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.401510  7257 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.439555  7231 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:19.462579  7235 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.433307  7314 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:19.480468  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 328866us
I20260709 12:21:19.481321  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:19.439785  7313 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:19.468786  7066 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.504097  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.504868  4325 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:19.472474  7285 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:21:19.505452  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 104567us
I20260709 12:21:19.477329  7201 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.513063  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:19.486778  7187 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.479962  7302 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:19.530987  7309 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:21:19.509150  7323 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.531769  7302 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.532506  7323 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.508466  7255 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:19.534524  7255 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:19.534912  7255 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.530393  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:19.535667  4255 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:19.530603  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:19.536834  4406 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:19.539615  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:19.488972  7319 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:19.434960  7307 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.494972  7198 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.509479  7314 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.549084  7311 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.549649  7311 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.506659  7099 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:21:19.551826  7322 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:21:19.538758  7323 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:19.553350  7203 consensus_meta.cc:287] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 1.004s	user 0.008s	sys 0.004s
I20260709 12:21:19.554116  7311 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:19.553810  7203 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:19.555115  7059 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.090s	user 0.014s	sys 0.000s
I20260709 12:21:19.556126  7203 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.557108  7311 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.557829  7311 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.536703  7231 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:21:19.560447  4250 raft_consensus.cc:2368] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6.
I20260709 12:21:19.565775  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.566577  4325 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 3.
I20260709 12:21:19.570709  4325 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.512316  7066 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.579784  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:19.589295  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:19.551095  7314 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.535503  7235 consensus_queue.cc:1059] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:21:19.593464  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.604308  7020 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.606797  7020 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.570372  7326 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:19.607908  7020 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:19.608031  7326 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.609606  7020 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:19.610733  7317 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.610852  7326 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.578810  7187 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.583540  7203 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:21:19.593077  7325 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.611325  7317 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.612636  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.478669  4991 rpcz_store.cc:276] 0709 12:21:18.388910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.409645 (+ 20735us) service_pool.cc:224] Handling call
0709 12:21:18.434108 (+ 24463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:18.434730 (+   622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.434794 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:18.435563 (+   769us) log.cc:844] Serialized 26 byte log entry
0709 12:21:18.517489 (+ 81926us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:19.296400 (+778911us) log.cc:844] Serialized 14 byte log entry
0709 12:21:19.419577 (+123177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.425124 (+  5547us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.426688 (+  1564us) raft_consensus.cc:1685] finished
0709 12:21:19.426704 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.434983 (+  8279us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":218030,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":175858,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":5621,"thread_start_us":869093,"threads_started":3,"wal-append.queue_time_us":255603}
I20260709 12:21:19.613473  7263 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.616801  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:19.619164  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.579772  7321 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.622413  7235 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:19.624442  7301 log.cc:927] Time spent T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.392s	user 0.003s	sys 0.000s
I20260709 12:21:19.635164  7321 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.635159  7235 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:19.627648  7311 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:19.636957  7235 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.637542  7321 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:19.638031  7305 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:19.638273  7235 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:19.638447  7305 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:19.595053  7059 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:19.614837  7328 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:19.639755  7328 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:19.633309  7325 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.640820  7328 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:19.641989  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.642132  7328 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:19.589615  7307 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:19.642795  4983 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:21:19.633917  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.644951  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 729) took 1079 ms. Trace:
W20260709 12:21:19.651808  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.645396  4983 rpcz_store.cc:276] 0709 12:21:18.565966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.571410 (+1005444us) service_pool.cc:224] Handling call
0709 12:21:19.644751 (+ 73341us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400512054. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:19.644893 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120982912}
I20260709 12:21:19.663370  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.620007  7187 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.620895  7313 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:19.672204  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:19.635671  7066 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:19.697398  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 571) took 1017 ms. Trace:
I20260709 12:21:19.697798  4401 rpcz_store.cc:276] 0709 12:21:18.679925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.680142 (+   217us) service_pool.cc:224] Handling call
0709 12:21:18.680523 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:18.680925 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:18.680959 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:19.082496 (+401537us) log.cc:844] Serialized 52 byte log entry
0709 12:21:19.420303 (+337807us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:19.508097 (+ 87794us) log.cc:844] Serialized 14 byte log entry
0709 12:21:19.691626 (+183529us) log.cc:844] Serialized 14 byte log entry
0709 12:21:19.697089 (+  5463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.697164 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:19.697205 (+    41us) raft_consensus.cc:1685] finished
0709 12:21:19.697217 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:19.697345 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601,"prepare.queue_time_us":173972,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":79604,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":32107,"thread_start_us":556150,"threads_started":3,"wal-append.queue_time_us":394174}
I20260709 12:21:19.703099  4331 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:19.673235  7321 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.672959  7059 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:19.642051  7325 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:19.706264  7321 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.667502  7308 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.695957  7041 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:19.715088  7313 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:19.652880  7305 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:19.728127  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:19.706532  7285 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:19.727422  7041 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.728226  7308 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.721262  7287 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.747188  7232 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.748198  7317 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.749402  7187 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.848704  7269 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:19.761739  7306 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
W20260709 12:21:19.786742  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.769258  7321 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.806334  7235 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.770669  7285 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.855834  7235 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.858296  7235 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.761309  7287 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.861661  7310 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:19.862352  7310 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.864698  7310 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.816470  7317 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:19.866400  7317 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.869046  7317 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.765558  7255 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.733172  4219 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:19.848503  7308 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.849123  4325 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:19.852077  7041 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.883073  7185 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.890691  7287 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:19.887856  4149 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 6 to 7, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.755818  7059 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.769496  6934 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:19.749358  7232 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:19.771926  4333 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:19.887871  7305 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:19.911053  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 177947us
W20260709 12:21:19.889101  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.909372  7235 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.923321  7293 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:19.923753  7283 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:19.931087  7283 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.927587  6934 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:19.931507  7283 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:19.933116  6934 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:19.928095  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.922426  4404 raft_consensus.cc:2410] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:19.779160  7313 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:19.967746  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:19.968114  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 497479us
I20260709 12:21:19.966966  4149 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 4 to 5, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 5 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:19.960753  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 457903us
W20260709 12:21:19.971846  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 392124us
W20260709 12:21:19.979784  4404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 574) took 1290 ms (client timeout 1611 ms). Trace:
W20260709 12:21:19.980191  4404 rpcz_store.cc:269] 0709 12:21:18.680889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:18.681008 (+   119us) service_pool.cc:224] Handling call
0709 12:21:19.961703 (+1280695us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54002440d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:19.971108 (+  9405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972499712}
I20260709 12:21:19.984660  4955 leader_election.cc:400] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7.
W20260709 12:21:19.986774  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:19.959508  7337 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:20.041786  7185 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:20.042349  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:20.042872  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:20.042981  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 371885us
I20260709 12:21:20.041996  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:20.026679  4983 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:20.042960  4990 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:20.027742  4992 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:20.026163  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:19.988117  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:20.044582  4986 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.010187  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:20.049161  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 77742.9us
W20260709 12:21:20.049351  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 72772.4us
I20260709 12:21:20.050216  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:20.051534  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:19.962128  7235 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.056306  4252 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:20.056432  4253 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 12:21:20.057607  4987 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.057775  4249 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:20.058171  4331 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.058528  4331 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:20.057893  4149 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.041898  7339 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:19.975060  7041 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.986119  7321 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:20.005549  7313 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:20.082983  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.083803  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:20.059269  4250 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:20.087682  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:20.090266  4328 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:20.090776  4256 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:20.057667  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:20.088021  4253 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:21:20.092125  4985 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:19.986573  7323 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:20.094087  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:20.050006  7268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.008s	sys 0.011s
I20260709 12:21:20.085618  4149 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:19.983459  7317 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.115355  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:20.094452  4249 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:21:20.055841  7314 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.025658  7329 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:20.120774  4153 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 260) took 15538 ms (client timeout 15000 ms). Trace:
I20260709 12:21:20.059849  7325 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:20.160121  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 183854us
I20260709 12:21:20.158176  4149 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.164486  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:20.161527  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:20.049757  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:20.088605  4331 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.043861  7343 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:20.094684  7187 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.201051  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:20.202015  4331 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.114806  7239 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:20.202288  4404 raft_consensus.cc:606] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:20.203817  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.209167  4986 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
W20260709 12:21:20.202316  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 136349us
I20260709 12:21:20.238679  4404 raft_consensus.cc:614] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:20.239573  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 80127.8us
I20260709 12:21:20.094388  7041 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.119591  7263 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:20.221236  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:20.122893  7268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.010s	sys 0.013s
W20260709 12:21:20.238399  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:20.252008  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.115991  7338 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:20.169186  7314 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.281345  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:20.282707  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:20.260279  4218 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.735s (SENT)
I20260709 12:21:20.258590  4987 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:20.088362  7339 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:20.170989  7341 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:21:20.286782  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 118706us
I20260709 12:21:20.120048  7348 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:20.048322  7337 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:20.284986  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 44165.9us
I20260709 12:21:20.165483  7349 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.253064  4149 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 3, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.119500  7323 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:20.291167  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52238.8us
I20260709 12:21:20.114951  7310 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.292347  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:20.293999  4249 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:20.221196  6960 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:20.118207  7321 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:20.296967  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 181680us
I20260709 12:21:20.336813  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:20.167486  4153 rpcz_store.cc:269] 0709 12:21:04.577432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.577820 (+   388us) service_pool.cc:224] Handling call
0709 12:21:20.114418 (+15536598us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:16.105596 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:16.139479 (+ 33883us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:16.139544 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:21:16.139568 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:16.140798 (+  1230us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:16.140879 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:16.140909 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:21:16.279360 (+138451us) tablet.cc:701] Row locks acquired
0709 12:21:16.279413 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:21:16.279593 (+   180us) write_op.cc:270] Start()
0709 12:21:16.298563 (+ 18970us) write_op.cc:276] Timestamp: P: 1783599676279525 usec, L: 0
0709 12:21:16.298590 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:21:16.325563 (+ 26973us) log.cc:844] Serialized 4301 byte log entry
0709 12:21:17.053072 (+727509us) op_driver.cc:464] REPLICATION: finished
0709 12:21:17.292764 (+239692us) write_op.cc:301] APPLY: starting
0709 12:21:17.306446 (+ 13682us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:17.482929 (+176483us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:17.500938 (+ 18009us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:17.794230 (+293292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:17.936303 (+142073us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:21:17.948740 (+ 12437us) write_op.cc:312] APPLY: finished
0709 12:21:17.949135 (+   395us) log.cc:844] Serialized 83 byte log entry
0709 12:21:17.949321 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:17.949454 (+   133us) write_op.cc:454] Released schema lock
0709 12:21:17.949514 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:17.949943 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:17.949970 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":943518,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":172057,"apply.run_cpu_time_us":6443,"apply.run_wall_time_us":676714,"num_ops":11,"prepare.queue_time_us":142825,"prepare.run_cpu_time_us":35080,"prepare.run_wall_time_us":472962,"raft.queue_time_us":162871,"raft.run_cpu_time_us":20904,"raft.run_wall_time_us":224809,"replication_time_us":742239,"thread_start_us":479028,"threads_started":4,"wal-append.queue_time_us":319290,"wal-append.run_cpu_time_us":41017,"wal-append.run_wall_time_us":2306892}]]}
I20260709 12:21:20.215132  4991 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.227495  7285 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.290813  4253 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:20.313786  7340 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.325393  4331 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:21:20.325803  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.287596  7343 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.252861  6970 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.288690  7314 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.329214  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:20.328706  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:20.203511  7329 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.220983  7257 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:21:20.120121  7302 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 12:21:20.436139  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:20.436866  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:20.228269  7325 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:21:20.329888  4149 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 3, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.214999  7187 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:20.451110  7352 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:21:20.452312  7187 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.333621  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:20.338989  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 78733.7us
W20260709 12:21:20.453817  7345 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:21:20.372781  4249 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:20.316035  7318 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.260519  7239 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.321719  7255 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:20.468149  4218 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.745s (SENT) [suppressed 14 similar messages]
I20260709 12:21:20.315490  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa405b398df42edbf74ee643aeb18dc not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41690
W20260709 12:21:20.339013  7333 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 12:21:20.389277  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:20.482574  4404 raft_consensus.cc:606] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:20.391222  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 62596.6us
I20260709 12:21:20.213850  7328 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:20.386638  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:20.379264  7344 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:20.204282  7317 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.395066  4254 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:20.380134  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:20.407109  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:20.286401  7263 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.338107  6960 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:20.445046  4219 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:20.330518  7349 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.339076  7353 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:20.289932  7338 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:20.449566  7347 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:21:20.339149  7310 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.453763  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:20.324012  4257 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:20.456007  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:20.461509  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.465181  4149 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 1 to 3, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 3 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.388198  7285 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.474426  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:20.472002  7209 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.395923  7231 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:20.485944  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:20.486694  4990 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:20.542119  4248 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
W20260709 12:21:20.586567  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 12:21:20.370290  7348 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:21:20.598100  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:20.599888  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2375) took 1034 ms. Trace:
W20260709 12:21:20.546283  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 101365us
W20260709 12:21:20.574515  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 245376us
I20260709 12:21:20.583386  4255 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:20.585667  4992 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:20.388413  7343 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.395764  7340 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.595752  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:20.486469  7328 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:20.399472  6970 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.613271  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:20.599126  4149 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:20.548461  7351 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:21:20.609689  4983 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.600405  4329 rpcz_store.cc:276] 0709 12:21:19.565222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.568270 (+  3048us) service_pool.cc:224] Handling call
0709 12:21:19.568615 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:19.591790 (+ 23175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:19.591822 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:19.621374 (+ 29552us) log.cc:844] Serialized 26 byte log entry
0709 12:21:19.891159 (+269785us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:19.891308 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:19.891385 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:20.599636 (+708251us) raft_consensus.cc:1685] finished
0709 12:21:20.599665 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:20.599818 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16473,"raft.queue_time_us":42096,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10443,"thread_start_us":263257,"threads_started":1,"wal-append.queue_time_us":424278}
I20260709 12:21:20.483246  7312 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:20.571396  7353 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.633177  7353 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:20.546216  7099 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:20.637408  4250 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:20.637804  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.642316  4983 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:20.584349  7235 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.574643  7255 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:20.653661  4404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
W20260709 12:21:20.655393  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.689527  4404 raft_consensus.cc:606] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:20.689888  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.689987  4404 raft_consensus.cc:614] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:20.696573  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:20.605880  7183 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:20.664520  7329 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.665905  7339 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.667477  7239 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.608793  4247 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:20.671221  7099 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.675628  6926 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.607808  7187 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:20.633929  7328 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:20.606215  7307 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:20.634133  7271 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:21:20.638362  7324 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:20.706127  4325 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 12:21:20.805014  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 336902us
I20260709 12:21:20.805464  4325 pending_rounds.cc:85] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 9
I20260709 12:21:20.638929  7231 consensus_queue.cc:1059] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:21:20.779157  7338 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.549611  7344 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.691985  7312 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.769855  7317 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.770427  6926 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.771574  7349 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.773185  7358 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.773248  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:20.776933  7283 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.845s	user 0.007s	sys 0.003s
I20260709 12:21:20.780943  6970 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.781508  7239 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.912257  7239 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.768180  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:20.917349  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:20.918309  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:20.484378  7318 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:20.805739  4218 leader_election.cc:336] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.747s (SENT)
W20260709 12:21:20.919875  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 114162us
W20260709 12:21:20.920441  4218 leader_election.cc:336] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.757s (SENT)
I20260709 12:21:20.920820  7318 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.805823  4325 pending_rounds.cc:107] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:21:20.922787  4325 raft_consensus.cc:2889] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:20.644613  7356 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:20.809283  4984 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:20.923735  7356 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:20.637019  7209 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:20.924721  7356 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.926085  7209 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:20.804419  7305 consensus_meta.cc:287] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.000s
W20260709 12:21:20.804234  7293 consensus_meta.cc:287] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.874s	user 0.006s	sys 0.006s
I20260709 12:21:20.788198  7359 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:20.927735  7359 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.929929  7359 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.701192  7255 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.931928  7255 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.809047  7268 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:20.803040  6960 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:20.933024  6960 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:20.935075  7287 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:20.935738  7362 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.935626  7287 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.936225  7362 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.806694  7187 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:20.801541  7329 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:21:20.906977  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.871663  7183 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:20.808468  7307 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:20.950093  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.903414  7257 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.967554  7257 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:20.938532  7283 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:20.899792  7321 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:20.958318  7287 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:20.958619  7313 consensus_meta.cc:287] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.002s
I20260709 12:21:20.959081  4990 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:21:20.959226  7362 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.960426  6926 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.961814  7263 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.962554  7310 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:20.962647  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:20.990873  4985 raft_consensus.cc:2410] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:20.965724  4989 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [7.10-9.11]
W20260709 12:21:20.992352  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 389481us
I20260709 12:21:20.993920  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:20.995440  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:20.984144  4990 pending_rounds.cc:85] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 7
I20260709 12:21:20.948328  7183 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:20.988847  4325 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:20.996512  4990 pending_rounds.cc:107] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:21:20.996789  4990 raft_consensus.cc:2889] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:20.989287  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:20.997408  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.989537  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:20.966789  7355 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.420s	user 0.003s	sys 0.000s
I20260709 12:21:20.998172  4329 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:21.005620  4955 leader_election.cc:400] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6.
I20260709 12:21:21.005929  4955 leader_election.cc:403] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:21:21.007309  4333 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:21:21.007694  4333 pending_rounds.cc:85] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:21:21.007925  4333 pending_rounds.cc:107] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:21:21.008150  4333 raft_consensus.cc:2889] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:21.013732  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:20.915066  7239 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:21.015321  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.019878  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:21.017169  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:21.023608  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:21.047956  4989 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:21.050683  4329 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:21.051122  4329 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:21.026862  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:21.053658  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:21.007552  7321 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:21.017884  7235 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:20.903893  7358 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.053797  4332 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:21.046706  4325 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:21.017028  6926 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.077695  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:21.079407  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:21.084537  4989 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:21.022828  7059 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6.
I20260709 12:21:21.044634  7361 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.084687  4327 raft_consensus.cc:2393] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:21.047444  6970 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.059801  7235 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.083984  7239 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:21.046773  7255 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.086556  7185 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:21.086397  6926 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.101497  7255 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:21.053007  7276 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.048955  7319 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:21.057955  7183 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.116570  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:21.119922  7235 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:21.121290  7255 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:21.117694  4991 consensus_meta.cc:287] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.004s
I20260709 12:21:21.102533  7276 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.058950  7359 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:21:21.149735  4250 consensus_meta.cc:287] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.005s
I20260709 12:21:21.271718  4250 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:21.177737  4327 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:21:21.101591  7185 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.087442  4329 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:21.277124  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 271613us
I20260709 12:21:21.113411  7321 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:21.132483  7310 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:21.269538  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.014s	sys 0.015s
W20260709 12:21:21.297901  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.016s
W20260709 12:21:21.298316  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 694060us
I20260709 12:21:21.299074  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:21.291632  4329 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:21.293974  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.132215  7305 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:21.300802  4401 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
W20260709 12:21:21.202272  7365 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:21:21.200163  7374 tablet_replica.cc:333] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:21:21.182091  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 64914.7us
I20260709 12:21:21.112869  6970 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:21.306398  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.124868  7239 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:21.320195  4986 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:21.281693  7185 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:21.346679  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.346635  4406 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:21.346621  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.350647  4401 raft_consensus.cc:2410] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:21:21.288611  7059 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.288757  7232 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:21.357107  4408 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:21.057392  7187 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.305094  7379 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.117952  7361 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:21.366403  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:21.289722  7283 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:21.376453  4955 connection.cc:256] RPC call timeout handler was delayed by -1.5653049599995938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 12:21:21.371464  7310 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.414376  7379 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.130035  7319 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.424289  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.431146  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:21.181031  4991 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:21.132539  7353 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.427726  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.427977  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.444798  4406 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:21.445242  4329 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:21.426970  4327 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:21.433434  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.373440  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.446048  4400 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:21.383289  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.445611  4329 pending_rounds.cc:85] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 3
I20260709 12:21:21.446710  4329 pending_rounds.cc:107] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:21.447067  4329 raft_consensus.cc:2889] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:21.322624  7349 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.448160  4402 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:21.446300  4401 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:21:21.444679  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 134916us
I20260709 12:21:21.456086  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:21.454568  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.462997  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:21.363829  7344 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:21.463938  4401 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
W20260709 12:21:21.449366  7328 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 12:21:21.317402  7305 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:21.498777  7339 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:21.445899  7329 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:21.374960  7232 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:21.374765  7059 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:21.644464  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.058130  4409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.020s	sys 0.032s
W20260709 12:21:22.098448  4409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.021s	sys 0.033s
I20260709 12:21:22.101291  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:21.786198  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 423646us
I20260709 12:21:21.794301  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1814) took 1475 ms. Trace:
W20260709 12:21:21.844995  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 388963us
I20260709 12:21:22.105906  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2077) took 1413 ms. Trace:
W20260709 12:21:22.106245  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:21.466614  4991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 734) took 1492 ms (client timeout 1520 ms). Trace:
I20260709 12:21:22.106647  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:22.110126  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.098037  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.106345  4333 rpcz_store.cc:276] 0709 12:21:20.692105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.692270 (+   165us) service_pool.cc:224] Handling call
0709 12:21:20.692636 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.020426 (+327790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.105681 (+1085255us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54002f21d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:22.105848 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722837760}
I20260709 12:21:22.112296  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.105144  4256 rpcz_store.cc:276] 0709 12:21:20.319205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.319438 (+   233us) service_pool.cc:224] Handling call
0709 12:21:20.332991 (+ 13553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.373370 (+ 40379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.373404 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.373979 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.806264 (+432285us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:20.806304 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.806377 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:21.793959 (+987582us) raft_consensus.cc:1685] finished
0709 12:21:21.794003 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:21.794215 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5937,"raft.queue_time_us":6104,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9524,"thread_start_us":323635,"threads_started":1,"wal-append.queue_time_us":574273}
I20260709 12:21:21.463019  7307 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.113884  4219 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:22.096599  7339 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:21.499399  7257 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:22.136309  7339 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.062142  7358 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.136771  7325 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:22.137406  7339 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:22.137817  7305 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:22.138226  7387 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.655s	user 0.001s	sys 0.000s
I20260709 12:21:22.138420  7305 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:22.138845  7363 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:21:22.146122  4989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.015s	sys 0.001s
W20260709 12:21:22.146522  4989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.015s	sys 0.001s
I20260709 12:21:22.147142  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.147578  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 992) took 1177 ms. Trace:
I20260709 12:21:22.147776  4409 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:21.977494  7391 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 12:21:21.499069  7350 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:21.978536  7386 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.491s	user 0.000s	sys 0.001s
W20260709 12:21:21.720878  7373 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.346s	user 0.000s	sys 0.000s
W20260709 12:21:21.888921  7367 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.793s	user 0.001s	sys 0.000s
I20260709 12:21:22.155036  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.164492  4327 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:22.139709  7394 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:21:22.148298  4989 rpcz_store.cc:276] 0709 12:21:20.970503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.093103 (+122600us) service_pool.cc:224] Handling call
0709 12:21:21.120006 (+ 26903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.120224 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:21.282146 (+161922us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.147081 (+864935us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.147220 (+   139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.147257 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:22.147321 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.147392 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.147519 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":378417,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":1026022,"threads_started":2}
I20260709 12:21:21.501286  7328 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.099699  7379 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:21.499404  7369 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.138507  7324 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.127508  7356 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:22.111866  7329 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.197762  7329 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:22.199424  4201 auto_rebalancer.cc:629] Failed to schedule move for tablet 8afcac1f47834987ac3889edd37f61a3: Illegal state: Replica 899897e6794541b5ab538af361fc9e6c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:22.033529  7353 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.178030  7398 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:22.035310  7263 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.920162  7378 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:22.124693  7361 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:22.179390  7379 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.163156  7350 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:22.209134  6960 consensus_meta.cc:287] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.276s	user 0.014s	sys 0.003s
I20260709 12:21:22.153303  7307 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.245811  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 737) took 1631 ms. Trace:
W20260709 12:21:22.167542  7314 consensus_meta.cc:287] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.707s	user 0.013s	sys 0.000s
W20260709 12:21:22.272665  4297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.059s	sys 0.068s
W20260709 12:21:22.273016  4297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.059s	sys 0.068s
I20260709 12:21:22.181663  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:21.499601  7377 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:22.191833  7343 consensus_meta.cc:287] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.552s	user 0.013s	sys 0.000s
I20260709 12:21:22.192234  7319 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.193096  7305 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:22.195050  7235 consensus_meta.cc:287] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.013s	user 0.006s	sys 0.003s
I20260709 12:21:22.165159  7239 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.204286  4329 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:22.168673  7276 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.171149  4409 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:21.467715  7349 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.184631  7324 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.225798  6926 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.226959  7360 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:22.290004  7360 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:22.291038  7360 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.291975  7360 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:22.184221  7369 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.206693  7398 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.293502  7398 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.294081  7340 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.294843  7369 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.294924  7305 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:22.296306  7305 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.297767  7328 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.222092  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2393) took 1128 ms. Trace:
I20260709 12:21:21.719538  7271 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:22.299702  7271 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:22.299479  4326 rpcz_store.cc:276] 0709 12:21:21.093506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.093674 (+   168us) service_pool.cc:224] Handling call
0709 12:21:21.094066 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.094468 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.094519 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.125987 (+ 31468us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.271009 (+145022us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:21.271046 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.271109 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:22.221814 (+950705us) raft_consensus.cc:1685] finished
0709 12:21:22.221841 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.222020 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13633,"thread_start_us":144725,"threads_started":1,"wal-append.queue_time_us":342080}
W20260709 12:21:22.301173  7388 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:21:22.302239  7271 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.303565  7310 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:22.304586  7397 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:21.626457  7321 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.236546  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2390) took 1182 ms. Trace:
I20260709 12:21:22.251344  4992 rpcz_store.cc:276] 0709 12:21:20.614786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.616054 (+  1268us) service_pool.cc:224] Handling call
0709 12:21:20.646450 (+ 30396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:21.020683 (+374233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:21.020713 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:21.021173 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.271179 (+250006us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:21.271278 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.271396 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:22.245547 (+974151us) raft_consensus.cc:1685] finished
0709 12:21:22.245576 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.245736 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169994,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":32130,"thread_start_us":522539,"threads_started":2,"wal-append.queue_time_us":326295}
I20260709 12:21:22.308805  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:22.309449  4992 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:22.308314  4328 rpcz_store.cc:276] 0709 12:21:21.053955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.054203 (+   248us) service_pool.cc:224] Handling call
0709 12:21:21.054566 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:21.054831 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:21.379929 (+325098us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.236042 (+856113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:22.236118 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:22.236192 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.236289 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.236469 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125624,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":378442,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":1173929,"threads_started":3,"wal-append.queue_time_us":802672}
I20260709 12:21:22.310294  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:22.241035  7313 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:22.273506  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 169527us
W20260709 12:21:22.311280  7185 consensus_meta.cc:287] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.936s	user 0.009s	sys 0.000s
I20260709 12:21:22.312041  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 736) took 2333 ms. Trace:
I20260709 12:21:22.312508  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.312405  4984 rpcz_store.cc:276] 0709 12:21:19.978430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.978561 (+   131us) service_pool.cc:224] Handling call
0709 12:21:20.025463 (+ 46902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.923765 (+898302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:22.311754 (+1387989us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54005311d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:22.311962 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801859328}
I20260709 12:21:22.313120  4409 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:22.313529  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:22.313655  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:22.314471  4955 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:22.273756  4983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 738) took 1598 ms (client timeout 2006 ms). Trace:
W20260709 12:21:22.273543  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.304804  7285 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.275117  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1816) took 2185 ms. Trace:
I20260709 12:21:22.229905  7395 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:22.227732  7372 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:21:22.317642  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.318390  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:22.318703  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.281929  7235 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.317574  4252 rpcz_store.cc:276] 0709 12:21:20.089354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.089599 (+   245us) service_pool.cc:224] Handling call
0709 12:21:20.090067 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.161309 (+ 71242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.161359 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.447247 (+285888us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b2c00028038. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbaf677a11 00007fdbaf687372 00007fdbb0db9a01 00007fdbb0d7e43a 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2
0709 12:21:20.447771 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:21:20.859392 (+411621us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:20.859433 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:20.859504 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:22.274813 (+1415309us) raft_consensus.cc:1685] finished
0709 12:21:22.274835 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.275050 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69426,"raft.queue_time_us":70534,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":36101,"spinlock_wait_cycles":4948864,"thread_start_us":295745,"threads_started":1,"wal-append.queue_time_us":538174}
I20260709 12:21:22.319854  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:22.316757  4983 rpcz_store.cc:269] 0709 12:21:20.675593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.181371 (+1505778us) service_pool.cc:224] Handling call
0709 12:21:22.273679 (+ 92308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.320711  7329 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:22.321090  7329 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.321167  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:22.321388  7235 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.321493  7329 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:22.321789  4983 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:22.322067  7235 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:22.322494  7235 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:22.317843  7395 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:22.323597  4983 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:21:22.323844  4401 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:22.322841  6926 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.324018  7395 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.324430  6926 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.324970  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.325677  4401 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:22.326459  6926 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.326654  4400 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:22.240473  4989 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:22.230541  7379 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:22.279063  7343 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:22.200444  7356 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.341370  7323 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:22.341725  7356 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.343017  7343 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:22.315780  7066 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:22.344033  7066 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.344379  7066 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:22.345005  4403 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:22.274151  7314 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.304273  7398 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:22.317056  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.348644  4987 raft_consensus.cc:2393] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:22.350097  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.230418  7378 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.319168  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.328164  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 990) took 1363 ms. Trace:
I20260709 12:21:22.323967  4983 pending_rounds.cc:85] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 5
I20260709 12:21:22.365022  4983 pending_rounds.cc:107] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:21:22.365347  4983 raft_consensus.cc:2889] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:22.114327  4991 rpcz_store.cc:269] 0709 12:21:19.970171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.973531 (+  3360us) service_pool.cc:224] Handling call
0709 12:21:21.453944 (+1480413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:22.332026  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:22.339417  7369 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:22.339680  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:22.339989  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.341043  4405 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:21:22.341200  7379 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.374837  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:22.363564  4988 rpcz_store.cc:276] 0709 12:21:20.965167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.967804 (+  2637us) service_pool.cc:224] Handling call
0709 12:21:20.968232 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:20.968690 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:20.968734 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:20.969291 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:21:21.371545 (+402254us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:21.371585 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:21.371653 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:22.327991 (+956338us) raft_consensus.cc:1685] finished
0709 12:21:22.328010 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:22.328112 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410,"raft.queue_time_us":3583,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11563,"thread_start_us":401809,"threads_started":1,"wal-append.queue_time_us":1208525}
I20260709 12:21:22.377805  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.378111  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.378696  4252 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:22.354344  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.354511  4992 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:22.355911  7349 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.380085  7349 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:22.380393  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.380569  7349 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:22.380599  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.381800  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.381637  7349 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.242144  7263 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:22.385838  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.382831  4219 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:22.397854  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.399156  4249 raft_consensus.cc:2410] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:22.403052  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.271250  7307 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.357088  4406 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:21:22.367162  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 260629us
I20260709 12:21:22.328974  7276 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.322857  7235 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:22.422663  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.424664  4252 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:22.368047  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.374078  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 730) took 2037 ms. Trace:
I20260709 12:21:22.408726  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.427237  4403 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:22.410269  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.428350  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.411504  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.429327  4257 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:22.413058  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.426156  4987 rpcz_store.cc:276] 0709 12:21:20.336402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.336566 (+   164us) service_pool.cc:224] Handling call
0709 12:21:22.373840 (+2037274us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400648554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:22.374008 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4624779136}
I20260709 12:21:22.431182  4400 raft_consensus.cc:2410] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 10.
I20260709 12:21:22.356083  7398 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.415771  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.417510  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.426432  4405 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 4: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:22.373483  7369 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.447450  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.428149  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.452768  4409 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:22.414723  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:22.383936  7392 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:21:22.436179  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.454423  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:22.457880  4257 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:22.311699  7185 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.465390  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.460045  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:22.463434  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 66302.7us
I20260709 12:21:22.466019  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:22.466616  4988 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:22.466648  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.396431  7269 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:22.467957  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:22.469168  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.470096  4405 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:22.518982  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.416961  7366 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:21:22.606114  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.482247  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:22.614055  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:22.614409  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:22.572502  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:22.606263  4402 raft_consensus.cc:2368] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9.
I20260709 12:21:22.478022  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.620551  4409 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:22.620695  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.621668  4325 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:22.482957  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.623211  4248 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:22.577358  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.417163  6926 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:22.525667  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.586551  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.543452  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.627628  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.439112  7354 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.669360  4325 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 3.
I20260709 12:21:22.669898  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:22.670611  4406 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:22.671438  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 204946us
I20260709 12:21:22.672696  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.674831  4405 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:22.676488  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:22.443773  7059 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.458931  7369 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:22.668789  4256 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:22.677639  4988 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:22.543244  7323 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.690274  4400 raft_consensus.cc:2393] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:22.673449  4257 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:22.545555  7402 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.236s
I20260709 12:21:22.613481  7314 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:22.614202  7366 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:22.543598  7343 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.445117  7276 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.545442  7399 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.321s
I20260709 12:21:22.692415  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:23.140413  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.850943  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 156851us
I20260709 12:21:22.705471  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.122047  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:23.057581  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.144279  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.111783  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:23.146018  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.146047  4333 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:23.127071  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:22.869604  4408 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:23.146831  4325 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:23.147437  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:23.147502  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.148813  4408 raft_consensus.cc:2410] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:21:23.097936  4372 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.006s	sys 0.003s
I20260709 12:21:23.150017  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.151064  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.717561  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.151935  4983 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:23.153133  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:22.721549  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.152240  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.154546  4401 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:23.150106  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 562434us
I20260709 12:21:23.146898  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.155668  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:23.448801  4406 raft_consensus.cc:2376] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7. Re-sending same reply.
W20260709 12:21:23.297490  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.204270  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.328583  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:23.450274  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.450343  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.248206  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.450801  4256 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:23.422770  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.154815  4325 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:23.353971  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.202936  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:23.320176  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 212885us
I20260709 12:21:23.329087  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.459187  4257 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:23.155335  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:23.324983  4255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.011s
W20260709 12:21:23.460319  4255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.006s	sys 0.013s
I20260709 12:21:23.460722  4218 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:22.978837  4409 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:23.461503  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2414) took 1131 ms. Trace:
I20260709 12:21:23.355439  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:23.381930  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:23.453116  4958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.006s	sys 0.013s
I20260709 12:21:23.331606  4252 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.378778  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:23.461746  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:23.465747  4407 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 6: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:23.432399  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:23.461875  4409 rpcz_store.cc:276] 0709 12:21:22.330063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.467659 (+137596us) service_pool.cc:224] Handling call
0709 12:21:23.461445 (+993786us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:23.465687  4958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.006s	sys 0.014s
I20260709 12:21:22.716795  7293 raft_consensus.cc:993] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
W20260709 12:21:23.469468  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:22.720624  7407 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:21:22.845499  7271 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:23.512719  4406 raft_consensus.cc:1275] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:21:23.465489  4408 raft_consensus.cc:2376] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8. Re-sending same reply.
I20260709 12:21:22.672340  6926 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.510149  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.511873  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:22.845098  7415 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.123s	user 0.000s	sys 0.004s
I20260709 12:21:23.510439  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:23.451061  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:23.423668  7418 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 12:21:23.523516  4328 raft_consensus.cc:2410] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:21:23.523639  4248 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:23.485216  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:23.140712  7366 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:23.529986  4401 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:21:23.516986  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2411) took 1187 ms. Trace:
I20260709 12:21:23.530764  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2412) took 1201 ms. Trace:
I20260709 12:21:23.513875  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:23.356657  7382 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.327252  7324 consensus_meta.cc:287] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.969s	user 0.012s	sys 0.000s
I20260709 12:21:22.712920  7307 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:23.072661  7405 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.326s	user 0.000s	sys 0.000s
W20260709 12:21:23.424551  7235 consensus_meta.cc:287] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.966s	user 0.008s	sys 0.004s
I20260709 12:21:23.520781  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2418) took 1189 ms. Trace:
I20260709 12:21:23.521418  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:22.714285  7185 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:23.052021  7263 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.137315  7232 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:22.848661  7041 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.523113  4333 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.522907  4252 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:23.524370  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.524739  4985 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.378185  7269 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.018221  7350 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:22.721169  7409 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:22.693225  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:22.729749  6970 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:22.827657  7059 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:23.143687  7332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.003s	sys 0.007s
I20260709 12:21:23.531184  4401 rpcz_store.cc:276] 0709 12:21:22.329507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.470640 (+1141133us) service_pool.cc:224] Handling call
0709 12:21:23.529669 (+ 59029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.530524 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.530710 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.531185  4406 rpcz_store.cc:276] 0709 12:21:22.329145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.481328 (+1152183us) service_pool.cc:224] Handling call
0709 12:21:23.512247 (+ 30919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.516740 (+  4493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.516932 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.531701  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2416) took 1201 ms. Trace:
W20260709 12:21:23.531754  4296 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.009s	sys 0.017s
W20260709 12:21:23.517576  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 55899.6us
I20260709 12:21:22.692910  7337 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:23.485438  7338 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:22.744494  7066 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.514235  7417 raft_consensus.cc:1081] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:23.539160  4409 rpcz_store.cc:276] 0709 12:21:22.331186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.509009 (+1177823us) service_pool.cc:224] Handling call
0709 12:21:23.509409 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.509641 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.509679 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.509750 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:23.509805 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.509876 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.520728 (+ 10852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.485186  7268 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:22.689801  7354 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.155182  7343 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.716886  7329 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.525918  6926 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.424291  6934 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:21:22.719463  7323 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:22.717214  7356 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:23.552886  7412 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.623s	user 0.002s	sys 0.000s
I20260709 12:21:23.525492  7271 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:23.611114  4985 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:23.654554  4983 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:21:23.637609  4296 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.009s	sys 0.021s
I20260709 12:21:23.741787  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 754) took 1051 ms. Trace:
W20260709 12:21:23.742086  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 1.10526e+06us
I20260709 12:21:23.742148  4985 rpcz_store.cc:276] 0709 12:21:22.690789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.484896 (+794107us) service_pool.cc:224] Handling call
0709 12:21:23.741728 (+256832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.698962  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2420) took 1362 ms. Trace:
I20260709 12:21:23.654400  4989 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:23.704159  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 65491.4us
I20260709 12:21:23.742892  4401 rpcz_store.cc:276] 0709 12:21:22.336215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.638520 (+1302305us) service_pool.cc:224] Handling call
0709 12:21:23.698399 (+ 59879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.698599 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.698645 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.698687 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:23.698718 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.698780 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.698891 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:23.744660  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.550807  7324 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:23.747140  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:23.654170  7329 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.626632  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:23.628432  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 747) took 1327 ms. Trace:
I20260709 12:21:23.714676  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.565423  7235 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:23.739090  7369 consensus_meta.cc:287] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.981s	user 0.004s	sys 0.006s
I20260709 12:21:23.751613  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2430) took 1176 ms. Trace:
I20260709 12:21:23.722766  4333 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:23.753207  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:23.637820  4400 rpcz_store.cc:276] 0709 12:21:22.330617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.179665 (+849048us) service_pool.cc:224] Handling call
0709 12:21:23.531642 (+351977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.753741  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2425) took 1316 ms. Trace:
I20260709 12:21:23.718215  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 597) took 1333 ms. Trace:
W20260709 12:21:23.737272  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 304970us
I20260709 12:21:23.743588  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.657653  4409 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:23.654088  7066 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.745319  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:23.704202  7099 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:23.700582  7354 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.655215  4988 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:23.611506  7269 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:23.553555  7314 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:23.637732  7409 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.748876  4328 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:23.749297  4986 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:23.707255  7343 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:23.704607  7183 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:23.651315  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 126976us
I20260709 12:21:23.751005  4992 rpcz_store.cc:276] 0709 12:21:22.301035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.310086 (+  9051us) service_pool.cc:224] Handling call
0709 12:21:23.628227 (+1318141us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5400512a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:23.628361 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100448000}
I20260709 12:21:23.606729  7185 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:23.754164  4401 rpcz_store.cc:276] 0709 12:21:22.437553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.744315 (+1306762us) service_pool.cc:224] Handling call
0709 12:21:23.753405 (+  9090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.753537 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.753551 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.753579 (+    28us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:23.753597 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.753630 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.753700 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.681887  7059 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.755770  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 755) took 1057 ms. Trace:
I20260709 12:21:23.756139  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2424) took 1407 ms. Trace:
I20260709 12:21:23.754227  4406 rpcz_store.cc:276] 0709 12:21:22.384464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.707214 (+1322750us) service_pool.cc:224] Handling call
0709 12:21:23.717534 (+ 10320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.717782 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.717819 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.717876 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:23.717928 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.718006 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.718144 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.758270  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.754384  4405 rpcz_store.cc:276] 0709 12:21:22.575316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.626237 (+1050921us) service_pool.cc:224] Handling call
0709 12:21:23.751546 (+125309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.550418  7382 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.759169  7338 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.760309  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:23.622074  7313 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:23.751319  7370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.004s	sys 0.014s
I20260709 12:21:23.768630  7312 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:23.772034  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.824430  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2396) took 1683 ms. Trace:
I20260709 12:21:23.824743  4333 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 4.
I20260709 12:21:23.824841  4329 rpcz_store.cc:276] 0709 12:21:22.141189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.142554 (+  1365us) service_pool.cc:224] Handling call
0709 12:21:22.142881 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.277753 (+134872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.824187 (+1546434us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54002f3ad4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:23.824372 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140804864}
I20260709 12:21:23.825742  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:23.826210  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.826371  4333 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.826821  4329 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:23.780603  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 746) took 1479 ms. Trace:
I20260709 12:21:23.780705  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.777451  7276 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:23.827913  4992 raft_consensus.cc:2410] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:21:23.825670  7271 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.828506  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 754) took 1157 ms. Trace:
I20260709 12:21:23.781847  4404 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:23.783026  4327 raft_consensus.cc:2393] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:23.828771  4401 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:23.829480  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2428) took 1363 ms. Trace:
I20260709 12:21:23.828899  4992 rpcz_store.cc:276] 0709 12:21:22.671136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.780452 (+1109316us) service_pool.cc:224] Handling call
0709 12:21:23.828450 (+ 47998us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:23.830192  7419 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:21:23.830813  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.831974  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.827450  4984 rpcz_store.cc:276] 0709 12:21:22.300747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.328775 (+ 28028us) service_pool.cc:224] Handling call
0709 12:21:22.355656 (+ 26881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.355986 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.356017 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.356420 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:21:22.596429 (+240009us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:22.613710 (+ 17281us) log.cc:844] Serialized 14 byte log entry
0709 12:21:23.624014 (+1010304us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18002f8b40. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb0d76060 00007fdbb0d88716 00007fdbb0d99287 00007fdbb0d99208
0709 12:21:23.737889 (+113875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.737967 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.778224 (+ 40257us) raft_consensus.cc:1685] finished
0709 12:21:23.780377 (+  2153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.780528 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17150,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":11474,"raft.queue_time_us":539235,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":32756,"spinlock_wait_cycles":30560512,"thread_start_us":353295,"threads_started":2,"wal-append.queue_time_us":365274}
I20260709 12:21:23.833374  7366 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.781399  7185 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.834558  7185 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.786621  4985 rpcz_store.cc:276] 0709 12:21:22.698597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.743231 (+1044634us) service_pool.cc:224] Handling call
0709 12:21:23.755712 (+ 12481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.796751  7338 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.835783  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.835988  7338 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.836516  4985 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:23.837363  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.838305  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:23.799496  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:23.777628  7360 consensus_meta.cc:287] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.485s	user 0.008s	sys 0.004s
I20260709 12:21:23.793519  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:23.805471  7370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.005s	sys 0.014s
I20260709 12:21:23.807847  7437 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:23.845709  7366 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.846527  7337 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:21:23.848935  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 70724.8us
I20260709 12:21:23.845662  4333 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:23.851697  4333 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:23.854873  7337 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:23.856933  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.857817  4254 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:23.858407  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 623) took 1482 ms. Trace:
I20260709 12:21:23.858425  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 743) took 1558 ms. Trace:
I20260709 12:21:23.859091  4986 rpcz_store.cc:276] 0709 12:21:22.299860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.303542 (+  3682us) service_pool.cc:224] Handling call
0709 12:21:22.303918 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.775847 (+1471929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.858164 (+ 82317us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400637ed4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:23.858351 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3323666688}
I20260709 12:21:23.860706  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:23.861367  4986 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:23.862174  7378 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:23.865567  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:23.867841  4987 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:23.869030  7426 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.869675  7426 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.777024  7314 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.873726  7314 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.875592  7059 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:23.809624  7428 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:21:23.877445  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 628) took 1465 ms. Trace:
I20260709 12:21:23.797238  7350 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:21:23.878283  7350 consensus_queue.cc:1243] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:23.879643  7350 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.877868  4255 rpcz_store.cc:276] 0709 12:21:22.412515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.412707 (+   192us) service_pool.cc:224] Handling call
0709 12:21:22.442356 (+ 29649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:22.604421 (+162065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.604453 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:22.638054 (+ 33601us) log.cc:844] Serialized 26 byte log entry
0709 12:21:23.460752 (+822698us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:23.700481 (+239729us) log.cc:844] Serialized 14 byte log entry
0709 12:21:23.700949 (+   468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.701028 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:23.877176 (+176148us) raft_consensus.cc:1685] finished
0709 12:21:23.877205 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.877374 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286282,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":946,"raft.queue_time_us":140144,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":25064,"thread_start_us":1053449,"threads_started":3,"wal-append.queue_time_us":811589}
I20260709 12:21:23.811012  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.880016  7350 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:23.880440  7350 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.880980  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.881191  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.882341  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.882447  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.883006  4248 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:23.883360  7439 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:23.811370  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.812023  4257 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:23.885454  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:23.885870  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.886214  4255 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:23.886930  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.888123  4257 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:23.889292  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 48898.3us
I20260709 12:21:23.826865  7323 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.890089  4956 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:23.887069  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.833925  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.782567  4409 rpcz_store.cc:276] 0709 12:21:22.348270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.638550 (+1290280us) service_pool.cc:224] Handling call
0709 12:21:23.638871 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.755874 (+117003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.756068 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:23.841028  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 47599us
I20260709 12:21:23.890803  7323 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:23.820452  7424 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 12:21:23.891198  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:23.892270  7323 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.892611  7323 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.892941  7323 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.894083  7354 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.894563  7354 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.841796  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 756) took 1108 ms. Trace:
I20260709 12:21:23.895567  4984 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:23.895440  4985 rpcz_store.cc:276] 0709 12:21:22.733746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.838110 (+1104364us) service_pool.cc:224] Handling call
0709 12:21:23.841741 (+  3631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.829860  4401 rpcz_store.cc:276] 0709 12:21:22.465754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.779029 (+1313275us) service_pool.cc:224] Handling call
0709 12:21:23.828450 (+ 49421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.829279 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.829432 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.896458  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.896648  7354 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:23.895067  4218 connection.cc:256] RPC call timeout handler was delayed by -1.0977287249997971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:21:23.897455  4218 leader_election.cc:336] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.745s (SENT)
I20260709 12:21:23.897553  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.897915  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:23.878317  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.898222  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 744) took 1423 ms. Trace:
I20260709 12:21:23.752985  7369 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.884831  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:23.898626  4985 rpcz_store.cc:276] 0709 12:21:22.474793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.897342 (+1422549us) service_pool.cc:224] Handling call
0709 12:21:23.898176 (+   834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.887457  4253 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:23.827982  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.900254  4329 raft_consensus.cc:2410] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:23.901104  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1823) took 3428 ms. Trace:
W20260709 12:21:23.901707  4250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1818) took 3683 ms (client timeout 2076 ms). Trace:
I20260709 12:21:23.901927  7399 consensus_queue.cc:1243] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:21:23.902114  4250 rpcz_store.cc:269] 0709 12:21:20.203687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.220903 (+ 17216us) service_pool.cc:224] Handling call
0709 12:21:23.887116 (+3666213us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400120554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:23.887247 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804979968}
I20260709 12:21:23.902521  7323 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:23.895136  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2398) took 1751 ms. Trace:
I20260709 12:21:23.903606  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.904224  4991 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:23.903505  4330 rpcz_store.cc:276] 0709 12:21:22.143845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.144107 (+   262us) service_pool.cc:224] Handling call
0709 12:21:22.144316 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:22.144457 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:22.387115 (+242658us) log.cc:844] Serialized 14 byte log entry
0709 12:21:22.477916 (+ 90801us) log.cc:844] Serialized 14 byte log entry
0709 12:21:23.894697 (+1416781us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b1800142180. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc0bc0a 00007fdbb734b219 00007fdbadc93a40 00007fdbadc8e4e4 00007fdbadc8e455 00007fdbb0d76060 00007fdbb0d88716 00007fdbb0d99287 00007fdbb0d99208
0709 12:21:23.894824 (+   127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:23.894869 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:23.894912 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.894968 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:23.895080 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1360511,"prepare.queue_time_us":236083,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1424502,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":48475,"spinlock_wait_cycles":394075008,"thread_start_us":315665,"threads_started":2,"wal-append.queue_time_us":642267}
I20260709 12:21:23.904773  7323 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.828831  7271 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:23.907232  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.907568  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:23.908428  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1357850829999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 12:21:23.896452  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:23.908816  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1357850829999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:21:23.909174  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0853850829998919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:21:23.909309  4402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1637) took 1591 ms (client timeout 1520 ms). Trace:
W20260709 12:21:23.909520  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0457850829998279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 12:21:23.907017  4256 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
W20260709 12:21:23.909741  4402 rpcz_store.cc:269] 0709 12:21:22.317515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.318492 (+   977us) service_pool.cc:224] Handling call
0709 12:21:23.909109 (+1590617us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002440d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:23.909248 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615593728}
I20260709 12:21:23.909185  4985 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:23.910975  4984 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:21:23.911204  7307 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.911623  4985 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:23.911715  7307 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:23.912375  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 748) took 1290 ms. Trace:
I20260709 12:21:23.912765  4985 rpcz_store.cc:276] 0709 12:21:22.621969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.911168 (+1289199us) service_pool.cc:224] Handling call
0709 12:21:23.911448 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.912128 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.912323 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.914117  7307 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.911629  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 747) took 1385 ms. Trace:
I20260709 12:21:23.905210  4991 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:23.914857  4984 rpcz_store.cc:276] 0709 12:21:22.525834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.910442 (+1384608us) service_pool.cc:224] Handling call
0709 12:21:23.910740 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.911399 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.911580 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.832969  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.915856  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 743) took 1442 ms. Trace:
I20260709 12:21:23.916031  4992 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:23.916316  4991 rpcz_store.cc:276] 0709 12:21:22.473499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.904785 (+1431286us) service_pool.cc:224] Handling call
0709 12:21:23.905057 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.915558 (+ 10501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.915791 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:23.858866  4254 rpcz_store.cc:276] 0709 12:21:22.376098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.377409 (+  1311us) service_pool.cc:224] Handling call
0709 12:21:23.856783 (+1479374us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59eee 000000000036eb39 00007fdbb5ccd1e0 00007fdbb5d960c4 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:23.858334 (+  1551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3768320}
W20260709 12:21:23.922957  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 72914.2us
I20260709 12:21:23.892869  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:23.777108  7409 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.794255  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:23.901449  4253 rpcz_store.cc:276] 0709 12:21:20.472571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.548903 (+ 76332us) service_pool.cc:224] Handling call
0709 12:21:23.887257 (+3338354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.899376 (+ 12119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:23.900939 (+  1563us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b5400120550. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:23.901053 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7600546048}
I20260709 12:21:23.926661  4328 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.927870  4992 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:23.760905  7417 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:21:23.842635  7313 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.938562  4984 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:23.905162  7356 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:23.940258  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:23.940924  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:23.946631  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:23.949321  4991 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:23.804497  7433 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 12:21:23.950512  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:23.949147  7268 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.956005  7435 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:23.956444  7435 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.939174  7323 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:21:23.956820  7435 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:23.956979  7323 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:23.957499  7323 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:23.958873  4986 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:23.932207  7187 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:21:23.959632  7305 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:23.960496  7305 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:23.961622  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:23.968737  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.970007  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:23.962569  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:23.969374  4330 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:23.974324  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:23.975123  4330 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:23.978139  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.977237  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:23.960855  7305 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:23.982645  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:23.993886  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:23.973876  7312 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:23.998725  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:24.005003  4991 raft_consensus.cc:2376] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6. Re-sending same reply.
W20260709 12:21:24.006201  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 43710.5us
I20260709 12:21:23.979192  7356 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:23.980963  7403 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:23.962252  7099 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:24.018213  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:24.020607  4328 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:24.020848  4984 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:24.018854  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:24.024564  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:24.027835  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:24.038811  7323 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.041128  7269 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.042630  7271 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.020654  7312 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:24.048197  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:24.048243  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:24.048784  6926 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.048970  7312 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.049965  4984 pending_rounds.cc:85] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 4
I20260709 12:21:24.050280  4984 pending_rounds.cc:107] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:21:24.050545  4984 raft_consensus.cc:2889] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:24.013024  7337 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:24.051771  4247 raft_consensus.cc:2368] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9.
I20260709 12:21:24.052147  7403 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:24.052409  7437 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:24.052718  7403 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:24.053043  7437 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:24.045074  7350 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.050801  7305 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.055562  4330 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:24.057713  4333 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:24.051700  7337 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:24.014091  7356 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.060355  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:24.062922  4991 raft_consensus.cc:2393] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:24.053730  7403 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.021888  7324 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.059985  7337 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.079916  4991 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:24.064077  7356 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.063913  6926 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:24.086360  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:24.083004  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 67768.8us
I20260709 12:21:24.054108  7437 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.082212  7305 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:24.099797  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:24.124164  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 226714us
I20260709 12:21:24.089094  4956 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:24.125626  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.126245  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:24.127871  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:24.129151  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:24.129772  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:24.131747  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:24.133975  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:24.135499  7360 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:24.136190  7360 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:24.137151  7360 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.139350  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:24.135389  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 157955us
I20260709 12:21:24.166602  7402 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:24.167392  7402 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.175585  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:24.176368  4402 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.090322  7382 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:24.197445  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 68351.8us
I20260709 12:21:24.200063  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.206215  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:24.206578  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.208720  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.209390  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:24.087344  7325 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:21:24.149967  7314 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:24.149807  7349 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:24.242277  4991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:21:24.224249  7268 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.223933  7417 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:24.148259  7271 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.241767  7314 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:24.205157  7269 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:24.279031  7350 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.279277  7453 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.280112  7460 raft_consensus.cc:2764] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:21:24.281515  7440 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:24.288388  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 714) took 1098 ms. Trace:
W20260709 12:21:24.289237  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 73717.1us
W20260709 12:21:24.309731  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.255743  7349 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:24.319659  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.321727  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2413) took 1991 ms. Trace:
I20260709 12:21:24.322260  4407 rpcz_store.cc:276] 0709 12:21:22.329796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.486226 (+1156430us) service_pool.cc:224] Handling call
0709 12:21:23.527451 (+ 41225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.854083 (+326632us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b18002b5dc0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb0d76060 00007fdbb0d76bfb 00007fdbb0d8164b
0709 12:21:23.854258 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.854297 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.854939 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.097086 (+242147us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:24.320919 (+223833us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.321197 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.321298 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.321347 (+    49us) raft_consensus.cc:1685] finished
0709 12:21:24.321476 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.321649 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180309,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":4503,"spinlock_wait_cycles":62220544,"thread_start_us":537301,"threads_started":3,"wal-append.queue_time_us":427294}
I20260709 12:21:24.318343  4327 rpcz_store.cc:276] 0709 12:21:23.190244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.829622 (+639378us) service_pool.cc:224] Handling call
0709 12:21:23.889231 (+ 59609us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59eee 000000000036eb39 00007fdbb5ccd1e0 00007fdbb5d960c4 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:23.889412 (+   181us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:23.943212 (+ 53800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.943244 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:23.945257 (+  2013us) log.cc:844] Serialized 52 byte log entry
0709 12:21:24.085667 (+140410us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:24.085711 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.085792 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.287986 (+202194us) raft_consensus.cc:1685] finished
0709 12:21:24.288016 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.288308 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64652,"raft.queue_time_us":51465,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":1236,"spinlock_wait_cycles":28210304,"thread_start_us":133925,"threads_started":1,"wal-append.queue_time_us":260388}
I20260709 12:21:24.326704  4991 raft_consensus.cc:606] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:24.327113  4991 raft_consensus.cc:614] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:24.289732  7314 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:24.277217  7323 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.289819  7417 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:24.289359  7446 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:24.343997  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:24.292685  7324 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:21:24.325770  7307 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.277626  7185 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:24.360617  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 151301us
I20260709 12:21:24.315078  7453 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.366791  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 739) took 2177 ms. Trace:
I20260709 12:21:24.329556  7338 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.358331  7446 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:24.332226  7269 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:21:24.375413  7417 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.367249  4990 rpcz_store.cc:276] 0709 12:21:22.189867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.206938 (+ 17071us) service_pool.cc:224] Handling call
0709 12:21:22.209584 (+  2646us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:22.211989 (+  2405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:22.212023 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:22.222876 (+ 10853us) log.cc:844] Serialized 78 byte log entry
0709 12:21:23.880009 (+1657133us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b1800434620. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:24.135546 (+255537us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:24.325479 (+189933us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.326121 (+   642us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.326461 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.327548 (+  1087us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.366508 (+ 38960us) raft_consensus.cc:1685] finished
0709 12:21:24.366535 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.366731 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7553,"prepare.queue_time_us":206747,"raft.queue_time_us":17269,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":20308,"spinlock_wait_cycles":9919872,"thread_start_us":367025,"threads_started":2,"wal-append.queue_time_us":2043920}
W20260709 12:21:24.364344  7183 consensus_meta.cc:287] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.008s
I20260709 12:21:24.397382  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2419) took 2061 ms. Trace:
I20260709 12:21:24.366406  7232 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:21:24.363024  7263 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:24.400643  7462 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:21:24.421393  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 78141.4us
I20260709 12:21:24.401005  7451 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:21:24.416599  7445 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:21:24.397775  4400 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:24.428694  7458 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:21:24.437883  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:24.436561  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68888.5us
I20260709 12:21:24.435753  4408 rpcz_store.cc:276] 0709 12:21:22.335879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.526234 (+1190355us) service_pool.cc:224] Handling call
0709 12:21:23.556786 (+ 30552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.748889 (+192103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:23.748931 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.749675 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.013580 (+263905us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:24.239322 (+225742us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.239857 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.240066 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.397175 (+157109us) raft_consensus.cc:1685] finished
0709 12:21:24.397198 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.397323 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6116,"prepare.queue_time_us":332583,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3595,"raft.queue_time_us":189138,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":3876,"thread_start_us":622193,"threads_started":3,"wal-append.queue_time_us":335494}
W20260709 12:21:24.432951  7457 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.074s	user 0.001s	sys 0.002s
I20260709 12:21:24.440335  4334 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:21:24.442365  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:24.450284  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.363749  7307 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.453193  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.386502  7349 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.459095  4218 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.461373  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:24.451889  7462 consensus_queue.cc:1243] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:24.475749  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 753) took 1808 ms. Trace:
I20260709 12:21:24.457557  7453 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.462594  7324 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:24.476191  4985 rpcz_store.cc:276] 0709 12:21:22.667472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.913598 (+1246126us) service_pool.cc:224] Handling call
0709 12:21:23.913889 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.914267 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:23.914299 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:23.914780 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.148436 (+233656us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:24.148505 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.148591 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.475531 (+326940us) raft_consensus.cc:1685] finished
0709 12:21:24.475551 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.475672 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3101,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4626,"thread_start_us":219736,"threads_started":1,"wal-append.queue_time_us":471477}
W20260709 12:21:24.475852  4983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 751) took 1842 ms (client timeout 1753 ms). Trace:
I20260709 12:21:24.481460  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:24.481130  4983 rpcz_store.cc:269] 0709 12:21:22.633315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.152908 (+519593us) service_pool.cc:224] Handling call
0709 12:21:24.475630 (+1322722us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400603bd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:24.475781 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151249664}
I20260709 12:21:24.482095  4985 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:24.482990  4983 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:24.483075  4985 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:24.484380  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55413.1us
I20260709 12:21:24.451522  7466 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:21:24.473145  7452 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:24.513787  4401 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:24.514007  7452 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:24.486604  7465 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:21:24.458629  7350 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:21:24.493397  7409 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260709 12:21:24.494083  7185 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:24.495679  7435 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.004s
I20260709 12:21:24.498441  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:24.498211  7356 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.493422  7338 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.511654  7307 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.511545  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:24.463275  7446 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:24.512655  4407 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:24.480567  7462 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:24.512712  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:24.513273  7437 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:24.553781  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:24.512740  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:24.521840  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2092) took 1373 ms. Trace:
I20260709 12:21:24.514940  7452 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.525494  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:24.526064  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:24.510953  7268 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:24.538842  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:24.551486  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:24.554570  4255 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:21:24.477526  7471 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:24.557672  4404 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:24.562153  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:24.557986  4326 rpcz_store.cc:276] 0709 12:21:23.148437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.148558 (+   121us) service_pool.cc:224] Handling call
0709 12:21:23.148832 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:23.901861 (+753029us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:24.093019 (+191158us) log.cc:844] Serialized 14 byte log entry
0709 12:21:24.315707 (+222688us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:24.316202 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:21:24.316351 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:24.316384 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.316450 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:24.521656 (+205206us) raft_consensus.cc:1685] finished
0709 12:21:24.521672 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:24.521786 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":752630,"prepare.queue_time_us":380053,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":777375,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":14072,"thread_start_us":294216,"threads_started":2,"wal-append.queue_time_us":212953}
I20260709 12:21:24.567588  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:24.604252  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:24.606083  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:24.606647  4408 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.607511  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:24.607540  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:24.565574  7232 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:24.599427  7464 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:24.609161  7232 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:24.609385  7464 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.610176  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:24.610303  7232 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.609126  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:24.611496  7232 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.611524  7464 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.612102  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:24.612486  7464 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:24.612897  4257 raft_consensus.cc:2410] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:21:24.613003  7464 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.613835  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:24.615338  7464 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.628023  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:24.631029  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 107294us
W20260709 12:21:24.631510  4955 connection.cc:256] RPC call timeout handler was delayed by -1.6712152980003339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:21:24.631788  4955 connection.cc:256] RPC call timeout handler was delayed by -1.6208152980002524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 12:21:24.622326  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:24.551388  7435 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.561805  7462 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:24.608050  7452 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:24.632120  4955 connection.cc:256] RPC call timeout handler was delayed by -1.2356152980000843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 12:21:24.625461  7481 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.539584  7409 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:24.631870  7313 consensus_meta.cc:287] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
I20260709 12:21:24.625594  7307 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.616513  7471 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:24.599469  7337 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.646694  4408 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:24.647794  4406 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:24.649222  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:24.646780  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.635788  7462 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:24.633934  7466 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:24.651808  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.635854  7464 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:24.657466  7305 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:24.658088  7235 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.664238  7472 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:24.661589  7409 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:24.661921  7469 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:21:24.652509  7360 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:24.676065  7464 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:24.665594  7325 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:24.648366  7377 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:21:24.646849  7313 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.648274  7323 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:24.714955  7482 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:24.715451  7482 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:24.716342  7482 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:24.717401  7430 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 1.106s	user 0.004s	sys 0.011s
W20260709 12:21:24.703662  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.710369  7464 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:24.700703  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 49548.8us
I20260709 12:21:24.684988  7471 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.644121  7481 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.734113  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2427) took 2273 ms. Trace:
I20260709 12:21:24.737214  7369 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.741961  7481 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.743324  7481 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:24.743476  7464 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.707402  4404 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:24.687175  7356 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:24.713227  7314 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.717463  7482 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:24.649214  7307 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:24.744062  7481 consensus_queue.cc:1243] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:24.666150  7466 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:24.734653  4400 rpcz_store.cc:276] 0709 12:21:22.461076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.754207 (+1293131us) service_pool.cc:224] Handling call
0709 12:21:23.762431 (+  8224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:24.447460 (+685029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.733867 (+286407us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003c7dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:24.734046 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406179712}
I20260709 12:21:24.747856  7313 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.748744  7435 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.749102  7314 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:24.750324  4990 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:24.752674  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:24.755110  7478 log.cc:927] Time spent T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:21:24.708942  7472 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:24.663858  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:24.765028  7307 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.852327  4326 raft_consensus.cc:1240] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:24.854679  4403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2421) took 2513 ms (client timeout 3348 ms). Trace:
I20260709 12:21:24.724169  7337 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:24.861711  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:24.856784  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 122695us
W20260709 12:21:25.176128  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.028355  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:24.986363  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:24.766001  7325 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.290237  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:25.288072  4403 rpcz_store.cc:269] 0709 12:21:22.347332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.752407 (+2405075us) service_pool.cc:224] Handling call
0709 12:21:24.854602 (+102195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:25.072072  4987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 752) took 2434 ms (client timeout 1756 ms). Trace:
W20260709 12:21:25.111466  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.049428  4334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 2079) took 4061 ms (client timeout 3166 ms). Trace:
W20260709 12:21:25.121984  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:24.986217  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 745) took 2685 ms. Trace:
W20260709 12:21:24.856875  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 193149us
I20260709 12:21:25.299695  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:24.850286  7406 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 2.176s	user 0.005s	sys 0.010s
W20260709 12:21:25.304297  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.352254  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 62072.2us
I20260709 12:21:25.304523  4332 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:25.353567  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:25.355481  4253 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:21:25.355146  4987 rpcz_store.cc:269] 0709 12:21:22.637979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.154235 (+516256us) service_pool.cc:224] Handling call
0709 12:21:25.071784 (+1917549us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400499654. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.071965 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940752768}
W20260709 12:21:25.356593  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.357795  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:25.358312  4250 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
W20260709 12:21:25.078958  7467 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.628s	user 0.007s	sys 0.006s
I20260709 12:21:25.358500  4989 rpcz_store.cc:276] 0709 12:21:22.300452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.327500 (+ 27048us) service_pool.cc:224] Handling call
0709 12:21:22.354121 (+ 26621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:23.743097 (+1388976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.985917 (+1242820us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400522954. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:24.986127 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2989928832}
I20260709 12:21:25.360606  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:25.048206  7437 raft_consensus.cc:993] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
W20260709 12:21:25.353024  4334 rpcz_store.cc:269] 0709 12:21:20.987901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.989223 (+  1322us) service_pool.cc:224] Handling call
0709 12:21:25.049094 (+4059871us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b5400104fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.049293 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7802630400}
I20260709 12:21:25.046679  7263 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:24.917410  7480 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:21:25.364004  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:24.942883  7426 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:24.945432  7464 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:24.857736  7356 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:25.358004  7337 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.039798  7433 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:25.044471  7402 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:25.357890  7293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.042s
W20260709 12:21:24.856536  7422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.221s	user 0.045s	sys 0.056s
I20260709 12:21:25.384877  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:24.915517  7466 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:25.360031  7483 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:24.860378  7462 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.381165  7325 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:25.365121  7314 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.378288  7263 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:24.925359  7472 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:25.387795  7422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.781s	user 0.057s	sys 0.083s
I20260709 12:21:25.385823  7437 raft_consensus.cc:1081] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:25.390695  7356 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:25.389290  7483 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:25.385442  7426 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:25.387943  7433 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:25.420567  7483 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:25.426326  7462 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.456136  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:25.458662  4327 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:25.383486  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:25.460443  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 104531us
I20260709 12:21:25.460788  4329 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:25.379040  4330 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:25.363269  4332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:21:25.464401  4332 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.464949  4332 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:25.467932  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:25.468779  4333 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:25.472424  4371 connection.cc:256] RPC call timeout handler was delayed by -1.9940860770002473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 12:21:25.473228  4371 connection.cc:256] RPC call timeout handler was delayed by -1.8662860770004954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:21:25.473709  4371 connection.cc:256] RPC call timeout handler was delayed by -1.6952860770002189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 12:21:25.474109  4371 connection.cc:256] RPC call timeout handler was delayed by -1.6898860770002102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:21:25.474536  4371 connection.cc:256] RPC call timeout handler was delayed by -1.6349860770005762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 12:21:25.474916  4371 connection.cc:256] RPC call timeout handler was delayed by -1.2596860770004241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24960000000000002s for a response
W20260709 12:21:25.477468  4247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 636) took 2882 ms (client timeout 1834 ms). Trace:
W20260709 12:21:25.478148  4247 rpcz_store.cc:269] 0709 12:21:22.594986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.615308 (+ 20322us) service_pool.cc:224] Handling call
0709 12:21:25.476695 (+2861387us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b540001f4d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.477063 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793924864}
W20260709 12:21:25.480386  4252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 635) took 2908 ms (client timeout 2054 ms). Trace:
I20260709 12:21:25.480443  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:25.481307  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:25.481097  4252 rpcz_store.cc:269] 0709 12:21:22.572018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:22.572182 (+   164us) service_pool.cc:224] Handling call
0709 12:21:25.479829 (+2907647us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54002b43d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.480117 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646750080}
I20260709 12:21:25.482378  4987 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:25.483460  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:25.483798  4249 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:21:25.484164  4988 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 749) took 2857 ms (client timeout 1638 ms). Trace:
I20260709 12:21:25.484594  4992 raft_consensus.cc:2368] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9.
W20260709 12:21:25.484664  4988 rpcz_store.cc:269] 0709 12:21:22.626422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.146674 (+520252us) service_pool.cc:224] Handling call
0709 12:21:25.483703 (+2337029us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540049c354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.483926 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452956544}
I20260709 12:21:25.487159  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 759) took 1087 ms. Trace:
I20260709 12:21:25.487576  4330 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:25.487782  4990 rpcz_store.cc:276] 0709 12:21:24.399274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.435436 (+ 36162us) service_pool.cc:224] Handling call
0709 12:21:25.486607 (+1051171us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54004d6a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.486908 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696437632}
I20260709 12:21:25.487269  7263 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.490342  7263 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:25.388846  7293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.008s	sys 0.055s
I20260709 12:21:25.404361  7325 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.497530  7325 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.501097  7305 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:25.502508  7305 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.490262  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:25.480612  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 761) took 1535 ms. Trace:
I20260709 12:21:25.388404  7337 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:25.509949  4984 rpcz_store.cc:276] 0709 12:21:23.945264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.049410 (+104146us) service_pool.cc:224] Handling call
0709 12:21:24.049761 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:24.051246 (+  1485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:24.051280 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:24.053881 (+  2601us) log.cc:844] Serialized 52 byte log entry
0709 12:21:24.373107 (+319226us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:24.373144 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:24.373227 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:25.078180 (+704953us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:25.479807 (+401627us) raft_consensus.cc:1685] finished
0709 12:21:25.479850 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:25.480338 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1789,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":6688128,"thread_start_us":318788,"threads_started":1,"wal-append.queue_time_us":362286}
I20260709 12:21:25.512512  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:25.513042  7437 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.513975  7337 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:25.514083  7437 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.516062  7435 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:25.517611  7437 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.518357  7437 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.515076  7337 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:25.503032  7305 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:25.566121  4333 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:25.506626  7374 raft_consensus.cc:2243] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:25.608268  7483 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.614171  4331 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.614756  4331 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:25.616297  4331 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.619614  4332 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:25.625909  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 113680us
I20260709 12:21:25.629449  7305 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:25.629892  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 244927us
I20260709 12:21:25.627704  7483 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.634068  7305 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.647140  4332 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.659029  7339 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:25.659798  4331 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.660161  7337 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:25.660195  7339 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.667270  7339 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.668130  7325 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:25.668955  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.669198  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 644) took 1115 ms. Trace:
W20260709 12:21:25.669543  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.669698  4248 rpcz_store.cc:276] 0709 12:21:24.553873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:24.609938 (+ 56065us) service_pool.cc:224] Handling call
0709 12:21:25.668772 (+1058834us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54002b4dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.669002 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547712384}
I20260709 12:21:25.670855  7325 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:25.662657  4984 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:21:25.688293  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48860.2us
I20260709 12:21:25.690097  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:25.690884  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.691601  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 390164us
I20260709 12:21:25.691896  4333 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:25.695179  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:25.699591  7492 consensus_queue.cc:1059] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:25.700416  4330 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:25.701238  7492 raft_consensus.cc:3055] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:25.701749  7492 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:25.703876  7493 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.704824  7493 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:25.703248  7492 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.707547  7374 raft_consensus.cc:2272] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:25.737596  7426 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:25.739820  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:25.742326  7269 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:25.745352  7487 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:25.746532  7487 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:25.746950  7487 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:25.748939  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53997.2us
I20260709 12:21:25.748659  7487 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.750548  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:25.757436  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 67615us
W20260709 12:21:25.772284  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.756146  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:25.814849  4333 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:25.815721  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:25.819036  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 63084.7us
I20260709 12:21:25.751690  7487 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.729421  7492 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.818372  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:25.771559  4330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:21:25.823374  4330 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.823851  4330 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:25.826506  4331 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:21:25.754278  7324 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.826853  4331 pending_rounds.cc:85] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:25.734491  7337 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:25.831585  4984 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:25.820107  7493 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:25.829504  4331 pending_rounds.cc:107] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:21:25.834326  4331 raft_consensus.cc:2889] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:25.754372  7263 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.837559  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:25.832846  7269 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:25.841140  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.841696  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:25.835557  7426 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:21:25.845822  7399 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:21:25.834722  7374 ts_tablet_manager.cc:1916] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:21:25.838500  7451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.002s	sys 0.028s
I20260709 12:21:25.845952  7324 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.855715  7370 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:25.858469  4332 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:25.867971  7446 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:25.868157  4328 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:25.868435  7446 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:25.869352  7324 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.869551  7446 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.870857  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:25.841210  7269 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:25.859252  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 49104.2us
I20260709 12:21:25.859931  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:25.860481  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:25.860797  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:25.851583  4249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1828) took 2041 ms. Trace:
I20260709 12:21:25.854014  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 716) took 2427 ms. Trace:
W20260709 12:21:25.863389  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 113247us
W20260709 12:21:25.844697  7455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.004s	sys 0.042s
I20260709 12:21:25.859176  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:25.839524  7437 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:25.876557  4327 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:25.878988  4329 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.881911  4990 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.876904  4984 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:25.877712  4331 rpcz_store.cc:276] 0709 12:21:23.417590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.835191 (+417601us) service_pool.cc:224] Handling call
0709 12:21:23.842388 (+  7197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:25.613833 (+1771445us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54003393a0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cf5dc0 00007fdbb0d801c0 00007fdbb0d81231 00007fdbb0d7dd8f 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c
0709 12:21:25.843181 (+229348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.845181 (+  2000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171654528}
I20260709 12:21:25.877449  4249 rpcz_store.cc:276] 0709 12:21:23.810112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.815386 (+  5274us) service_pool.cc:224] Handling call
0709 12:21:25.483100 (+1667714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:25.484353 (+  1253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:25.851284 (+366931us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54002b43d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:25.851463 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3834098944}
I20260709 12:21:25.877306  4334 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:25.871873  4987 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.876083  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:25.878363  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:25.871251  7446 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:25.895593  4218 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.926s (SENT) [suppressed 21 similar messages]
W20260709 12:21:25.897051  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0290261889999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:21:25.897495  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0281261889999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 12:21:25.898095  4219 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:25.879673  7504 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:21:25.874348  7269 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.904260  7503 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:25.904743  7503 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:25.905730  4988 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:25.905840  7503 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.879513  7437 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.907598  7437 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.909536  7503 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:25.910593  4989 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:25.903470  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.878602  7455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.005s	sys 0.042s
W20260709 12:21:25.882709  7451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.003s	sys 0.028s
I20260709 12:21:25.936549  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:25.922914  7455 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.937757  7455 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:25.938001  7451 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:25.938434  7451 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:25.938784  7455 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:25.939596  7451 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.933316  7441 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:25.926060  7263 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:25.942951  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.943609  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:25.934194  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 58255.6us
I20260709 12:21:25.934855  7435 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:25.940088  7455 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.931573  7504 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:25.937947  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:25.948381  4330 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:25.954399  4330 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.955869  4987 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:25.949875  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:25.958062  4988 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:21:25.965911  4989 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:25.962234  4991 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:25.963174  4984 raft_consensus.cc:2368] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8.
I20260709 12:21:25.950229  7324 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.959069  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 61093.8us
W20260709 12:21:25.977065  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81519.7us
I20260709 12:21:25.963050  7451 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:25.961400  7263 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:25.959612  7504 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:25.983561  4331 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:21:25.985176  7505 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:21:25.987597  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:26.000607  4989 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:25.988225  4327 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:21:25.963871  7496 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:25.991223  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:26.001760  4987 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:26.170439  4329 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:26.147706  4218 leader_election.cc:336] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.006s (SENT)
W20260709 12:21:26.146696  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.123529  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 106998us
I20260709 12:21:26.098703  4990 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:26.170320  4988 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:26.029903  7437 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:26.006606  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 128426us
I20260709 12:21:25.978998  7435 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 12:21:26.025898  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.179817  4326 raft_consensus.cc:2410] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:21:26.026443  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:26.181242  7508 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:21:26.183009  7337 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:21:26.184655  7434 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:21:26.185611  7434 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:26.186025  7434 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:26.166216  7493 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.188166  7493 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:26.190636  7493 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:26.060887  4987 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:26.033665  7324 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.179883  7437 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:26.269881  4249 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 12:21:26.247109  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.246438  4986 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:26.282913  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.197153  4989 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:26.293172  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.272691  4330 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:21:26.276084  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.276899  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 294997us
I20260709 12:21:26.273094  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.299114  4256 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:26.026983  4328 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:26.001366  4327 pending_rounds.cc:85] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 2
I20260709 12:21:26.305920  4327 pending_rounds.cc:107] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:21:26.306265  4327 raft_consensus.cc:2889] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:26.307108  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.295048  4988 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:26.004371  7496 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.267550  7426 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:26.333504  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:26.339869  4328 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:21:26.343849  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.345640  7417 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:26.345817  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:26.346326  7417 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.346889  4256 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:26.348573  7417 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.324421  7496 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.028875  7433 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.321545  7455 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.023698  7462 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.355882  7305 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.355628  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:26.360736  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:26.361003  4248 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:26.361553  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:26.362514  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 238350us
I20260709 12:21:26.262066  7337 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:21:26.365756  7472 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.366173  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:26.187121  7434 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:26.376677  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.350286  7433 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.350211  7324 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.385757  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.388088  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:26.391464  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.245096  7504 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.394264  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.396413  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:26.396660  4250 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 12:21:26.399437  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.402320  4332 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:21:26.402607  7462 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.362257  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:26.340956  7399 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.343803  7493 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:21:26.409715  4254 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:26.373411  7503 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:26.420917  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 238156us
I20260709 12:21:26.434345  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.440129  4333 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:26.431113  4256 raft_consensus.cc:2376] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5. Re-sending same reply.
I20260709 12:21:26.443359  4252 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:21:26.443797  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.439333  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90970.1us
I20260709 12:21:26.386607  7472 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.372903  7426 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.442188  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:26.410512  7455 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.410889  7305 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:26.449662  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 105545us
W20260709 12:21:26.450645  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.451177  4218 leader_election.cc:336] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.114s (SENT)
W20260709 12:21:26.445776  7269 consensus_meta.cc:287] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 12:21:26.437808  7324 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:26.454485  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.442294  7434 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:26.455886  4334 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:21:26.462796  7379 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:26.462546  7293 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:26.459666  4334 pending_rounds.cc:85] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:26.464208  4334 pending_rounds.cc:107] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:21:26.464478  4334 raft_consensus.cc:2889] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.474866  7455 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:26.461998  7487 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.004s
I20260709 12:21:26.452294  7503 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.488077  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.491580  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.451030  7263 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:21:26.500460  4333 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:21:26.500886  4333 pending_rounds.cc:85] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:26.501118  4333 pending_rounds.cc:107] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:21:26.501389  4333 raft_consensus.cc:2889] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.501571  4326 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 12:21:26.502352  7513 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:21:26.503320  7462 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.503753  7437 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:26.504742  7437 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:26.505123  7437 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:26.506220  7437 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.507498  7437 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.510577  7503 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:26.512588  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47450.7us
I20260709 12:21:26.534955  4219 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.542526  7520 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:26.543174  7520 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:26.543642  7520 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.461824  7269 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.546200  7269 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:26.547870  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.551606  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 94857.9us
I20260709 12:21:26.552474  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.553581  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:26.557016  4255 raft_consensus.cc:2368] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7.
W20260709 12:21:26.558347  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 112831us
I20260709 12:21:26.461179  7399 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.472167  7324 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.553028  4151 catalog_manager.cc:5697] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 5, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:26.559736  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 395158us
I20260709 12:21:26.560024  4328 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:26.568351  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:26.572746  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 103212us
I20260709 12:21:26.559188  7451 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:26.560956  7503 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:26.576951  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.565560  7519 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:26.583688  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.573769  7487 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.579471  7455 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:26.587837  7455 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:26.579881  7503 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.588331  7455 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.588461  7503 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.587908  7487 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:26.597930  4218 leader_election.cc:336] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.745s (SENT)
I20260709 12:21:26.598448  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.599323  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:26.600069  4327 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:26.558799  7379 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:26.608723  4334 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:26.578171  7451 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:26.572319  7462 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:21:26.607614  7263 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.627983  7399 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.635637  7310 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:26.636288  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.637429  7493 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:26.637979  7493 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:26.639123  7493 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.639693  7338 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:26.640822  7305 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.636292  7310 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.641526  7472 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.641856  7310 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:26.645578  7324 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.615350  7451 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.647760  7426 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.613832  7487 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.662235  7374 ts_tablet_manager.cc:1929] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:21:26.662081  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.663003  7374 log.cc:1199] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/wals/4079a3fa5d6b4cafa2f9b17573d0e1b0
I20260709 12:21:26.665472  7374 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41690 (request call id 95) took 6608 ms. Trace:
I20260709 12:21:26.665923  7374 rpcz_store.cc:276] 0709 12:21:20.057475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:20.162344 (+104869us) service_pool.cc:224] Handling call
0709 12:21:21.199582 (+1037238us) ts_tablet_manager.cc:1151] Deleting tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0
0709 12:21:21.199758 (+   176us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:26.397947 (+5198189us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:26.662083 (+264136us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:26.665350 (+  3267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4081596,"tablet-delete.queue_time_us":729732,"thread_start_us":481863,"threads_started":1}
I20260709 12:21:26.665190  7503 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.668083  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:21:26.669647  7503 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:26.670742  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.672663  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 93633.6us
W20260709 12:21:26.674443  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.678918  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81040.4us
I20260709 12:21:26.680956  4371 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.671937  7455 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.685300  7455 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.680312  7487 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:21:26.688562  7503 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:26.673506  7263 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.689723  7503 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:26.690239  7503 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:26.690842  7263 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.691599  7503 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.693439  7503 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.699829  4151 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:26.704581  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:26.705435  4330 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.707984  7520 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.710310  7520 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:26.704600  4218 leader_election.cc:336] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.894s (SENT)
W20260709 12:21:26.715068  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.721328  4330 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
W20260709 12:21:26.724856  4149 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 389) took 24873 ms (client timeout 15000 ms). Trace:
W20260709 12:21:26.741495  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51822.6us
I20260709 12:21:26.702486  4151 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 5, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:26.745877  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 160928us
I20260709 12:21:26.748252  7532 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.748891  7532 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.750115  7356 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.750638  7356 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.748276  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.710915  7520 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:21:26.755863  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 167744us
I20260709 12:21:26.757433  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.760216  4219 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.764850  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.753737  7532 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.756621  7492 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:26.753755  7310 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.775034  4956 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.776420  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:26.776942  7310 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:26.755610  7455 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:21:26.780192  7517 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:26.780690  7517 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.781116  7517 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:26.783488  7525 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:26.785615  7525 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:26.786170  7525 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:26.788452  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 128803us
I20260709 12:21:26.762547  7325 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:21:26.772038  7472 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:26.789958  7472 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:26.791527  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.792387  7356 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.786190  7524 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:21:26.763516  7263 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:26.807125  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.808189  7520 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:26.808809  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:26.809684  7520 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:26.810355  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:26.747092  7496 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.811466  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:26.821242  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.821492  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.822039  4987 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:26.823415  7263 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:26.823618  4984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:21:26.824556  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.753633  7451 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.827739  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:26.828341  4151 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 6, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 6 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.834002  4989 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:26.835022  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.790959  7472 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.835373  4983 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:26.836258  4296 leader_election.cc:400] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7.
I20260709 12:21:26.837633  4984 raft_consensus.cc:606] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.837718  4296 leader_election.cc:403] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:26.838132  4984 raft_consensus.cc:614] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:26.780208  7455 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:26.830816  4151 catalog_manager.cc:5697] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:26.843863  7455 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:26.835498  7451 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.849375  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.849563  7455 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:26.836091  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.852226  4986 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:26.850921  7455 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:26.860526  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:26.869066  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.887759  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.880390  4151 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 9, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 9 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.847200  7520 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:26.892343  4332 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:26.893066  4986 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:26.893136  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:26.894493  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:26.835382  7533 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:21:26.903403  4992 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:26.899955  4151 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.905267  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:26.906087  4988 raft_consensus.cc:2376] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9. Re-sending same reply.
I20260709 12:21:26.787163  7525 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:26.744562  4149 rpcz_store.cc:269] 0709 12:21:01.851276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.892367 (+ 41091us) service_pool.cc:224] Handling call
0709 12:21:26.724648 (+24832281us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:21.499374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:21.723408 (+224034us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:21.723446 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:21:21.723465 (+    19us) tablet.cc:662] Decoding operations
0709 12:21:21.724439 (+   974us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:21.724499 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:21.724527 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:21:21.725302 (+   775us) tablet.cc:701] Row locks acquired
0709 12:21:21.725323 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:21:21.725486 (+   163us) write_op.cc:270] Start()
0709 12:21:21.725610 (+   124us) write_op.cc:276] Timestamp: P: 1783599681725428 usec, L: 0
0709 12:21:21.725632 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:21.821075 (+ 95443us) log.cc:844] Serialized 3548 byte log entry
0709 12:21:24.724152 (+2903077us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:25.667246 (+943094us) op_driver.cc:464] REPLICATION: finished
0709 12:21:25.881484 (+214238us) write_op.cc:301] APPLY: starting
0709 12:21:25.881658 (+   174us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:25.899810 (+ 18152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:25.920066 (+ 20256us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:26.016993 (+ 96927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:26.019421 (+  2428us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:21:26.019471 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:26.019946 (+   475us) log.cc:844] Serialized 71 byte log entry
0709 12:21:26.020201 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.020423 (+   222us) write_op.cc:454] Released schema lock
0709 12:21:26.020535 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:26.021044 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:26.021080 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":951698,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":213812,"apply.run_cpu_time_us":5010,"apply.run_wall_time_us":139589,"num_ops":9,"prepare.queue_time_us":615360,"prepare.run_cpu_time_us":16731,"prepare.run_wall_time_us":808319,"raft.queue_time_us":274714,"raft.run_cpu_time_us":72231,"raft.run_wall_time_us":162460,"replication_time_us":3941400,"spinlock_wait_cycles":6947584,"thread_start_us":1006894,"threads_started":4,"wal-append.queue_time_us":601545}]]}
I20260709 12:21:26.912218  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:26.889235  7379 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7.
I20260709 12:21:26.904965  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:26.915190  4983 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:26.915422  4985 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:26.915315  4151 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:26.916925  4151 catalog_manager.cc:5697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.918430  4151 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:26.920379  4986 raft_consensus.cc:2368] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8.
W20260709 12:21:26.921934  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 87013.5us
W20260709 12:21:26.922580  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 63053us
I20260709 12:21:26.923245  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:26.927810  7305 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:26.891548  7493 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:26.861701  7437 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:21:26.933283  4218 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc -> Peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853): Couldn't send request to peer 0952d204644f41a88e5e463e697dcc27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 374e8fa3690a41af9874f32b270bf3e1. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:26.934060  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 123822us
I20260709 12:21:26.935837  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:26.939513  7263 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.944003  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:26.944218  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:26.944707  4402 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.945101  4402 raft_consensus.cc:614] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:26.945374  7504 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:26.945612  7503 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:26.946030  7504 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:26.946269  7496 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:26.947188  7532 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:26.947885  7532 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:26.948988  7532 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.949515  7437 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:21:26.947197  7504 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:26.958897  4955 leader_election.cc:400] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9.
I20260709 12:21:26.964363  4955 leader_election.cc:403] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:26.943090  7487 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:21:26.945411  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:26.960249  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.913868  7520 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:26.951370  4296 leader_election.cc:400] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9.
I20260709 12:21:26.966259  4296 leader_election.cc:403] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:21:26.963341  4985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:21:26.966796  4985 raft_consensus.cc:606] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.977520  4983 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:26.930593  7305 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:26.968632  4328 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:21:26.981479  4151 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 4 to 5, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.987025  7337 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:26.986510  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.987914  4151 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 5 to 6, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 6 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.988656  7305 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:26.984179  7338 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:26.999926  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:26.990870  7399 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9.
I20260709 12:21:26.984164  7524 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9.
W20260709 12:21:27.014356  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.015826  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:27.020804  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.013278  4151 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 4, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 4 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:26.997277  7338 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:27.005918  7492 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.007674  7462 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:27.038247  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 79550.1us
I20260709 12:21:27.034093  4151 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.022995  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:21:27.073202  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 70109.4us
I20260709 12:21:27.074329  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:27.074416  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:27.019986  7532 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.040609  7520 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.012077  7417 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:21:27.040609  7472 raft_consensus.cc:2764] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:27.042974  7462 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.092720  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:27.108383  7338 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:27.090363  7530 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:21:27.111068  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.111822  4151 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 4, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:27.113883  4151 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 4, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.110646  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:27.119973  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.122089  4151 catalog_manager.cc:5697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.125344  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:27.127476  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:27.129850  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.130512  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.099713  7462 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:27.135610  7540 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:21:27.122416  7399 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:27.136798  7399 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.137256  7399 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.137275  4986 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:27.139420  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:27.139962  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 153564us
I20260709 12:21:27.140131  4986 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:27.133387  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:27.153110  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 58623.4us
I20260709 12:21:27.154418  7551 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:27.155435  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.156301  4402 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:27.142409  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:27.157617  4985 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:27.158926  4151 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 6, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:27.159515  7524 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:27.186211  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 111965us
I20260709 12:21:27.186013  4151 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:27.185045  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.129014  7472 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:27.203785  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:27.206604  4984 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:27.208112  4983 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 7. Ops: [5.6-5.6]
I20260709 12:21:27.160657  7451 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:27.196166  4151 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 4 to 5, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.196605  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:27.195232  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 156084us
I20260709 12:21:27.228706  4151 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:27.231359  7562 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:27.232890  7562 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.234169  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.234500  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.235445  4402 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:27.238019  4328 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:27.233332  7562 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.240823  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.267328  4991 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:27.254714  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.206735  7433 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:27.264046  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 67567.8us
I20260709 12:21:27.268965  4986 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:21:27.270793  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:27.272498  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6681459640003595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3328s for a response
I20260709 12:21:27.269882  4151 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 4, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.295379  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.296083  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.297034  4986 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.297724  7451 raft_consensus.cc:697] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:27.298213  7568 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.298619  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:27.299245  4256 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:27.298765  7568 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:27.298806  7451 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.300191  7310 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.300700  7310 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.301628  7568 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:27.302896  7310 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.307653  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:27.307822  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:27.308748  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:27.309175  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.304872  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:27.315871  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:27.312796  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:27.317637  4253 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:27.319123  7493 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:27.319691  7493 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:27.320845  7493 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:27.322197  7493 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.326840  4402 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:27.327328  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.330636  4407 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:27.332006  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:27.306942  7517 consensus_meta.cc:287] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.003s
I20260709 12:21:27.370446  7556 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:27.371033  7556 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:27.370970  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:27.371604  7556 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.371769  4257 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.372291  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.372917  4403 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.303437  7553 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.274012  7555 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:27.391762  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 78916.9us
I20260709 12:21:27.500586  4403 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:27.408108  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.496450  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 265732us
I20260709 12:21:27.413508  4252 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:27.448158  4257 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
W20260709 12:21:27.504055  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 221404us
I20260709 12:21:27.506093  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:27.506889  4254 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:27.506457  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.428428  4402 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:27.505335  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:27.512907  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.514253  4218 leader_election.cc:400] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8.
I20260709 12:21:27.313954  7263 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:27.545598  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.518149  4329 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:21:27.516305  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.517549  4328 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:27.515529  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 246669us
I20260709 12:21:27.379432  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.559738  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:27.560619  4406 raft_consensus.cc:2410] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:21:27.560621  4955 connection.cc:256] RPC call timeout handler was delayed by -1.1204143749996547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 12:21:27.561297  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0988143750000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 12:21:27.551111  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:27.561580  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0961143750000701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:21:27.561877  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0304143749999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 12:21:27.562390  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:27.563685  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.433306  7492 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.313303  7433 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:27.375474  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:27.562958  4218 leader_election.cc:403] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:21:27.568598  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.569015  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3435031690000869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 12:21:27.569363  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.569655  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.569896  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1491031690002274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 12:21:27.570201  4296 connection.cc:256] RPC call timeout handler was delayed by -1.0645031690000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 12:21:27.432854  7496 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:27.575610  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.479586  7562 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:27.573817  4296 leader_election.cc:336] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.520s (SENT)
I20260709 12:21:27.516149  7435 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:27.550942  7310 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.578655  4253 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.580116  4254 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:27.578485  4247 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.585651  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:27.597270  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 83199.7us
I20260709 12:21:27.598896  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:27.601496  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:27.601624  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:27.576632  7544 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.350s	user 0.003s	sys 0.000s
I20260709 12:21:27.388032  7517 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.574761  7338 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:21:27.579686  7520 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:27.563540  7532 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:21:27.563870  7263 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.638537  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:27.627224  7435 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:21:27.656060  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.576633  7492 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:27.621034  7487 consensus_meta.cc:287] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.001s
I20260709 12:21:27.681064  4992 raft_consensus.cc:2368] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10.
W20260709 12:21:27.647562  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 49303.4us
W20260709 12:21:27.667191  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50454.1us
W20260709 12:21:27.668566  4296 leader_election.cc:336] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.563s (SENT)
W20260709 12:21:27.639477  7550 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:27.650656  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.580996  7496 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.622210  7269 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:27.654961  7305 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.004s
W20260709 12:21:27.658615  7399 consensus_meta.cc:287] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 12:21:27.680258  4983 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.583424  7310 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:27.667429  7532 consensus_queue.cc:1243] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:27.686762  4333 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:27.689409  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 127091us
I20260709 12:21:27.692360  4405 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:27.692356  4332 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:27.540195  7553 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.695173  4405 pending_rounds.cc:85] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 7
I20260709 12:21:27.704618  4405 pending_rounds.cc:107] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:27.704931  4405 raft_consensus.cc:2889] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:27.708842  7310 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:27.710877  7492 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:27.713835  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49972us
I20260709 12:21:27.714970  4256 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
W20260709 12:21:27.719012  4296 leader_election.cc:336] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.779s (SENT)
I20260709 12:21:27.719637  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:27.721269  7496 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:27.722347  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:27.723052  7433 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:27.723953  7310 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:27.724519  7531 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.694s	user 0.002s	sys 0.002s
I20260709 12:21:27.730728  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:27.731395  4330 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
W20260709 12:21:27.700523  7337 consensus_meta.cc:287] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.001s
I20260709 12:21:27.732241  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:27.732290  7337 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:27.734156  4372 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:27.748939  7263 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.749382  7575 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:27.749848  7575 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.750190  7575 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:27.751598  7562 consensus_queue.cc:1059] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:27.752529  7562 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:27.753441  7565 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:27.753866  7565 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:27.754688  4248 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:27.756461  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:27.758054  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:27.754765  7565 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.777012  7565 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.778637  7496 raft_consensus.cc:993] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:27.742090  7520 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:21:27.699383  7399 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.784794  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.692598  7305 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.807005  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:27.832489  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.788071  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.832720  4331 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:27.833841  4402 raft_consensus.cc:2410] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:27.761466  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:27.787680  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.849298  4406 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.852596  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.789258  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:27.854815  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 65664.4us
I20260709 12:21:27.779174  7496 raft_consensus.cc:1081] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:27.852057  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.859988  4407 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:27.812853  7462 consensus_meta.cc:287] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 12:21:27.863150  4404 raft_consensus.cc:2410] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:27.789491  7451 raft_consensus.cc:2764] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:21:27.788890  7310 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:27.785961  7399 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.826465  7517 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:27.865581  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:27.868960  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.797328  7553 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.858932  7379 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:27.877347  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.887915  4992 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:27.877806  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.878273  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.859056  7577 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:21:27.867674  7310 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.875414  7520 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:27.882120  7555 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:27.882037  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.882592  7337 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:27.883278  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 135279us
I20260709 12:21:27.893942  4400 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:27.884735  7305 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.885147  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:27.886050  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 287235us
I20260709 12:21:27.900020  4408 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:27.887403  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.887902  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.900609  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:27.865193  7462 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.890091  4331 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:27.890825  4403 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:27.789815  7567 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:21:27.891199  4406 raft_consensus.cc:2368] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6.
I20260709 12:21:27.892354  4256 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:27.806927  7575 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.894295  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.902938  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:27.903653  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:27.890990  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:27.901093  4402 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:27.858716  7556 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.894372  7338 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.915773  4249 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:21:27.925580  4253 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.915161  4255 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:27.922137  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.922122  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.913426  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:27.888571  7379 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:27.892576  7310 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:27.893115  7417 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:27.928736  4992 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:27.929359  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.915095  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.923600  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.934123  4408 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:27.927461  4248 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:27.931593  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:27.915380  7580 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:21:27.937166  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:27.938293  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.937422  4404 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:27.916036  7524 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:27.914721  7462 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.901715  7337 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:27.945490  7524 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:27.915805  7325 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.944773  4403 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.924515  7269 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8.
I20260709 12:21:27.932657  7379 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.914453  7487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57862 (request call id 17) took 4013 ms. Trace:
I20260709 12:21:27.951611  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.896106  7520 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.954326  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.963604  4327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:21:27.957768  7517 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:27.958448  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.963927  4405 raft_consensus.cc:2410] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:21:27.964434  4327 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:27.967139  4327 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:27.953020  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.968909  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:27.966259  7577 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:27.971556  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.969568  7517 consensus_queue.cc:1243] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:21:27.935606  7338 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.974717  7338 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.975399  7556 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.976740  7520 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:27.977084  7575 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:27.977715  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:27.975421  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.978701  4402 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:27.979007  7577 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:27.969718  4401 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:27.948098  7325 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.951128  7568 raft_consensus.cc:2764] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:27.980116  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.982671  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:27.983235  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:27.984125  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52602.9us
I20260709 12:21:27.984752  4326 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:27.971652  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.987761  4405 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:27.988744  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:27.989902  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.991393  4400 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:27.993094  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:27.946970  7524 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.995234  7434 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:27.995671  7434 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:27.955268  7487 rpcz_store.cc:276] 0709 12:21:23.901475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:23.905392 (+  3917us) service_pool.cc:224] Handling call
0709 12:21:24.497668 (+592276us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b24001823a8. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadb14cb9 00007fdbadb12dcb 00007fdbadc112b1 00007fdbadc0c848 00007fdbadc0c7ad 00007fdbaf04d9a7 00007fdbb0cda85c 00007fdbb0cda699 00007fdbb0cd76ad 00007fdbb0cd7527
0709 12:21:24.523764 (+ 26096us) log.cc:844] Serialized 492 byte log entry
0709 12:21:24.680575 (+156811us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180003f520. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc0bc0a 00007fdbb734b219 00007fdbadc93a40 00007fdbadc8e4e4 00007fdbadc8e455 00007fdbb0cd7b0b 00007fdbb0d5cb63 00007fdbb0d84752 00007fdbb5d44d29
0709 12:21:25.610508 (+929933us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b180003f520. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:25.683276 (+ 72768us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b180003f520. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc0bc0a 00007fdbb734b219 00007fdbadc93a40 00007fdbadc8e4e4 00007fdbadc8e455 00007fdbb0cd7b0b 00007fdbb0d5cb63 00007fdbb0d84752 00007fdbb5d44d29
0709 12:21:27.914320 (+2231044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1072481,"raft.queue_time_us":1086671,"raft.run_cpu_time_us":3546,"raft.run_wall_time_us":91047,"spinlock_wait_cycles":68256000,"thread_start_us":92055,"threads_started":1,"wal-append.queue_time_us":140034,"wal-append.run_cpu_time_us":24905,"wal-append.run_wall_time_us":1780179}
I20260709 12:21:27.996624  7434 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:27.998813  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:27.999364  7587 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
I20260709 12:21:27.997308  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:27.999608  4404 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.999607  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.000785  4403 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:28.001076  7577 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.002521  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.003113  4403 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:28.003804  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.003945  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.004448  4409 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:28.004968  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.005251  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.005585  4403 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:28.006428  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:28.001060  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:28.008257  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.012416  4409 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:27.990545  4405 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:28.025712  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.026670  4405 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:28.045158  4405 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:28.073714  4400 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:28.074795  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 115970us
I20260709 12:21:28.090278  7310 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.095649  4406 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:28.101747  4407 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:28.101840  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 113840us
I20260709 12:21:28.092913  4956 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:28.095732  4327 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:28.124796  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.128613  4402 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
W20260709 12:21:28.152837  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.165725  4327 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:28.172780  4992 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:28.108462  7337 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:28.227700  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 242452us
I20260709 12:21:28.230268  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:28.227432  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 170812us
W20260709 12:21:28.228273  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.234407  4404 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:28.237010  4403 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:28.237975  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 128859us
I20260709 12:21:28.235610  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:28.239132  4405 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:28.240268  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:28.240283  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:28.214952  7575 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.253237  4409 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:21:28.241881  4326 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:28.248416  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:28.255370  4372 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:28.227257  7434 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.257087  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.256876  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:28.204344  7338 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:21:28.238965  7568 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:28.281046  4989 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:28.280776  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.243327  7562 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:28.283608  4988 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:28.264485  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 336570us
I20260709 12:21:28.272689  4986 pending_rounds.cc:85] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 4
I20260709 12:21:28.284521  4986 pending_rounds.cc:107] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:21:28.282774  7496 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:28.343564  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.518590  7558 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:28.701503  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.375980  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:28.284751  4409 raft_consensus.cc:2368] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12.
W20260709 12:21:28.701982  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.288723  7568 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:28.656934  7524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.003s	sys 0.011s
W20260709 12:21:28.712244  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:28.715099  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.284941  4986 raft_consensus.cc:2917] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:21:28.389532  7527 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:28.552510  7591 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:21:28.716471  4986 raft_consensus.cc:2889] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:28.718600  4984 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:28.692286  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 448274us
I20260709 12:21:28.389051  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:28.551499  7595 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:21:28.702504  4992 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:28.256994  7533 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:28.268524  7325 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:28.703107  4985 raft_consensus.cc:1240] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:28.474159  7310 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:28.668407  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.730290  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.730916  4400 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
W20260709 12:21:28.712433  7524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.012s
I20260709 12:21:28.690248  7574 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.289084  7562 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:28.713039  7568 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:28.496928  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:28.437266  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.319099  7582 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:28.717391  4990 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:28.510924  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:28.746629  4404 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.692019  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:28.747504  4405 raft_consensus.cc:2410] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:28.374025  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:28.748188  4326 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:28.722393  4987 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:21:28.380897  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.386201  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:28.701581  7496 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:28.720856  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:28.726701  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:28.729686  4408 consensus_meta.cc:287] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.750s	user 0.017s	sys 0.001s
I20260709 12:21:28.751205  4988 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:28.265244  7575 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.715868  4991 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:21:28.755599  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:28.756042  4984 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:28.739800  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:28.729964  7533 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:28.753392  4408 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:28.271531  7455 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:28.746403  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 491127us
I20260709 12:21:28.311995  7567 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:28.761734  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:28.741242  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.758597  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:28.764088  4253 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:28.418699  7379 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.739156  7527 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:28.766733  4248 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:28.701655  7558 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.769117  4989 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:28.761327  7567 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.776420  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:28.757262  7310 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:28.776770  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:28.788147  4247 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:28.779874  7605 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 12:21:28.761444  7455 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:28.789043  7455 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.785547  7567 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:28.795858  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:28.796581  4325 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:28.787045  7575 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:28.800910  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:28.809514  4407 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:28.809950  4407 raft_consensus.cc:614] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:28.799229  4253 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:28.856490  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.856205  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:28.860116  4332 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:28.862069  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 107510us
I20260709 12:21:28.752126  7574 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.871181  4254 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: [3.5-7.6]
I20260709 12:21:28.872926  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:28.873766  4253 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.818614  7553 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.803730  7582 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:28.859731  7603 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.870484  7575 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:28.863000  7310 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:28.883968  7496 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:28.898123  4218 leader_election.cc:336] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 3.348s (SENT)
I20260709 12:21:28.908551  4253 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:28.915516  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 174252us
W20260709 12:21:28.915802  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:28.922329  4249 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:28.876451  7305 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:21:28.890300  7575 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.932634  4325 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:28.934594  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:28.935575  4402 raft_consensus.cc:606] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:28.935953  4402 raft_consensus.cc:614] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:28.884471  7553 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.909924  4247 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:28.875001  7562 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:28.933331  7496 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:28.897244  7603 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.937179  7575 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:28.947436  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 57381.7us
W20260709 12:21:28.944847  7434 consensus_meta.cc:287] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.675s	user 0.013s	sys 0.000s
I20260709 12:21:28.947718  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:28.953233  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:28.956789  4985 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:28.960816  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:28.910187  7533 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:28.962028  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1859) took 1454 ms. Trace:
I20260709 12:21:28.962618  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:28.949723  7582 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:28.965488  7593 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.463s	user 0.001s	sys 0.009s
I20260709 12:21:28.965854  7379 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:28.968107  4257 rpcz_store.cc:276] 0709 12:21:27.507756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.508200 (+   444us) service_pool.cc:224] Handling call
0709 12:21:27.508592 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:27.562093 (+ 53501us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:27.726067 (+163974us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b18000bdd00. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb47763c7 00007fdbb0d889a7 00007fdbb0d980bf 00007fdbb0d98038
0709 12:21:27.882334 (+156267us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b18000bdd00. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc0bc0a 00007fdbb734b219 00007fdbb4c5258f 00007fdbadc91571 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd
0709 12:21:27.966600 (+ 84266us) log.cc:844] Serialized 14 byte log entry
0709 12:21:28.265757 (+299157us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:28.272584 (+  6827us) log.cc:844] Serialized 26 byte log entry
0709 12:21:28.272711 (+   127us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:28.272747 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:28.272807 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:28.961836 (+689029us) raft_consensus.cc:1685] finished
0709 12:21:28.961853 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:28.961970 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79744,"prepare.queue_time_us":395266,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":57975,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":23168,"spinlock_wait_cycles":16459904,"thread_start_us":434234,"threads_started":2,"wal-append.queue_time_us":787429}
I20260709 12:21:28.973934  4404 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:28.930912  7527 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.021130  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:29.021978  4402 raft_consensus.cc:606] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:29.022446  4402 raft_consensus.cc:614] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:29.025787  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:29.027697  7608 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:21:29.028141  7269 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:21:29.032048  4253 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:29.034456  4990 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:29.035706  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:29.037142  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:29.037832  4989 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.037544  7338 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:29.039610  7574 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:29.035480  7556 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:29.053795  4328 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.023967  7558 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:28.957837  7310 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:29.119959  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:29.125236  4989 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
W20260709 12:21:29.126766  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 146589us
W20260709 12:21:29.131024  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.119891  4955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.021s	sys 0.000s
W20260709 12:21:29.131635  4955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.021s	sys 0.000s
W20260709 12:21:29.130244  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 265940us
W20260709 12:21:29.138046  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 897845us
I20260709 12:21:29.135469  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:29.147416  7553 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:29.148123  7615 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:21:29.150297  7379 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:29.150784  7379 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.151144  7379 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.152930  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:29.153201  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.154663  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:29.156579  7325 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:29.159063  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:29.159807  7601 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:29.160413  7601 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:29.161605  7601 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.156595  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:29.164592  7379 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:29.167330  7379 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:29.168478  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:29.159014  7325 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:29.175052  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:29.175917  7612 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:21:29.203688  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.215029  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:29.216244  4253 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:29.216483  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.121701  7567 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:29.229315  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:29.230880  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:29.222528  7524 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:29.217147  7615 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:29.239615  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.247813  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.220687  7551 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.222841  7577 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:29.282289  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 75886.8us
I20260709 12:21:29.286106  4257 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:21:29.225394  7325 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:29.204295  7613 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:21:29.292477  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.293787  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:29.296303  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:29.275977  7603 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:29.299989  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.279170  7433 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.279996  7615 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.225935  7379 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:21:29.227394  7455 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.315590  4990 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:29.316421  4257 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:21:29.316927  4371 connection.cc:256] RPC call timeout handler was delayed by -3.4426408429999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 12:21:29.317327  4371 connection.cc:256] RPC call timeout handler was delayed by -3.3409408429997711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:21:29.318126  4371 connection.cc:256] RPC call timeout handler was delayed by -3.2563408430000891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:21:29.318465  4371 connection.cc:256] RPC call timeout handler was delayed by -3.0790408429998024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 12:21:29.318753  4371 connection.cc:256] RPC call timeout handler was delayed by -3.0376408429997355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 12:21:29.319037  4371 connection.cc:256] RPC call timeout handler was delayed by -3.0304408430001786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 12:21:29.319336  4371 connection.cc:256] RPC call timeout handler was delayed by -2.9782408430000942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 12:21:29.319648  4371 connection.cc:256] RPC call timeout handler was delayed by -2.8837408429999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:21:29.320075  4371 connection.cc:256] RPC call timeout handler was delayed by -2.594840842999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2521s for a response
W20260709 12:21:29.320379  4371 connection.cc:256] RPC call timeout handler was delayed by -2.3311408429999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28140000000000004s for a response
W20260709 12:21:29.320622  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.320660  4371 connection.cc:256] RPC call timeout handler was delayed by -2.2096408429997609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2949s for a response
W20260709 12:21:29.321184  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.321229  4371 connection.cc:256] RPC call timeout handler was delayed by -2.0143408429999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
W20260709 12:21:29.321771  4371 connection.cc:256] RPC call timeout handler was delayed by -1.3447408430001815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.391s for a response
W20260709 12:21:29.322413  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 341885us
I20260709 12:21:29.323997  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.316532  7433 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:29.327661  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.328085  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.328195  7433 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:29.329149  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:29.328429  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.330408  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:29.300210  7434 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:29.332916  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.334962  4325 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.335634  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:29.336293  4402 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:29.315383  7615 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:29.336704  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.338521  4402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:29.288841  7551 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.341095  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:29.339385  4402 raft_consensus.cc:606] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.301923  7617 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:21:29.343468  7630 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:29.345211  7602 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.634s	user 0.007s	sys 0.030s
I20260709 12:21:29.348795  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.340728  7487 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.350064  7630 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:29.350481  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:29.351583  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.351886  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:29.352664  7630 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.338099  7434 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.355513  7325 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.356178  7567 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:29.356665  7617 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.357215  7617 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.357888  7455 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:29.333657  7379 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:29.358750  7379 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:29.342664  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:29.360809  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.352629  4990 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:29.361948  4990 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:29.342861  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:29.360661  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.368202  4257 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:29.384627  4408 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:29.385424  4407 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:21:29.390872  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 50985.1us
I20260709 12:21:29.391932  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.393399  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:29.338778  7517 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.395380  4990 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.359237  7617 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:29.390928  7433 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:29.411466  4257 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [4.6-7.7]
I20260709 12:21:29.407688  7603 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:29.408170  7610 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:29.412575  7610 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:29.413388  4254 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:29.413527  7610 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.414481  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:29.415050  4248 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:29.409226  7614 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:21:29.415648  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:29.417121  4256 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:29.417974  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 796) took 1163 ms. Trace:
I20260709 12:21:29.418681  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:29.419921  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.420003  4249 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:21:29.418432  4986 rpcz_store.cc:276] 0709 12:21:28.254231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:28.254456 (+   225us) service_pool.cc:224] Handling call
0709 12:21:28.272493 (+ 18037us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:28.753895 (+481402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:28.753923 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:28.761862 (+  7939us) log.cc:844] Serialized 52 byte log entry
0709 12:21:29.049818 (+287956us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:29.090615 (+ 40797us) log.cc:844] Serialized 14 byte log entry
0709 12:21:29.097527 (+  6912us) log.cc:844] Serialized 14 byte log entry
0709 12:21:29.103031 (+  5504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.103105 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:29.409448 (+306343us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18004561c0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:29.417719 (+  8271us) raft_consensus.cc:1685] finished
0709 12:21:29.417748 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:29.417897 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86355,"prepare.queue_time_us":78785,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":34265,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":17881,"spinlock_wait_cycles":28900096,"thread_start_us":261177,"threads_started":1,"wal-append.queue_time_us":499880}
I20260709 12:21:29.420727  7379 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.405239  7630 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:29.422108  7379 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.414872  7610 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:29.424875  7551 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:29.333186  7611 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:21:29.425678  7611 consensus_queue.cc:1243] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:29.427390  7622 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:29.430610  7615 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:29.378293  7624 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:29.397183  7455 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.427284  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2454) took 1536 ms. Trace:
I20260709 12:21:29.431461  7517 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.431638  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:29.432487  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 98755.5us
I20260709 12:21:29.397737  7616 ts_tablet_manager.cc:933] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
I20260709 12:21:29.338876  7556 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:29.441923  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:29.443799  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 51986.4us
I20260709 12:21:29.467810  4255 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.359452  7574 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:29.468550  7574 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.470726  7574 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:29.448604  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:29.471786  4334 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:29.471994  4333 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.446372  4332 rpcz_store.cc:276] 0709 12:21:27.890960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:27.891099 (+   139us) service_pool.cc:224] Handling call
0709 12:21:27.898882 (+  7783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:28.864893 (+966011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:29.427057 (+562164us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54002f26d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:29.427218 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210214272}
I20260709 12:21:29.472254  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:29.450004  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:29.461479  4327 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:29.464560  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.468124  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.348937  7338 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 12:21:29.498224  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 137646us
I20260709 12:21:29.500196  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:29.504464  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.506722  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:29.488461  7575 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.000s
I20260709 12:21:29.480335  7556 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.511677  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:29.487881  7624 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:29.457548  7496 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:21:29.518613  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.521908  4984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:21:29.522538  4984 raft_consensus.cc:606] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.524896  4333 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:29.528023  7624 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.506422  7574 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:29.509486  7533 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.532088  4372 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:29.537987  4218 leader_election.cc:336] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.645s (SENT)
W20260709 12:21:29.531463  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63459.6us
I20260709 12:21:29.508220  7310 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:29.541172  4255 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:29.515612  7556 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.546861  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.550447  7606 raft_consensus.cc:993] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:29.550546  7434 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:29.551637  7628 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:21:29.555812  7607 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.842s	user 0.003s	sys 0.018s
I20260709 12:21:29.515345  7575 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.762840  7575 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:29.550275  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 54602.1us
W20260709 12:21:29.764225  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.548740  7310 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:29.764760  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.736609  7615 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:29.518509  7567 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:29.531201  7562 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:29.549098  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:29.781287  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.549260  7609 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:21:29.742600  7566 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:29.746982  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 208922us
W20260709 12:21:29.788220  4218 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.926s (SENT)
W20260709 12:21:29.749392  7626 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.217s	user 0.008s	sys 0.000s
I20260709 12:21:29.754323  7462 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:29.753129  7517 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:29.770327  4253 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:29.766206  7310 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:29.772408  7524 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:29.802487  7524 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.803752  7615 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:29.804278  7615 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:29.804646  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.804716  7615 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:29.805349  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.808089  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:21:29.808477  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.809900  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:29.810729  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.810860  7524 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:29.812119  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:29.812888  4984 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:29.819756  7524 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:29.775547  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:29.831069  4329 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:29.772459  7562 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:29.778019  4330 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:29.773294  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:29.780095  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.788641  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:29.768141  7434 raft_consensus.cc:1081] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:29.820698  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:29.737457  7631 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:29.784512  7556 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.854369  4986 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:29.800654  7567 consensus_queue.cc:1243] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:29.852638  7562 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:29.888728  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:29.942636  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 162678us
I20260709 12:21:29.967192  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:29.902693  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:29.984040  4983 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:29.966593  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 420410us
W20260709 12:21:29.909267  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 121072us
W20260709 12:21:29.987561  4218 leader_election.cc:336] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.021s (SENT)
W20260709 12:21:29.955384  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 182164us
I20260709 12:21:29.934249  4329 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:29.908221  4326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:21:29.989502  4326 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.989826  4986 pending_rounds.cc:85] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 5
I20260709 12:21:29.990319  4986 pending_rounds.cc:107] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:29.990577  4986 raft_consensus.cc:2889] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:29.991199  4326 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:29.991222  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.994701  7603 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:29.995409  7603 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:29.996307  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:29.998252  4218 leader_election.cc:336] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.084s (SENT)
W20260709 12:21:29.909006  7647 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:21:30.002910  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.003839  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:29.907737  7337 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.910746  7556 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:29.966385  7637 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.875082  7617 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:29.915436  7435 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:29.874294  7624 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.005344  7433 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:21:30.010030  7625 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.606s	user 0.000s	sys 0.011s
I20260709 12:21:30.005651  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:29.852893  7524 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:29.965353  7631 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:30.014559  7533 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:30.016372  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:30.023556  7610 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:30.025355  7520 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:30.041654  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.043251  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.056228  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.058432  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 55581.1us
W20260709 12:21:30.060040  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 43742us
I20260709 12:21:29.887193  7310 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.048765  4990 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.012980  7567 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:30.010776  7603 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.069846  7379 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:30.013486  7337 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.045852  7433 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:30.050176  7533 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:30.084888  4408 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:30.061769  7520 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:30.058079  7617 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:30.053550  7574 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:30.055704  7610 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:30.151513  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:30.153311  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:30.137542  7616 tablet_copy_client.cc:323] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.129:34061
W20260709 12:21:30.093271  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 88643.9us
W20260709 12:21:30.138334  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.158457  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:30.161716  4331 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:30.163396  4331 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:30.084451  7379 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:30.142602  4407 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:21:30.125186  4955 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.122745  7533 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:30.166597  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 79870.2us
I20260709 12:21:30.019809  7637 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:30.198612  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.172263  4407 pending_rounds.cc:85] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 7
I20260709 12:21:30.207602  4407 pending_rounds.cc:107] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:21:30.207916  4407 raft_consensus.cc:2889] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:30.207870  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 82809.2us
W20260709 12:21:30.237701  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 64311.1us
I20260709 12:21:30.237197  4331 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:30.241941  4327 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:30.243621  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.163445  7630 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:30.256156  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:30.175276  7379 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.259153  4990 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:30.192453  7574 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:30.265682  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55144.6us
W20260709 12:21:30.248616  7612 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:21:30.211032  7568 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.268038  4401 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:30.263418  7517 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:21:30.270556  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:30.270263  7659 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:30.247013  7433 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.279997  7574 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.207970  7562 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.260601  7525 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:21:30.268493  7610 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.285137  7562 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.285694  7524 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:30.286046  7624 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:30.286405  4329 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:30.286934  7624 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:30.287755  7645 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:21:30.289860  7624 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:30.290318  7648 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:21:30.262121  7577 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:21:30.263065  7567 raft_consensus.cc:2764] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:21:30.291193  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.213810  7631 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.291721  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:30.292373  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.292773  4407 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:30.296387  7637 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.250391  7527 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:30.298615  7527 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.299031  7527 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.300045  4250 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:30.302327  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.286610  4332 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:30.312039  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68515.9us
I20260709 12:21:30.313181  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:30.326871  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.335546  4405 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:30.340759  4296 leader_election.cc:400] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10.
I20260709 12:21:30.341296  4296 leader_election.cc:403] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:30.343847  4400 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:21:30.337155  4326 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.257706  7615 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.264410  7609 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:21:30.363720  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:30.359982  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 94965.1us
I20260709 12:21:30.331190  7525 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:30.360895  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:30.348518  7606 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:30.374784  4326 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:30.381525  4333 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:30.358788  7434 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.390769  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:30.357872  7611 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:30.361407  7568 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10.
I20260709 12:21:30.392133  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:30.370080  7659 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:30.357399  7325 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:21:30.367803  7525 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:30.416260  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:30.380630  7606 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:30.392477  7310 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:30.334343  7520 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.367844  7562 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:21:30.348686  7617 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.420130  7525 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.415126  7337 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:30.441423  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.419718  7662 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:30.428077  7435 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.448376  4402 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:30.448922  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.449599  4218 leader_election.cc:336] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 4.135s (SENT)
I20260709 12:21:30.413087  7594 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:21:30.453544  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.407122  7611 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.431684  7582 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:30.417734  7656 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:21:30.428952  7524 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:21:30.428965  7568 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:21:30.460602  7582 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:30.495927  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 148687us
I20260709 12:21:30.497443  7659 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:30.498076  7325 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:30.499594  7574 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:30.499094  7325 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:30.500571  7325 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:30.500617  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:30.501431  4333 raft_consensus.cc:2393] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:30.501552  7325 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.502786  7325 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:30.499153  7659 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:30.497323  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 127896us
W20260709 12:21:30.510329  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 151878us
I20260709 12:21:30.511355  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:30.508175  7582 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:30.527529  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:30.527732  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 95264.4us
I20260709 12:21:30.467202  7630 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:30.534813  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 116650us
I20260709 12:21:30.535394  4249 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:30.438638  7661 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:21:30.544915  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:30.552042  4249 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:30.552421  4255 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:30.539417  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:30.543467  4254 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:21:30.543850  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.544081  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.556864  4252 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:30.544287  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.544564  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.544894  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.545210  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.547240  7435 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:30.549057  7660 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:21:30.548961  7615 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.549247  7582 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.549868  7630 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.550300  7527 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.580228  4333 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:30.553069  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.580953  4249 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:30.559687  4257 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:30.581578  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:30.561758  7433 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:30.586179  4255 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:30.537501  7609 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:30.538465  7338 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:30.455197  7662 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.558364  7574 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:21:30.571920  4267 tablet_copy_service.cc:140] P 0aa405b398df42edbf74ee643aeb18dc: Received BeginTabletCopySession request for tablet 374e8fa3690a41af9874f32b270bf3e1 from peer 0952d204644f41a88e5e463e697dcc27 ({username='slave'} at 127.0.0.1:57876)
I20260709 12:21:30.572813  7594 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:30.573959  4248 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:30.576360  7611 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:30.577003  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:30.578507  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.587987  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:30.556077  4254 pending_rounds.cc:85] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 5
I20260709 12:21:30.492477  7606 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:30.590755  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51488.1us
I20260709 12:21:30.557389  7637 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:30.601204  4256 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:30.571812  4247 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:30.602200  4248 pending_rounds.cc:85] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 8
I20260709 12:21:30.590416  7661 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:21:30.670961  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.662045  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:30.661846  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:30.679328  4257 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.661384  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.614706  4333 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:30.610365  4248 pending_rounds.cc:107] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:21:30.608340  4254 pending_rounds.cc:107] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:21:30.692451  4254 raft_consensus.cc:2889] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:30.692948  4254 pending_rounds.cc:107] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:21:30.693573  4254 raft_consensus.cc:2889] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:30.609023  4326 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:30.691957  4248 raft_consensus.cc:2889] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:30.607241  4267 tablet_copy_service.cc:161] P 0aa405b398df42edbf74ee643aeb18dc: Beginning new tablet copy session on tablet 374e8fa3690a41af9874f32b270bf3e1 from peer 0952d204644f41a88e5e463e697dcc27 at {username='slave'} at 127.0.0.1:57876: session id = 0952d204644f41a88e5e463e697dcc27-374e8fa3690a41af9874f32b270bf3e1
I20260709 12:21:30.700435  4329 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:30.661675  4249 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:21:30.606683  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1677161489997161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 12:21:30.601192  7338 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:30.663128  7520 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.707157  4255 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:30.667371  7609 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:30.651867  7577 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.594599  7379 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.660022  7613 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:30.661326  7610 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:30.711755  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.708325  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:30.623816  7661 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:30.613066  7594 consensus_queue.cc:1243] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:30.721310  7582 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.721093  7661 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.722270  7661 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:30.705869  7435 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.723469  7657 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:30.723170  7533 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:30.723837  7657 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:30.724660  7657 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.725602  7533 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.725914  4257 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:30.727365  4332 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:30.653716  7666 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:21:30.713063  7609 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.717902  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:30.694461  7606 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:30.736115  4248 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:21:30.733620  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 72364us
I20260709 12:21:30.726295  7667 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:21:30.663826  7665 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:21:30.747884  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.747896  4334 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:30.738498  4254 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:30.719488  7613 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:30.753978  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51218.5us
I20260709 12:21:30.735962  7496 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:30.759037  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:30.735319  7609 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:30.758047  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:30.762132  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:30.766656  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:30.781795  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:30.783982  7615 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:30.754938  7433 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:30.789811  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:30.790639  4989 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 4: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:30.793097  4991 raft_consensus.cc:1240] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:21:30.719941  7577 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.749200  7594 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:21:30.838699  4990 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:21:30.822824  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.803920  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:30.859237  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 53442.8us
I20260709 12:21:30.870692  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:30.766288  7659 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:30.817893  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 236404us
I20260709 12:21:30.877924  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:30.888317  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.860613  7556 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.885564  4267 tablet_copy_source_session.cc:215] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:30.807022  7527 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.860050  7672 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:30.884282  7433 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:30.911356  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44854.8us
I20260709 12:21:30.803550  7434 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:21:30.836501  7562 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:21:30.859774  7533 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:21:30.862740  7670 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 12:21:30.877501  7337 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:21:30.860313  7669 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:21:30.835789  7677 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 12:21:30.932780  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:30.933347  7434 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:30.791656  7667 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:21:30.900933  7662 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.908517  7556 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:30.911590  7594 consensus_queue.cc:1243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:21:30.965588  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 154654us
W20260709 12:21:30.963641  7681 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:21:30.971993  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:30.857765  7613 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:30.995133  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 114735us
I20260709 12:21:30.969406  7434 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:30.996156  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.004060  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:31.005301  4296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.652s (SENT) [suppressed 35 similar messages]
I20260709 12:21:30.979601  7670 consensus_queue.cc:1243] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:30.973461  7379 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:30.998788  7615 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:31.011016  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:31.010977  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 140387us
I20260709 12:21:30.992024  7677 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:31.013949  4296 leader_election.cc:336] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.945s (SENT)
I20260709 12:21:31.018010  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:31.018127  7613 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:31.018908  4987 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:31.015465  7434 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:31.022775  7525 consensus_meta.cc:287] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 12:21:31.028272  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 813) took 1036 ms. Trace:
I20260709 12:21:30.995628  7682 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.033757  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.037941  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.040046  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:31.030041  4983 rpcz_store.cc:276] 0709 12:21:29.992063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.002397 (+ 10334us) service_pool.cc:224] Handling call
0709 12:21:30.002693 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.083779 (+ 81086us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:30.140835 (+ 57056us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.296419 (+155584us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b1800375040. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91522 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:30.321914 (+ 25495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.321976 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:30.322024 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.028053 (+706029us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b5400498c54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:31.028107 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.028218 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38496,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":4670,"raft.queue_time_us":762,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8004,"spinlock_wait_cycles":223837184,"thread_start_us":237115,"threads_started":2}
I20260709 12:21:31.034791  7667 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:31.043376  7682 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:31.044904  7690 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:31.045642  7682 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:31.046469  7615 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:31.047720  7691 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:31.035147  7455 raft_consensus.cc:476] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:21:31.036962  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.010429  7674 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:31.081140  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67218.7us
W20260709 12:21:31.084848  4296 leader_election.cc:336] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.037s (SENT)
I20260709 12:21:31.085305  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:31.082221  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.086586  4402 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:30.999006  7562 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:21:31.092437  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.094156  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:30.999027  7659 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:21:31.095602  4402 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:31.027762  7631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.014s	sys 0.007s
I20260709 12:21:31.114012  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.038897  7525 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.115192  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.039688  7577 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:31.124980  4247 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:31.133329  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.176930  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.178216  4405 raft_consensus.cc:2410] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:21:31.177371  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 92554.6us
I20260709 12:21:31.178048  4326 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:21:31.169930  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.180112  4403 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:31.182629  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.093822  7677 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:31.182101  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:31.183437  4402 raft_consensus.cc:2393] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:31.131904  7631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.015s	sys 0.008s
I20260709 12:21:31.188952  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.189543  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:31.166280  7645 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:21:31.190846  4401 raft_consensus.cc:2368] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8.
I20260709 12:21:31.120962  7630 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:31.180105  7524 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:31.195672  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.198086  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.121543  7698 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:31.205595  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.210397  4409 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:31.212172  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 201203us
I20260709 12:21:31.211696  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.213426  4401 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.194044  7568 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:31.199656  7434 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:31.199734  7594 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:31.195330  7566 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.215943  7524 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.223147  4402 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:31.224622  7594 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.226821  7594 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:31.227254  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.227427  7696 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.231917  7697 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:31.231873  7696 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.232672  7697 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:31.211704  7698 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:31.234020  7698 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:31.234614  7696 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:31.235836  7702 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:21:31.096983  7674 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.228331  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:31.249475  7652 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.966s	user 0.000s	sys 0.003s
I20260709 12:21:31.228165  7520 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:21:31.251835  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 812) took 1286 ms. Trace:
I20260709 12:21:31.252254  4986 rpcz_store.cc:276] 0709 12:21:29.965820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.965953 (+   133us) service_pool.cc:224] Handling call
0709 12:21:29.989602 (+ 23649us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:30.008564 (+ 18962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:30.008597 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:30.009168 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:21:30.133180 (+124012us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:30.133224 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:30.133293 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:31.248919 (+1115626us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:31.251526 (+  2607us) raft_consensus.cc:1685] finished
0709 12:21:31.251548 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:31.251774 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2377,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":71232768,"thread_start_us":123639,"threads_started":1,"wal-append.queue_time_us":249650}
I20260709 12:21:31.237351  7562 consensus_queue.cc:1059] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:31.228463  7568 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:31.255849  7568 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.256259  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.257238  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:31.257395  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.258415  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:31.258786  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.223541  7379 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:31.261840  4218 connection.cc:256] RPC call timeout handler was delayed by -1.7011686679998093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3165s for a response
W20260709 12:21:31.273375  4218 connection.cc:256] RPC call timeout handler was delayed by -1.6665460720000738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260709 12:21:31.274564  4984 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:31.270123  4990 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:31.274711  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:31.270905  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.267551  4409 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:31.280467  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.282644  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.285017  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:31.285665  4257 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
W20260709 12:21:31.259043  7610 consensus_meta.cc:287] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:21:31.240675  7556 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:31.290865  4257 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:31.291832  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:31.293078  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:31.296211  4252 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:31.270406  7520 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:31.271404  7379 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:31.297501  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:31.288035  7682 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:31.237335  7566 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:31.305806  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.290506  7577 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:31.278350  7613 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:21:31.328457  4296 leader_election.cc:336] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 3.328s (SENT)
I20260709 12:21:31.328907  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:31.333382  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.333668  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.335659  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.310113  7594 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:31.320623  7577 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:31.341506  4402 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:31.322625  7603 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:31.346698  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:31.310436  7696 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:21:31.319613  7527 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:21:31.319447  7610 consensus_queue.cc:1059] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:21:31.355201  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81304.9us
I20260709 12:21:31.345640  7658 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:21:31.345871  7577 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:31.243755  7677 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:31.344544  7525 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:31.341149  7710 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:31.373723  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:31.374804  7695 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.104s
W20260709 12:21:31.379387  7699 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:21:31.380551  7671 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:21:31.380853  4987 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:31.382017  7676 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:21:31.382732  7676 consensus_queue.cc:1243] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:31.383713  7685 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:21:31.385303  7706 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:21:31.388975  4990 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:31.391788  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:31.402810  4218 leader_election.cc:336] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.503s (SENT)
I20260709 12:21:31.411804  4401 raft_consensus.cc:2468] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:31.412526  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:31.354373  7603 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.350354  7379 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:31.413147  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.463213  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:31.484021  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.067853  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:31.452943  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50188.6us
W20260709 12:21:31.700785  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:31.357535  7527 consensus_queue.cc:1243] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 0aa405b398df42edbf74ee643aeb18dc log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:31.508189  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:32.094977  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:32.074296  4402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.010s	sys 0.001s
W20260709 12:21:31.504946  7706 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:21:31.745939  7707 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.015252  7434 consensus_meta.cc:287] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.003s
I20260709 12:21:31.982228  7685 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:31.806185  7675 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:21:32.000905  7606 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.255s	user 0.009s	sys 0.005s
W20260709 12:21:31.542238  7700 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:21:31.901062  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374e8fa3690a41af9874f32b270bf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:32.121621  4402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.013s	sys 0.003s
I20260709 12:21:32.100852  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.068804  4987 raft_consensus.cc:2410] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:21:32.122951  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.135850  4408 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:32.136224  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.136657  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.137319  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.137717  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.138252  4408 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:32.138365  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.139645  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.140228  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.098821  7667 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:31.561345  7708 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
W20260709 12:21:31.562525  7711 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:21:31.913357  7714 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 12:21:32.126811  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.154495  4985 raft_consensus.cc:2410] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:21:32.127648  4407 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:31.412771  7568 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.124022  7462 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.844s	user 0.017s	sys 0.004s
I20260709 12:21:32.130530  7434 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.129921  4218 leader_election.cc:336] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.459s (SENT)
W20260709 12:21:32.015070  7698 consensus_meta.cc:287] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.000s
W20260709 12:21:32.131835  7594 consensus_meta.cc:287] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.000s
I20260709 12:21:32.121513  7379 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.140772  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.121256  7720 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:31.937122  7609 consensus_meta.cc:287] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 1.159s	user 0.008s	sys 0.004s
I20260709 12:21:32.142571  4404 raft_consensus.cc:2410] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:21:32.148973  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 84837.8us
I20260709 12:21:32.185891  4987 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:32.157755  7462 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.877s	user 0.018s	sys 0.005s
I20260709 12:21:32.155602  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:31.813339  7674 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:32.180477  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50562.2us
I20260709 12:21:32.182638  4985 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:32.126750  7707 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:32.157410  7577 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.002s
I20260709 12:21:32.126420  7696 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:32.200158  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.201385  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.202024  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.130753  7685 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.205514  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1879) took 1201 ms. Trace:
I20260709 12:21:32.183863  7594 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.212965  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.152544  7667 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.215794  4255 rpcz_store.cc:276] 0709 12:21:31.004334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.004464 (+   130us) service_pool.cc:224] Handling call
0709 12:21:31.004761 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.010656 (+  5895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.010698 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.011245 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.098349 (+ 87104us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:31.098467 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.098597 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.205299 (+1106702us) raft_consensus.cc:1685] finished
0709 12:21:32.205317 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.205455 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6067,"raft.queue_time_us":30160,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":47601,"thread_start_us":69930,"threads_started":1,"wal-append.queue_time_us":259453}
I20260709 12:21:32.179695  7434 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.224728  4253 raft_consensus.cc:2410] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:32.162990  7568 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.231791  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.180049  7698 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.225889  7603 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.227860  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:32.218000  7721 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:21:32.191514  7551 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:21:32.245240  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2453) took 1043 ms. Trace:
I20260709 12:21:32.245653  4402 rpcz_store.cc:276] 0709 12:21:31.201648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.348001 (+146353us) service_pool.cc:224] Handling call
0709 12:21:31.364157 (+ 16156us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:31.364640 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.364666 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:31.365436 (+   770us) log.cc:844] Serialized 52 byte log entry
0709 12:21:32.139393 (+773957us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.162733 (+ 23340us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.163212 (+   479us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.180624 (+ 17412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.180695 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.245044 (+ 64349us) raft_consensus.cc:1685] finished
0709 12:21:32.245063 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.245187 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17205,"prepare.queue_time_us":59975,"raft.queue_time_us":44136,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":15763,"spinlock_wait_cycles":5383936,"thread_start_us":792286,"threads_started":2,"wal-append.queue_time_us":733119}
I20260709 12:21:32.242923  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.247813  7685 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.248682  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 657) took 1046 ms. Trace:
I20260709 12:21:32.249053  4401 rpcz_store.cc:276] 0709 12:21:31.201929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.247909 (+1045980us) service_pool.cc:224] Handling call
0709 12:21:32.248207 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.248384 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.248410 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.248455 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:32.248489 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.248540 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.248632 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.250627  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 658) took 1043 ms. Trace:
I20260709 12:21:32.250908  4401 rpcz_store.cc:276] 0709 12:21:31.207648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.249916 (+1042268us) service_pool.cc:224] Handling call
0709 12:21:32.250183 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.250344 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.250368 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.250405 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:32.250440 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.250488 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.250580 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.249053  7657 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.252282  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2451) took 1069 ms. Trace:
I20260709 12:21:32.253403  4402 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 7. Ops: []
I20260709 12:21:32.254168  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2454) took 1034 ms. Trace:
I20260709 12:21:32.252722  4406 rpcz_store.cc:276] 0709 12:21:31.182629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.199461 (+ 16832us) service_pool.cc:224] Handling call
0709 12:21:31.205666 (+  6205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.208553 (+  2887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.208584 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.216101 (+  7517us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.307103 (+ 91002us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:31.307138 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.307202 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.251069 (+943867us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b2400200798. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadb179c4 00007fdbadb15acb 00007fdbadcd0dc9 00007fdbadcd0a55 00007fdbadccffb0 00007fdbb0946488 00007fdbb0946be8 00007fdbb091e398 00007fdbb091976a 00007fdbb0918bb6
0709 12:21:32.251917 (+   848us) raft_consensus.cc:1685] finished
0709 12:21:32.251941 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.252201 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4829,"raft.queue_time_us":3009,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3978,"spinlock_wait_cycles":7140480,"thread_start_us":81165,"threads_started":1,"wal-append.queue_time_us":117747}
I20260709 12:21:32.254431  4402 rpcz_store.cc:276] 0709 12:21:31.219623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.252966 (+1033343us) service_pool.cc:224] Handling call
0709 12:21:32.253254 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.253953 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.254118 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.257347  4402 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:32.257432  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2439) took 1221 ms. Trace:
I20260709 12:21:32.257591  7698 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.257934  4404 rpcz_store.cc:276] 0709 12:21:31.036150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.036290 (+   140us) service_pool.cc:224] Handling call
0709 12:21:32.257206 (+1220916us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000bc7d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:32.257343 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407186816}
I20260709 12:21:32.259577  7667 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.260231  7435 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:32.260673  7435 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:32.261919  7435 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.262277  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2456) took 1031 ms. Trace:
W20260709 12:21:32.263916  4984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 795) took 1484 ms (client timeout 1537 ms). Trace:
W20260709 12:21:32.264660  4984 rpcz_store.cc:269] 0709 12:21:30.779094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.779229 (+   135us) service_pool.cc:224] Handling call
0709 12:21:32.263755 (+1484526us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b540071f2d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:32.263853 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752308608}
I20260709 12:21:32.265196  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1867) took 1733 ms. Trace:
I20260709 12:21:32.215126  7577 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.265605  4250 rpcz_store.cc:276] 0709 12:21:30.531872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.532014 (+   142us) service_pool.cc:224] Handling call
0709 12:21:30.539765 (+  7751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.645224 (+105459us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:30.714484 (+ 69260us) log.cc:844] Serialized 14 byte log entry
0709 12:21:30.868609 (+154125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:30.868639 (+    30us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:30.868667 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.264969 (+1396302us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400120554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:32.265018 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.265136 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246522,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":14736,"raft.run_wall_time_us":3583,"spinlock_wait_cycles":255360000,"thread_start_us":222265,"threads_started":2,"wal-append.queue_time_us":282506,"wal-append.run_cpu_time_us":1385,"wal-append.run_wall_time_us":1045211}
I20260709 12:21:32.188915  7720 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.267602  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.267879  7577 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.188795  7609 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.269148  4248 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:32.212100  7606 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.270139  7609 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.270043  7606 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.270587  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.271178  4248 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:32.272047  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.272225  7606 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.273008  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.243317  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:32.269147  7720 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.273238  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 652) took 1058 ms. Trace:
I20260709 12:21:32.240193  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.233501  4987 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:32.268690  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:32.285614  4250 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.280841  4255 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:32.276072  4403 rpcz_store.cc:276] 0709 12:21:31.179414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.184636 (+  5222us) service_pool.cc:224] Handling call
0709 12:21:31.184927 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:31.186643 (+  1716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.186670 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:31.189259 (+  2589us) log.cc:844] Serialized 26 byte log entry
0709 12:21:31.320687 (+131428us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:31.320744 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.320839 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.237836 (+916997us) raft_consensus.cc:1685] finished
0709 12:21:32.237862 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.238000 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1331,"raft.queue_time_us":3162,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7119,"thread_start_us":128769,"threads_started":1,"wal-append.queue_time_us":157596}
W20260709 12:21:32.242816  7719 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:21:32.288622  4371 connection.cc:256] RPC call timeout handler was delayed by -1.2057523489997948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 12:21:32.290827  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 669) took 1747 ms. Trace:
W20260709 12:21:32.281563  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 94334.2us
I20260709 12:21:32.263130  7435 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:32.301537  4408 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:21:32.281757  4248 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:32.264241  4402 rpcz_store.cc:276] 0709 12:21:31.230404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.256906 (+1026502us) service_pool.cc:224] Handling call
0709 12:21:32.257194 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.257686 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.262211 (+  4525us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:32.311115  4296 leader_election.cc:336] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.992s (SENT)
I20260709 12:21:32.311240  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2459) took 1052 ms. Trace:
I20260709 12:21:32.301986  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:32.312165  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:32.286227  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2457) took 1046 ms. Trace:
I20260709 12:21:32.263844  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 659) took 1047 ms. Trace:
I20260709 12:21:32.289276  7606 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:32.289860  4255 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:21:32.291143  4371 connection.cc:256] RPC call timeout handler was delayed by -1.1922523489997729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:21:32.315693  4371 connection.cc:256] RPC call timeout handler was delayed by -1.170652348999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:21:32.311640  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 165295us
I20260709 12:21:32.313146  4401 rpcz_store.cc:276] 0709 12:21:31.216388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.251760 (+1035372us) service_pool.cc:224] Handling call
0709 12:21:32.263368 (+ 11608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.263552 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.263577 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.263617 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:32.263656 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.263707 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.263793 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.313030  4404 rpcz_store.cc:276] 0709 12:21:31.240109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.258913 (+1018804us) service_pool.cc:224] Handling call
0709 12:21:32.259212 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.283045 (+ 23833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.283066 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.285956 (+  2890us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:32.285999 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.286059 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.286176 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.255200  4406 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.336156  4406 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:32.291230  4256 rpcz_store.cc:276] 0709 12:21:30.553726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.564113 (+ 10387us) service_pool.cc:224] Handling call
0709 12:21:30.593059 (+ 28946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.609602 (+ 16543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.290655 (+1681053us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54000df050. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:32.290774 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65675520}
I20260709 12:21:32.299994  7568 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.311918  4408 rpcz_store.cc:276] 0709 12:21:31.258583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.284535 (+1025952us) service_pool.cc:224] Handling call
0709 12:21:32.301226 (+ 16691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.310954 (+  9728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.311180 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.338527  4248 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:21:32.342144  4296 leader_election.cc:336] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.003s (SENT)
W20260709 12:21:32.344308  7731 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:32.344606  7517 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:32.345753  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.346379  4408 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.345836  7338 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.346796  7685 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:32.347381  7577 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.347857  7577 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.348632  7707 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.349957  7577 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.350317  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.347137  7338 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.352097  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.359969  7691 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:32.360502  7691 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.362058  7603 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:32.362684  4408 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:32.319908  7696 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.365545  7659 raft_consensus.cc:3055] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:32.365935  7659 raft_consensus.cc:740] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:32.366739  7659 consensus_queue.cc:260] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.367631  7594 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:32.368050  7659 raft_consensus.cc:3060] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.371788  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.372506  4408 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.372576  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1884) took 1073 ms. Trace:
I20260709 12:21:32.373418  7667 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.373654  7434 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.374112  7703 raft_consensus.cc:3055] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:32.374058  7667 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.374559  7703 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:32.375422  7703 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.376200  7667 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.376377  7703 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:32.379814  7462 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.380306  7462 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.373014  4257 rpcz_store.cc:276] 0709 12:21:31.299594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.299726 (+   132us) service_pool.cc:224] Handling call
0709 12:21:31.300039 (+   313us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:31.315031 (+ 14992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.315072 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:31.332434 (+ 17362us) log.cc:844] Serialized 78 byte log entry
0709 12:21:31.558656 (+226222us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:31.558722 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.558832 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.243885 (+685053us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b48002a0558. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:21:32.372241 (+128356us) raft_consensus.cc:1685] finished
0709 12:21:32.372268 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.372514 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390,"raft.queue_time_us":10169,"raft.run_cpu_time_us":37004,"raft.run_wall_time_us":928362,"spinlock_wait_cycles":8899840,"thread_start_us":208375,"threads_started":1,"wal-append.queue_time_us":785953}
I20260709 12:21:32.382267  7462 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.382395  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:32.383144  4992 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:32.387771  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.391443  4408 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:32.392402  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.392282  7691 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.392959  4408 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.393756  4985 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:32.395263  4402 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:32.395416  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:32.395897  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2460) took 1106 ms. Trace:
I20260709 12:21:32.396224  4402 rpcz_store.cc:276] 0709 12:21:31.289532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.312822 (+1023290us) service_pool.cc:224] Handling call
0709 12:21:32.352927 (+ 40105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.395673 (+ 42746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.395849 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.341655  4406 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:32.397966  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55847.8us
I20260709 12:21:32.399276  4257 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:32.400315  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.405891  4250 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:32.406697  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1860) took 1018 ms. Trace:
I20260709 12:21:32.408290  4404 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:32.408774  4404 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:32.407150  4250 rpcz_store.cc:276] 0709 12:21:31.387903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.268479 (+880576us) service_pool.cc:224] Handling call
0709 12:21:32.406615 (+138136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.400749  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:32.412985  4406 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:32.415374  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:32.417333  4984 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:32.416242  4404 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.415934  7568 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:32.339784  7606 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.420394  4408 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:32.424201  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:32.421713  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.427276  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.428960  4404 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:32.427098  4402 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:32.425064  7568 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:32.416167  7379 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:32.433837  4247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1875) took 1771 ms (client timeout 1507 ms). Trace:
I20260709 12:21:32.433688  7379 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:32.434216  4247 rpcz_store.cc:269] 0709 12:21:30.662316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.706507 (+ 44191us) service_pool.cc:224] Handling call
0709 12:21:32.433675 (+1727168us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540023ffd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:32.433773 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882320768}
I20260709 12:21:32.434662  7568 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.435688  7379 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.428352  7615 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:32.437187  7615 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.439162  7615 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.416471  7677 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:32.416548  7696 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.443933  7696 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.446013  7696 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.418270  7657 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:32.446762  7657 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:32.447726  7657 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.448297  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.448710  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 647) took 2075 ms. Trace:
I20260709 12:21:32.449115  4400 rpcz_store.cc:276] 0709 12:21:30.373316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.373420 (+   104us) service_pool.cc:224] Handling call
0709 12:21:30.373698 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.529289 (+155591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:30.529318 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:30.529769 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:21:30.603439 (+ 73670us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:30.603496 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.448338 (+1844842us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000bbdd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:32.448386 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.448439 (+    53us) raft_consensus.cc:1685] finished
0709 12:21:32.448451 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.448652 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":695,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":353304320,"thread_start_us":70311,"threads_started":1,"wal-append.queue_time_us":233047,"wal-append.run_cpu_time_us":8992,"wal-append.run_wall_time_us":1363306}
I20260709 12:21:32.451155  4247 pending_rounds.cc:85] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 7
I20260709 12:21:32.451488  4247 pending_rounds.cc:107] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:21:32.451719  4247 raft_consensus.cc:2889] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:32.456672  4404 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:32.457231  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.457571  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2471) took 1091 ms. Trace:
I20260709 12:21:32.458230  4404 rpcz_store.cc:276] 0709 12:21:31.365856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.331793 (+965937us) service_pool.cc:224] Handling call
0709 12:21:32.351957 (+ 20164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.457260 (+105303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.457501 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.465772  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.466356  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.466393  4400 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.468559  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.469362  4404 raft_consensus.cc:2410] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:21:32.414986  7691 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.481961  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.425565  7710 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:32.428184  7676 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.428349  7582 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:32.491155  7637 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:32.495080  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:32.493160  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.495393  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.495572  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.495765  4250 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:32.447844  7524 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.496820  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.494992  7338 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.499351  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 687) took 1108 ms. Trace:
I20260709 12:21:32.499622  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2480) took 1122 ms. Trace:
I20260709 12:21:32.501322  4250 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:32.506016  4256 rpcz_store.cc:276] 0709 12:21:31.391350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.336882 (+945532us) service_pool.cc:224] Handling call
0709 12:21:32.337172 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.337481 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:32.344212 (+  6731us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.478497 (+134285us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.479086 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.479249 (+   163us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:32.479310 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.479402 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.499136 (+ 19734us) raft_consensus.cc:1685] finished
0709 12:21:32.499161 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.499280 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14587,"prepare.queue_time_us":6579,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":26036,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":15545,"thread_start_us":119224,"threads_started":1,"wal-append.queue_time_us":153100}
I20260709 12:21:32.505275  4406 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:32.506175  4408 rpcz_store.cc:276] 0709 12:21:31.376974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.483161 (+1106187us) service_pool.cc:224] Handling call
0709 12:21:32.492776 (+  9615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.499258 (+  6482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.499287 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.499348 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:32.499393 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.499469 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.499569 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.508596  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 662) took 1278 ms. Trace:
I20260709 12:21:32.508816  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 800) took 1510 ms. Trace:
I20260709 12:21:32.509060  4406 rpcz_store.cc:276] 0709 12:21:31.230362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.254748 (+1024386us) service_pool.cc:224] Handling call
0709 12:21:32.255054 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.508214 (+253160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.508541 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:32.510599  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.509178  4991 rpcz_store.cc:276] 0709 12:21:30.998902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.999085 (+   183us) service_pool.cc:224] Handling call
0709 12:21:30.999545 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:30.999993 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:31.000035 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.438969 (+1438934us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b2c000f5d58. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbaf677a11 00007fdbaf687372 00007fdbb0db9a01 00007fdbb0d7e43a 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2
0709 12:21:32.439380 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.490503 (+ 51123us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:32.490543 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.490614 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.492362 (+  1748us) raft_consensus.cc:1685] finished
0709 12:21:32.492390 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.508760 (+ 16370us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":459,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":103,"spinlock_wait_cycles":19238144,"thread_start_us":50693,"threads_started":1,"wal-append.queue_time_us":51086}
W20260709 12:21:32.527431  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.531002  7325 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:32.495194  7462 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.450707  7677 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.536226  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.538193  4408 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.536696  4406 raft_consensus.cc:1240] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:32.532120  7524 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:32.533075  7609 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:21:32.544759  7606 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.531807  7720 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:32.531651  7325 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:32.501982  7676 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.572089  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.573004  4406 raft_consensus.cc:2376] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6. Re-sending same reply.
I20260709 12:21:32.564759  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:32.584229  7435 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.584864  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.586731  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.552023  7524 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.557834  4408 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:32.590114  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:32.565364  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.506856  7710 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.591125  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.596007  4408 raft_consensus.cc:2376] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8. Re-sending same reply.
I20260709 12:21:32.596860  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.599522  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:32.585851  7435 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:32.604285  7745 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:32.658802  7745 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.659150  7524 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.660772  7582 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.660960  7745 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:32.661105  7677 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.662863  7676 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.604642  7736 raft_consensus.cc:2764] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:21:32.619033  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.664567  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.623347  4296 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.570s (SENT)
I20260709 12:21:32.665346  7310 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:32.665839  7310 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.667896  7310 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:32.671056  7325 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.672284  4248 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:32.672500  7325 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:32.672868  7338 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:32.575145  7685 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.629849  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.817436  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.737057  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.724689  4402 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:32.845407  4248 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:32.828649  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.846396  4409 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:32.756554  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 82988.7us
W20260709 12:21:32.789091  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.847721  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.848379  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:32.752826  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.849185  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 1030) took 1229 ms. Trace:
W20260709 12:21:32.653097  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53690.3us
I20260709 12:21:32.676385  4400 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:32.675989  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.830037  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:32.849889  4988 rpcz_store.cc:276] 0709 12:21:31.619884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.620169 (+   285us) service_pool.cc:224] Handling call
0709 12:21:32.817204 (+1197035us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:21:32.849122 (+ 31918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11761408}
I20260709 12:21:32.851105  4406 raft_consensus.cc:2376] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7. Re-sending same reply.
I20260709 12:21:32.851197  4257 raft_consensus.cc:2376] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5. Re-sending same reply.
I20260709 12:21:32.674216  4408 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:32.852254  4332 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:32.731083  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2489) took 2337 ms. Trace:
I20260709 12:21:32.857625  4334 rpcz_store.cc:276] 0709 12:21:30.390845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.391275 (+   430us) service_pool.cc:224] Handling call
0709 12:21:30.413119 (+ 21844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:30.749865 (+336746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.727687 (+1977822us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54001054d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:32.727885 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769281920}
I20260709 12:21:32.866030  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.881312  4400 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:32.796510  7710 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:32.805073  7666 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:21:32.889163  4296 leader_election.cc:336] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.508s (SENT)
I20260709 12:21:32.891705  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.891985  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:32.652631  7667 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:32.881655  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:32.737703  7688 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 1.877s	user 0.000s	sys 0.012s
I20260709 12:21:32.882823  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.898219  4400 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:32.737703  7752 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:21:32.894802  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:32.897115  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:32.898716  4406 raft_consensus.cc:2376] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7. Re-sending same reply.
W20260709 12:21:32.731176  7718 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:21:32.895450  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:32.728822  7676 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:32.849563  7630 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:32.787835  7594 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.849118  7677 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:32.906611  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:32.598256  7606 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.298s
I20260709 12:21:32.908638  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2479) took 1532 ms. Trace:
I20260709 12:21:32.909602  4409 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:32.925210  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:32.911465  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.862097  7745 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:32.910866  4331 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:32.935766  7745 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.905140  7710 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.804041  7566 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:32.896504  7673 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.919472  4334 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:21:32.924078  4296 leader_election.cc:336] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.652s (SENT)
I20260709 12:21:32.925860  4406 raft_consensus.cc:2376] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7. Re-sending same reply.
I20260709 12:21:32.925707  4404 rpcz_store.cc:276] 0709 12:21:31.376684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.469950 (+1093266us) service_pool.cc:224] Handling call
0709 12:21:32.470236 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:32.470581 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.470610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:32.471047 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:21:32.562168 (+ 91121us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:32.900352 (+338184us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.908206 (+  7854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.908310 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.908372 (+    62us) raft_consensus.cc:1685] finished
0709 12:21:32.908391 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.908553 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7047,"raft.queue_time_us":7286,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":4114,"thread_start_us":402997,"threads_started":2,"wal-append.queue_time_us":121477}
I20260709 12:21:32.929785  4257 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:32.948215  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:32.933184  7697 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:32.915642  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.864668  7685 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.938246  4409 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:21:32.939553  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.940778  4400 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:32.911685  7666 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:32.939035  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 663) took 1668 ms. Trace:
I20260709 12:21:32.960355  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.960814  4991 pending_rounds.cc:85] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 5
I20260709 12:21:32.960958  4987 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:32.961318  4991 pending_rounds.cc:107] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:21:32.961712  4991 raft_consensus.cc:2889] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:32.962961  4400 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:32.964526  4404 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:32.964601  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:32.965801  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.925438  7630 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.915017  7435 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:21:32.970316  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.971101  4986 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:32.972620  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:32.974233  4955 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:32.947729  7667 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:32.977658  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.981865  4986 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:32.979001  4409 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:32.979061  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.983350  4987 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:32.956784  4403 rpcz_store.cc:276] 0709 12:21:31.270763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.288268 (+1017505us) service_pool.cc:224] Handling call
0709 12:21:32.288574 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:32.290658 (+  2084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:32.290686 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:32.300400 (+  9714us) log.cc:844] Serialized 52 byte log entry
0709 12:21:32.421111 (+120711us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:32.930625 (+509514us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003d6b40. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:32.936231 (+  5606us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18003d6b40. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb47763c7 00007fdbb0d889a7 00007fdbb0d980bf
0709 12:21:32.936376 (+   145us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.938749 (+  2373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.938814 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:32.938852 (+    38us) raft_consensus.cc:1685] finished
0709 12:21:32.938862 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:32.938983 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2101,"prepare.queue_time_us":70116,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":8966,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":24623,"spinlock_wait_cycles":27427584,"thread_start_us":102705,"threads_started":2,"wal-append.queue_time_us":153026}
I20260709 12:21:32.979848  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:32.947937  7736 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:32.953315  7566 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:32.924356  7676 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:32.987692  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.963979  7496 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:32.997347  4253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1859) took 1609 ms (client timeout 1601 ms). Trace:
I20260709 12:21:33.001767  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 822) took 1623 ms. Trace:
W20260709 12:21:33.016736  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.016790  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.041780  4250 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:33.040443  4983 rpcz_store.cc:276] 0709 12:21:31.377956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.379232 (+  1276us) service_pool.cc:224] Handling call
0709 12:21:31.379572 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:32.125394 (+745822us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:32.156958 (+ 31564us) log.cc:844] Serialized 14 byte log entry
0709 12:21:32.212054 (+ 55096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:32.212100 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:32.212166 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:32.436427 (+224261us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b180043e9a0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91557 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:33.001461 (+565034us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540049cd54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:33.001524 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.001688 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98945,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3182,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3916,"spinlock_wait_cycles":1737156736,"thread_start_us":86024,"threads_started":2,"wal-append.queue_time_us":124632}
I20260709 12:21:32.964349  7697 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:33.023622  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:32.989156  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:33.048243  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:32.937469  7594 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:32.946251  7677 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.037786  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:33.021085  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:32.975449  7671 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:33.039577  4253 rpcz_store.cc:269] 0709 12:21:31.387613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.212687 (+825074us) service_pool.cc:224] Handling call
0709 12:21:32.997049 (+784362us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b540019ad54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:32.997249 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10559872}
W20260709 12:21:33.057906  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.020249  7566 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:33.115381  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 141218us
I20260709 12:21:32.981017  7524 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:33.145169  4334 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:32.971714  7606 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:21:33.121932  4987 raft_consensus.cc:2376] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7. Re-sending same reply.
W20260709 12:21:33.132997  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.051493  7616 consensus_meta.cc:287] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.003s
W20260709 12:21:33.148553  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 194825us
I20260709 12:21:32.969959  7740 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.162s
I20260709 12:21:33.046264  7613 raft_consensus.cc:2804] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:33.154189  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.157485  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.156194  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.154873  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.158356  4332 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:33.038280  7666 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:21:33.143644  7736 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:33.045831  7496 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.021651  7667 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.192523  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.204061  4989 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:21:33.186240  7435 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:33.208819  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.190346  7691 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.206423  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.207803  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:33.207206  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.214727  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1032) took 1268 ms. Trace:
I20260709 12:21:33.214686  4404 raft_consensus.cc:2376] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7. Re-sending same reply.
I20260709 12:21:33.186444  7613 raft_consensus.cc:697] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:33.215231  4989 rpcz_store.cc:276] 0709 12:21:31.946307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.066685 (+120378us) service_pool.cc:224] Handling call
0709 12:21:33.203204 (+1136519us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5800004598. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:33.203821 (+   617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.214475 (+ 10654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.214673 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54682880}
I20260709 12:21:33.191037  7736 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:33.214669  4403 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:33.193079  7745 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.231817  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.232921  4409 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 9 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:21:33.235670  4325 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:32.955960  7673 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.202273  7765 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:33.243417  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.212432  7666 consensus_queue.cc:1243] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0aa405b398df42edbf74ee643aeb18dc log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:21:33.213603  7520 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.258062  4325 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:33.234565  7736 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.273970  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.243597  7745 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:33.269513  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:33.279402  7763 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:21:33.280472  7760 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:21:33.281302  7770 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:33.284147  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 653) took 2099 ms. Trace:
I20260709 12:21:33.285595  7685 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.284613  4405 rpcz_store.cc:276] 0709 12:21:31.184794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.195824 (+ 11030us) service_pool.cc:224] Handling call
0709 12:21:31.200041 (+  4217us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:31.208223 (+  8182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:31.300553 (+ 92330us) log.cc:844] Serialized 14 byte log entry
0709 12:21:31.341638 (+ 41085us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:31.347728 (+  6090us) log.cc:844] Serialized 52 byte log entry
0709 12:21:31.347879 (+   151us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:31.347903 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:31.347949 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.191714 (+1843765us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b18003d6840. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:33.283793 (+ 92079us) raft_consensus.cc:1685] finished
0709 12:21:33.283911 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.284082 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7674,"prepare.queue_time_us":155808,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":5702,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":7360,"spinlock_wait_cycles":35879808,"thread_start_us":95697,"threads_started":2,"wal-append.queue_time_us":209545}
W20260709 12:21:33.290655  4252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 670) took 2727 ms (client timeout 2028 ms). Trace:
W20260709 12:21:33.290824  4407 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2452) took 2102 ms (client timeout 2459 ms). Trace:
W20260709 12:21:33.291074  4252 rpcz_store.cc:269] 0709 12:21:30.563150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:30.563332 (+   182us) service_pool.cc:224] Handling call
0709 12:21:33.290481 (+2727149us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54003c05d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:33.290592 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583517952}
W20260709 12:21:33.291482  4407 rpcz_store.cc:269] 0709 12:21:31.188335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:31.190551 (+  2216us) service_pool.cc:224] Handling call
0709 12:21:33.290517 (+2099966us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:33.290718 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108267008}
W20260709 12:21:33.292595  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.293407  7616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52880 (request call id 804) took 4266 ms. Trace:
I20260709 12:21:33.294534  4401 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:33.295053  4401 pending_rounds.cc:85] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 7
I20260709 12:21:33.295343  4401 pending_rounds.cc:107] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:33.295709  4401 raft_consensus.cc:2889] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:33.295938  7676 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:33.298038  7433 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:21:33.298503  7433 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.246059  7765 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:33.298943  7433 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.299415  7667 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.299945  7667 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.299991  7765 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.300510  7667 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.300994  7433 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.301349  7765 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.302505  7667 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.303627  7566 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.274796  4334 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:33.284262  7630 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.221560  7691 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:33.221750  7435 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.259543  7666 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:33.322100  7688 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:33.264936  7520 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.282816  7613 consensus_queue.cc:237] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:33.399717  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 238039us
W20260709 12:21:33.407347  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 394489us
I20260709 12:21:33.408573  4325 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:33.402019  7568 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.439163  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.443012  4326 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:33.440244  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.403920  7637 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:33.443887  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.395596  7455 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:33.401741  7672 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.318840  7745 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:33.446810  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.465857  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:33.466305  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.410943  7594 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.448452  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.410683  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:33.467696  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 125218us
I20260709 12:21:33.293881  7616 rpcz_store.cc:276] 0709 12:21:29.026799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.026968 (+   169us) service_pool.cc:224] Handling call
0709 12:21:29.475379 (+448411us) ts_tablet_manager.cc:934] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Initiating tablet copy from peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061)
0709 12:21:31.319708 (+1844329us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:21:32.496694 (+1176986us) tablet_metadata.cc:665] Metadata flushed
0709 12:21:32.509758 (+ 13064us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:21:33.186742 (+676984us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:21:33.240969 (+ 54227us) tablet_replica.cc:206] Creating consensus instance
0709 12:21:33.272224 (+ 31255us) ts_tablet_manager.cc:989] Replica registered.
0709 12:21:33.275648 (+  3424us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":80555,"tablet-copy.queue_time_us":291139,"thread_start_us":506586,"threads_started":2}
W20260709 12:21:33.472795  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 313216us
W20260709 12:21:33.440191  7703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.026s
I20260709 12:21:33.413642  7496 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:33.477859  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67244.6us
W20260709 12:21:33.468503  4218 leader_election.cc:336] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.129s (SENT)
I20260709 12:21:33.389832  7666 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.478618  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:33.436904  7671 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:21:33.481135  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.451866  7637 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:33.474145  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.479133  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:33.479693  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.486418  4326 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:33.414577  7622 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:33.484221  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.455662  7455 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:33.483565  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:33.485277  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 215844us
I20260709 12:21:33.488143  4334 raft_consensus.cc:2410] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:33.479830  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:33.474793  7703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.026s
I20260709 12:21:33.490582  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.469971  7677 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.493301  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.499001  4325 raft_consensus.cc:2410] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:33.492654  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.488914  7496 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:33.502460  7496 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.502862  7496 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.504179  7435 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.505059  7310 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:33.505478  7310 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.505632  7606 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:33.505903  7310 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:33.506094  7606 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:33.507247  7782 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:33.507781  7683 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.450767  7568 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.530370  7568 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.532508  7666 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.511643  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.512547  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.515946  4955 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:33.489382  7622 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:33.464818  7672 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.519107  7520 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:33.487772  7637 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:33.485074  7671 consensus_queue.cc:1243] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:33.495911  7551 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:33.480613  7603 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:33.526855  7455 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.494004  7616 tablet_copy_client.cc:806] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:33.550901  7616 tablet_copy_client.cc:670] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:33.553336  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2470) took 2187 ms. Trace:
I20260709 12:21:33.553706  4401 rpcz_store.cc:276] 0709 12:21:31.365584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.331854 (+966270us) service_pool.cc:224] Handling call
0709 12:21:33.294046 (+962192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:33.296153 (+  2107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.553138 (+256985us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54002b66d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:33.553282 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204411264}
I20260709 12:21:33.542680  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1708) took 1202 ms. Trace:
I20260709 12:21:33.545145  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.523085  7677 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:33.547080  4218 leader_election.cc:336] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 4.003s (SENT)
I20260709 12:21:33.550128  7568 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.555888  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:33.555051  4406 rpcz_store.cc:276] 0709 12:21:32.340191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.947109 (+606918us) service_pool.cc:224] Handling call
0709 12:21:32.947799 (+   690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.022193 (+ 74394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:33.022223 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.022649 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:21:33.326261 (+303612us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:33.394410 (+ 68149us) log.cc:844] Serialized 14 byte log entry
0709 12:21:33.402741 (+  8331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.534739 (+131998us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b1800486340. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc5f2a6 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419
0709 12:21:33.542289 (+  7550us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b5400286754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:33.542345 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:33.542389 (+    44us) raft_consensus.cc:1685] finished
0709 12:21:33.542410 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:33.542601 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49351,"prepare.queue_time_us":67352,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":160880,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":45514,"spinlock_wait_cycles":103767296,"thread_start_us":165758,"threads_started":1,"wal-append.queue_time_us":415334}
W20260709 12:21:33.559268  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46773.5us
I20260709 12:21:33.559989  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:33.536870  7673 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.580449  7551 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.541200  7691 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.559178  7455 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:21:33.555122  7773 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:21:33.565410  7676 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:33.581735  7455 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:33.582445  7745 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:33.573880  7325 consensus_meta.cc:287] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.001s
I20260709 12:21:33.578569  4402 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:21:33.584797  4402 pending_rounds.cc:85] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 5
I20260709 12:21:33.585055  4402 pending_rounds.cc:107] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:21:33.585304  4402 raft_consensus.cc:2889] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:33.559394  7568 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:33.523659  7630 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:21:33.579538  7622 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:33.535506  7683 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:33.605532  4371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.011s	sys 0.032s
W20260709 12:21:33.609086  4371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.011s	sys 0.032s
W20260709 12:21:33.609467  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 636876us
W20260709 12:21:33.611491  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 53426.1us
I20260709 12:21:33.556562  7677 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:33.615823  4991 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 3. Current term is 4. Ops: []
I20260709 12:21:33.617342  4986 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:21:33.617245  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 57334us
I20260709 12:21:33.618302  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:33.621155  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.621798  4986 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:33.623749  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.621750  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.625757  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:33.582696  7672 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.643494  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.640189  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.645802  4400 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:33.641438  4408 raft_consensus.cc:1217] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-8.8]   Dedup: 4.6->[6.7-8.8]
I20260709 12:21:33.647008  4408 pending_rounds.cc:85] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 6
I20260709 12:21:33.647338  4408 pending_rounds.cc:107] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:21:33.647642  4408 raft_consensus.cc:2889] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:33.583444  7758 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:33.667066  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.624413  4405 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:33.650593  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.668009  4991 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:33.649683  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.670244  4407 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:33.648958  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:33.606976  7568 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:33.671669  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45991.7us
W20260709 12:21:33.667200  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 48977.5us
I20260709 12:21:33.644723  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.673913  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.674845  4984 raft_consensus.cc:2410] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:33.582650  7455 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:33.605095  7603 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:33.678426  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.679260  4249 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:33.624378  7677 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:33.606684  7787 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:33.681154  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.626809  7759 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:33.682953  4253 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:33.639530  7676 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:33.685566  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.649825  7776 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:33.648936  7766 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.671537  7622 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.676005  7574 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:33.678382  7672 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:33.691128  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:33.682799  7787 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:33.696398  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.688680  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.686893  7676 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.701539  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.702275  4253 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:33.688259  7776 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.624135  7606 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.705226  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.680289  7496 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.698401  7672 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:33.695796  7787 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:33.705883  4329 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:33.712800  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.702623  7676 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:33.706076  7776 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.715274  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.710234  7672 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:21:33.717195  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 170036us
I20260709 12:21:33.717129  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.697896  7767 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:21:33.723122  4329 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:33.708279  7325 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:33.721635  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.722344  4991 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:33.727653  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.720036  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.725940  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.729867  4326 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:33.708480  7574 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:33.715252  7606 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:33.728318  7325 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.736687  7325 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:33.733970  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.737339  7768 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:33.737486  4256 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:33.737883  7768 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.739809  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.740546  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.741394  7768 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.727454  4152 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 5, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:33.734346  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.744973  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.745975  4254 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:33.744261  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.729274  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.759425  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:33.724678  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.768410  4256 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:33.770788  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:33.772096  4256 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:33.774209  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:33.788357  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.790719  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:33.791257  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90988.1us
I20260709 12:21:33.804175  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:33.805109  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:33.805800  4983 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:33.805928  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:33.806967  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:33.810072  7703 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:33.720885  7603 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.792178  7791 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:33.793358  7778 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:33.815092  7310 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:33.820091  7772 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.425s	user 0.004s	sys 0.000s
I20260709 12:21:33.833859  7782 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:33.820291  7310 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.811072  7789 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:33.803934  7766 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:21:33.865849  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.876241  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:33.885835  7788 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:21:33.886602  7637 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.812069  7745 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:33.910799  7496 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.900652  7665 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:21:33.912297  7665 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:33.912657  7665 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:33.913496  4988 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:33.873215  7703 raft_consensus.cc:1064] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:21:33.864624  7782 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:33.916393  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:33.921866  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:33.923323  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.923597  7782 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:33.938889  7782 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.941766  4325 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:33.943696  4956 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:33.827627  7791 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:33.816383  7574 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.948930  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:33.952540  4325 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:33.955498  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:33.955932  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:33.921161  7637 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.950399  7656 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:33.966392  7776 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.969141  7791 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:33.970853  4249 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:33.911016  7672 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:33.957988  7496 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:33.977594  7736 consensus_meta.cc:287] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 12:21:33.940671  7551 consensus_queue.cc:1059] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:21:33.921651  7325 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.001802  4325 raft_consensus.cc:2393] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:33.913506  7665 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:33.970854  7622 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:21:33.991276  7496 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.012475  7662 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:21:34.015430  7325 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:34.015872  7662 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:34.016343  7662 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:34.017433  7787 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.018393  4219 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.020576  7496 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.021529  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.022164  4331 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:34.023969  7677 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.026034  7677 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.031421  7787 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:34.036232  7776 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.036734  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.001950  7676 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.038231  4331 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:34.038686  7676 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.038825  7683 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:33.947083  7789 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:21:34.039739  7551 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.040997  7672 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:34.045470  7790 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 12:21:34.046205  4219 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.046685  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.078438  7496 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.053898  7568 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:34.003856  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 200951us
I20260709 12:21:34.017174  7662 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:34.085768  7662 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.088542  4219 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.000674  7736 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.091852  4406 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:34.092223  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.093551  7551 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:34.093927  7551 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.089174  7789 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.094285  7551 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.096609  7736 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:34.086199  7791 consensus_queue.cc:1175] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 4 index: 4 } }
I20260709 12:21:34.098002  7691 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:34.098124  7783 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.471s	user 0.000s	sys 0.004s
I20260709 12:21:34.066761  4152 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 6, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.100034  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.100485  7774 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:34.101465  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 607247us
I20260709 12:21:34.124213  7789 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:34.124931  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.086199  7568 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:34.126048  4330 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:34.126650  7566 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:34.102944  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.103785  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.105199  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.128465  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.128989  7435 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:34.129137  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.129550  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:34.129522  7435 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.130853  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.131634  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.132019  7435 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.124963  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.132676  7435 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.133014  7566 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.105970  7433 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:34.133056  4328 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:34.133756  7433 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.134982  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:34.136319  7433 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.107504  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.136931  7789 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:34.109467  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.136650  7703 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.137573  7789 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.110070  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.110198  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.138464  4400 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.138695  7671 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.139145  7671 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.139482  7671 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.111169  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.141700  4403 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.144758  7665 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.150110  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 686) took 2774 ms. Trace:
I20260709 12:21:34.152083  7683 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:34.152627  7683 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.150609  4255 rpcz_store.cc:276] 0709 12:21:31.375289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:32.317677 (+942388us) service_pool.cc:224] Handling call
0709 12:21:33.003776 (+686099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:33.027179 (+ 23403us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:33.027208 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:33.027687 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:21:33.412940 (+385253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:33.412986 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:33.413051 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:34.097412 (+684361us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:34.121027 (+ 23615us) raft_consensus.cc:1685] finished
0709 12:21:34.121057 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.149903 (+ 28846us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b540019ad50. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:34.150039 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4219,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":1695366912,"thread_start_us":274167,"threads_started":1,"wal-append.queue_time_us":496670}
I20260709 12:21:34.112526  7673 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:34.114135  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.105404  7667 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:34.109206  7551 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:34.155376  7667 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.137936  7789 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.160017  7789 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.161782  7667 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.163910  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.164549  4329 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:34.166090  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.167649  7774 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:34.167598  7433 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:34.168226  7774 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.168637  7774 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:34.169195  7771 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.169844  7771 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.172498  7771 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.173413  7551 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:34.178992  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.179498  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.180337  4326 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:34.181399  4328 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:34.182399  7630 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.182946  7630 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.185324  7630 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.189869  7683 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.190708  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.192457  7782 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:34.194010  7698 raft_consensus.cc:1064] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:21:34.194232  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.195097  4326 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:34.196187  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.208925  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.209856  4328 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.168547  7433 consensus_queue.cc:1243] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:34.214751  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.215026  7770 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:34.224267  7770 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:34.224623  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.225041  7770 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:34.225965  7795 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:34.226504  4152 catalog_manager.cc:5697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 4, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.240123  7770 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.241220  7770 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.242828  7770 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.237212  4326 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:34.238359  7606 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.247635  7606 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.248196  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:34.248332  4409 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:34.248977  7672 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:34.249284  7745 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.246858  7808 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:34.250159  7606 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.249599  7710 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.256229  7433 consensus_queue.cc:1059] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:34.257874  7606 raft_consensus.cc:3055] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:34.258213  4332 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:34.273296  7606 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:34.274426  7606 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.260957  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.261199  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:34.296047  4328 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:34.234861  4325 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:34.261838  7566 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.234457  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.299703  7566 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:34.300134  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 65770.6us
I20260709 12:21:34.300930  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.301728  7435 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.301892  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.302067  7566 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.302676  4987 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:34.302862  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:34.303326  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.303602  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.263085  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.267766  7673 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:34.304157  4992 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.305454  4409 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.305508  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.265287  4247 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:34.310884  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:34.312038  4255 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:34.312551  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:34.312985  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:34.313367  4332 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:34.314181  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.314421  7789 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.315948  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.275022  7710 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:34.276752  7433 consensus_queue.cc:1059] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:34.245596  4400 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:34.267786  4403 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:34.317552  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.318037  7435 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:34.318032  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:34.318822  4253 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:34.318928  7789 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:34.258731  4152 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.269814  7496 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:34.303759  4249 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:34.238560  7671 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.292610  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.322281  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:34.322626  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:34.314888  4987 raft_consensus.cc:2393] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 5: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:34.323598  4252 raft_consensus.cc:2368] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6.
I20260709 12:21:34.326331  4409 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:34.291908  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.318233  4333 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.327891  7606 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.330637  4992 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:34.331787  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.332608  7603 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:34.335041  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.335625  7603 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:34.335588  7673 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:34.335506  7710 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:34.333693  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.336292  7603 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.336539  7673 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.336679  7710 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:34.337018  7795 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:34.335971  7574 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:34.337247  7603 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.338469  7603 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:34.337482  7673 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.338112  7574 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.339663  7574 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.337553  7795 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.337545  7710 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.342468  7795 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:34.345263  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 431934us
I20260709 12:21:34.345817  4152 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.348130  7622 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:34.350538  7829 log.cc:927] Time spent T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:34.351239  4252 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:34.352514  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:34.354197  4151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 369) took 17779 ms (client timeout 15000 ms). Trace:
I20260709 12:21:34.354462  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:34.352519  4329 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:34.357108  4253 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:21:34.323037  7671 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:34.358222  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.359215  7582 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:34.355940  7568 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:34.361567  7698 raft_consensus.cc:1068] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Unable to promote non-voter 0952d204644f41a88e5e463e697dcc27: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }.
  Pending config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.363289  4219 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.364218  7622 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:34.364691  7622 raft_consensus.cc:697] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:34.365556  4330 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:34.365535  7622 consensus_queue.cc:237] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:34.371336  7698 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:34.360121  7582 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.374002  7582 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.265158  7774 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.381381  4248 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:34.382735  7774 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:34.382974  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.359203  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:34.380486  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 75064.4us
I20260709 12:21:34.335052  4333 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:34.384186  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:34.394937  7435 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:34.383172  7771 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:34.396855  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 76574.6us
I20260709 12:21:34.400128  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:34.409499  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50370.9us
I20260709 12:21:34.413300  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.414031  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.414968  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.408560  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.417666  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.419060  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.419966  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.422307  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.423547  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.424477  4401 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:34.427728  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.454716  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:34.444145  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:34.454787  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.456728  4248 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:34.457019  4409 raft_consensus.cc:2376] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8. Re-sending same reply.
I20260709 12:21:34.455009  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.454113  4406 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:34.454433  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.444396  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.459983  4400 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 4.
I20260709 12:21:34.461275  4403 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:34.462543  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:34.354671  4151 rpcz_store.cc:269] 0709 12:21:16.575345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.576043 (+   698us) service_pool.cc:224] Handling call
0709 12:21:34.354104 (+17778061us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:27.749783 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:27.750469 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:27.750523 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:21:27.750543 (+    20us) tablet.cc:662] Decoding operations
0709 12:21:27.752439 (+  1896us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:27.752524 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:27.752552 (+    28us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:21:27.754162 (+  1610us) tablet.cc:701] Row locks acquired
0709 12:21:27.754209 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:21:27.754382 (+   173us) write_op.cc:270] Start()
0709 12:21:27.754528 (+   146us) write_op.cc:276] Timestamp: P: 1783599687754320 usec, L: 0
0709 12:21:27.754550 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:27.907854 (+153304us) log.cc:844] Serialized 8549 byte log entry
0709 12:21:28.961299 (+1053445us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:29.326044 (+364745us) op_driver.cc:464] REPLICATION: finished
0709 12:21:29.918911 (+592867us) write_op.cc:301] APPLY: starting
0709 12:21:29.918997 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:29.919382 (+   385us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:29.919403 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:29.921747 (+  2344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:29.922061 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:21:29.922108 (+    47us) write_op.cc:312] APPLY: finished
0709 12:21:29.922498 (+   390us) log.cc:844] Serialized 152 byte log entry
0709 12:21:29.922663 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:29.922859 (+   196us) write_op.cc:454] Released schema lock
0709 12:21:29.922922 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:29.985890 (+ 62968us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:29.990354 (+  4464us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":191614,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":585488,"apply.run_cpu_time_us":4412,"apply.run_wall_time_us":4411,"num_ops":22,"prepare.queue_time_us":123123,"prepare.run_cpu_time_us":30417,"prepare.run_wall_time_us":485459,"raft.queue_time_us":245703,"raft.run_cpu_time_us":23882,"raft.run_wall_time_us":230931,"replication_time_us":1547594,"spinlock_wait_cycles":7110528,"thread_start_us":456468,"threads_started":4,"wal-append.queue_time_us":467654,"wal-append.run_cpu_time_us":24299,"wal-append.run_wall_time_us":2493664}]]}
I20260709 12:21:34.465706  4405 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:34.467346  4333 raft_consensus.cc:1275] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:34.428578  7808 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:21:34.467734  4333 pending_rounds.cc:85] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:21:34.468109  4333 pending_rounds.cc:107] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:34.468353  4333 raft_consensus.cc:2889] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:34.469197  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.416601  7574 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:34.406526  7435 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:34.421846  7698 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:34.418444  7630 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:34.475966  7830 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:34.470398  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:34.483233  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.434679  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.474539  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.477372  4250 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:34.477454  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:34.465626  7821 log.cc:927] Time spent T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:21:34.421882  7745 raft_consensus.cc:2764] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:21:34.383371  7736 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:34.487243  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.505702  4406 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.488107  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:34.506366  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.506699  4254 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:34.489923  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.507596  4404 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.491442  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:34.499372  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.468429  7676 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:34.508507  4400 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:34.509651  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.520145  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.520313  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.521384  4405 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:34.473194  7776 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.522033  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.526467  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:34.527114  4992 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:34.528040  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.528602  4988 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.530591  4992 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:21:34.531308  4218 leader_election.cc:336] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.643s (SENT)
I20260709 12:21:34.477631  7795 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.527719  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:34.473331  7533 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:21:34.539834  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.541590  4402 raft_consensus.cc:2376] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4. Re-sending same reply.
I20260709 12:21:34.539836  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.543203  4400 raft_consensus.cc:2376] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5. Re-sending same reply.
I20260709 12:21:34.557083  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.557904  4409 raft_consensus.cc:2376] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8. Re-sending same reply.
I20260709 12:21:34.560393  4401 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:34.564263  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.503454  7568 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:34.569885  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:34.582806  4254 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.572512  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:34.575492  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 105212us
I20260709 12:21:34.578276  4988 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:34.494354  7698 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:34.595266  4400 raft_consensus.cc:2376] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7. Re-sending same reply.
I20260709 12:21:34.607769  4400 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:34.599472  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:34.598950  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.610186  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.611146  4401 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:21:34.612033  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 84407.5us
I20260709 12:21:34.624610  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:34.628453  4247 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:21:34.628275  7698 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.584340  7435 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:34.634372  7435 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:34.635790  7630 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:34.636404  7630 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:34.636446  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:34.636929  7630 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.637094  4409 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:34.640363  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 679) took 1011 ms. Trace:
W20260709 12:21:34.640357  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 70528.6us
I20260709 12:21:34.641651  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:34.502224  7594 consensus_queue.cc:1048] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:21:34.535250  7776 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:34.535742  7771 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:34.642774  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:34.610575  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:34.643736  4330 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:34.656563  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:34.559738  7676 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:34.640784  4408 rpcz_store.cc:276] 0709 12:21:33.628603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:33.628801 (+   198us) service_pool.cc:224] Handling call
0709 12:21:33.641174 (+ 12373us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:34.103396 (+462222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:34.103720 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:21:34.283888 (+180168us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:34.284609 (+   721us) log.cc:844] Serialized 52 byte log entry
0709 12:21:34.284786 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:34.284825 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.284898 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:34.639921 (+355023us) raft_consensus.cc:1685] finished
0709 12:21:34.639939 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:34.640091 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432141,"prepare.queue_time_us":696,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":434190,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"thread_start_us":179445,"threads_started":1,"wal-append.queue_time_us":178829}
I20260709 12:21:34.668293  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:34.669019  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:34.669088  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:34.669548  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:34.672049  4252 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.672075  4247 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:34.581871  7568 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:34.686305  4404 raft_consensus.cc:2410] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:21:34.688868  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:34.689199  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45514.6us
W20260709 12:21:34.689409  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46715.5us
I20260709 12:21:34.689674  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:34.653585  7740 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:34.654976  7776 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.675546  7609 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:34.568840  7795 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:34.742309  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52694.4us
I20260709 12:21:34.743356  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:34.609443  4400 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:34.696131  7533 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:34.717002  7616 tablet_copy_client.cc:538] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:34.760597  4400 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:21:34.669133  7582 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:21:34.688390  7691 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:21:34.765512  7789 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.740998  7609 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.765772  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.764703  4406 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:34.767095  7795 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:34.717921  7782 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:34.773650  4991 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:34.719208  7740 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:34.724182  7657 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:34.676121  7771 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:34.718161  7520 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:21:34.778342  4330 raft_consensus.cc:1275] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:34.793629  4252 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:34.749354  7811 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:34.797088  7818 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:34.794915  7609 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:34.798573  7740 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:34.809023  7789 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:21:34.824792  7837 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:21:34.825066  7771 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:34.825878  7520 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:34.801136  7782 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.803391  7657 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.832093  7520 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:34.789247  7568 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.775152  4409 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:34.856983  4254 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:34.800324  7676 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.871189  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.907243  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:34.876133  7568 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:34.873292  7771 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.915864  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:34.929327  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 236043us
I20260709 12:21:34.915011  7667 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:34.951624  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 263344us
I20260709 12:21:34.955147  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:34.951015  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:34.962387  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:34.988093  7840 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:21:34.994576  4409 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:34.923483  7771 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:34.920889  7520 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:34.973227  7667 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.005009  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:35.011668  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:35.011662  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:35.015995  4987 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:35.008749  4409 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
W20260709 12:21:35.016837  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 220473us
W20260709 12:21:35.017443  4218 leader_election.cc:336] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.068s (SENT)
I20260709 12:21:35.017802  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:34.990690  7774 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.025739  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:35.028807  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:35.029759  4991 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
W20260709 12:21:35.034080  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:35.035916  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 232730us
W20260709 12:21:35.040191  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.023954  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:35.021198  4984 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [5.6-9.8]
I20260709 12:21:35.049367  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:35.045554  7845 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:35.026959  7691 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:35.082988  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.050585  7520 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.061020  7657 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:35.136615  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.085261  7782 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:35.144240  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 381182us
I20260709 12:21:35.146706  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:35.147598  4329 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:35.156153  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:35.158155  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 242346us
W20260709 12:21:35.152640  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 207447us
W20260709 12:21:35.162844  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 113518us
I20260709 12:21:35.140436  7691 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.182860  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.185611  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:35.145876  7551 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.205677  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.213467  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:35.211369  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:35.219807  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:35.218777  4956 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:35.225243  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:35.229027  7770 consensus_meta.cc:287] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.888s	user 0.005s	sys 0.007s
W20260709 12:21:35.231240  7606 consensus_meta.cc:287] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.003s
I20260709 12:21:35.216486  7667 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.226636  7433 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.258939  4988 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:35.253551  4403 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
W20260709 12:21:35.272887  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53156.9us
W20260709 12:21:35.244565  7435 consensus_meta.cc:287] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.004s
W20260709 12:21:35.275595  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 89162.9us
I20260709 12:21:35.275866  4296 leader_election.cc:400] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6.
I20260709 12:21:35.277094  4296 leader_election.cc:403] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:21:35.277412  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:35.277760  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:35.279726  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.235610  7861 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:35.271589  7606 raft_consensus.cc:2764] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:21:35.295306  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.250368  7533 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:35.279242  7771 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:35.272786  7867 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:35.301798  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:35.299861  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 67632.3us
I20260709 12:21:35.251284  7852 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:35.308661  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:35.291697  7855 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:35.311939  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:35.313410  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:35.313961  4409 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:21:35.314663  4296 leader_election.cc:336] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.506s (SENT)
W20260709 12:21:35.316978  4296 leader_election.cc:336] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.507s (SENT)
I20260709 12:21:35.318280  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:35.318645  4296 leader_election.cc:336] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.758s (SENT)
I20260709 12:21:35.317178  4992 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:21:35.319386  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:35.314716  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:35.321201  4409 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:35.250306  7862 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 12:21:35.306988  7776 consensus_meta.cc:287] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 12:21:35.324620  4983 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:35.304347  7672 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.360188  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.355239  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:35.308802  7867 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.315559  7676 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6.
I20260709 12:21:35.375571  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:35.377091  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.340250  7667 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:35.307730  7852 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.340461  7606 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:35.322690  7861 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:35.343127  7433 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:21:35.375171  7844 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:21:35.370257  4409 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:35.400281  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:35.309087  7868 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:21:35.310465  7533 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:35.360438  7872 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:35.381048  7435 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.385608  7667 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:35.343868  7847 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:21:35.402035  7609 consensus_meta.cc:287] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 12:21:35.322459  7771 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:21:35.380887  7865 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:35.428987  7865 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:35.374347  7867 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:35.345600  7855 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.388657  7852 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.390957  7745 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.391710  7672 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:35.362519  7776 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.425222  7872 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:35.405392  7873 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:35.452363  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 75362.2us
I20260709 12:21:35.462273  4402 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:35.423120  7667 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:35.466812  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 697) took 1132 ms. Trace:
I20260709 12:21:35.452649  7691 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:35.467458  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:35.549094  4325 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:35.487640  4328 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:35.401017  4409 raft_consensus.cc:2376] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6. Re-sending same reply.
I20260709 12:21:35.431738  7860 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:35.467533  4332 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:35.533543  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.519363  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:35.553828  4330 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:35.534040  4407 rpcz_store.cc:276] 0709 12:21:34.334307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.334408 (+   101us) service_pool.cc:224] Handling call
0709 12:21:34.334690 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:34.395461 (+ 60771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.395488 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:34.395940 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:21:34.893866 (+497926us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:34.893911 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.893980 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.466623 (+572643us) raft_consensus.cc:1685] finished
0709 12:21:35.466641 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.466760 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60379,"raft.queue_time_us":61146,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":113,"thread_start_us":497119,"threads_started":1,"wal-append.queue_time_us":634933}
I20260709 12:21:35.550233  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:35.452836  7871 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:35.555037  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:35.469198  7433 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.533484  7858 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:21:35.466293  7874 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:35.431282  7609 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.398846  7861 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.430366  7865 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.535640  7672 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:35.588210  4219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.012s
I20260709 12:21:35.547936  7745 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:35.590957  4219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.009s	sys 0.012s
W20260709 12:21:35.592393  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 548688us
I20260709 12:21:35.603194  4409 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
W20260709 12:21:35.589084  7864 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 12:21:35.587822  7606 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:35.578559  7877 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:35.567641  7433 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:35.649307  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.552518  7873 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.611588  7874 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:21:35.658232  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:35.561303  7533 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.600188  7847 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:21:35.617918  7860 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:35.601243  7745 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:35.651674  7630 consensus_meta.cc:287] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.014s	user 0.015s	sys 0.000s
W20260709 12:21:35.673599  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 140127us
I20260709 12:21:35.684300  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.694114  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1751) took 1071 ms. Trace:
I20260709 12:21:35.694628  4400 rpcz_store.cc:276] 0709 12:21:34.622310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.781556 (+159246us) service_pool.cc:224] Handling call
0709 12:21:34.781840 (+   284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:34.782412 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.782446 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:34.782936 (+   490us) log.cc:844] Serialized 52 byte log entry
0709 12:21:35.050603 (+267667us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:35.050646 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.050714 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.693821 (+643107us) raft_consensus.cc:1685] finished
0709 12:21:35.693851 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.694037 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7655,"thread_start_us":222255,"threads_started":1,"wal-append.queue_time_us":353321}
W20260709 12:21:35.675619  7869 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 12:21:35.681756  7864 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:35.654485  7877 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.735333  7867 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.692829  7630 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.731889  7873 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:35.722981  7871 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.732487  7740 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.899s	user 0.009s	sys 0.004s
I20260709 12:21:35.684952  7885 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:21:35.733327  7875 log.cc:927] Time spent T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:21:35.653191  7872 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.711501  7881 raft_consensus.cc:2764] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:21:35.712320  7874 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:21:35.681216  7672 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.686277  7860 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.724318  7776 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:35.714715  7606 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.744788  7855 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:35.748418  7866 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.217s	user 0.000s	sys 0.002s
I20260709 12:21:35.782021  7433 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:35.783284  7877 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:35.784003  7867 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:35.784750  7630 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:35.763880  7616 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Bootstrap starting.
I20260709 12:21:35.795871  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1749) took 1212 ms. Trace:
I20260709 12:21:35.799562  4405 rpcz_store.cc:276] 0709 12:21:34.583828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.697129 (+113301us) service_pool.cc:224] Handling call
0709 12:21:34.741847 (+ 44718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:34.754074 (+ 12227us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:21:34.780336 (+ 26262us) log.cc:844] Serialized 14 byte log entry
0709 12:21:35.081943 (+301607us) log.cc:844] Serialized 14 byte log entry
0709 12:21:35.083667 (+  1724us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:35.084284 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:21:35.084443 (+   159us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:35.084489 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.084582 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:35.795593 (+711011us) raft_consensus.cc:1685] finished
0709 12:21:35.795622 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:35.795791 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29686,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":105,"raft.queue_time_us":28262,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":32045,"spinlock_wait_cycles":4920064,"thread_start_us":295640,"threads_started":1,"wal-append.queue_time_us":442735}
I20260709 12:21:35.797046  7861 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:35.803002  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 214385us
I20260709 12:21:35.788205  7874 consensus_queue.cc:1243] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:35.787937  7609 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:35.755611  7740 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.787742  7745 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:35.827546  7860 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:35.755317  7871 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.827101  7876 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:35.836795  7520 consensus_meta.cc:287] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
W20260709 12:21:35.838747  7568 consensus_meta.cc:287] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.915s	user 0.009s	sys 0.003s
I20260709 12:21:35.839005  7667 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:35.829924  7766 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.011s	sys 0.023s
I20260709 12:21:35.840116  7876 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:35.842486  7766 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.012s	sys 0.023s
I20260709 12:21:35.874248  7871 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:35.866003  7852 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.881191  7852 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:35.878408  7876 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.883718  7876 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:35.917585  4220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.001s	sys 0.015s
W20260709 12:21:35.918609  4220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.002s	sys 0.015s
W20260709 12:21:35.918465  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 323523us
I20260709 12:21:35.920426  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:35.930730  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:35.942503  4991 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.002s	sys 0.010s
I20260709 12:21:35.943945  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:35.935570  4984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.007s
I20260709 12:21:35.943451  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:35.970285  7789 raft_consensus.cc:2764] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:35.970870  7871 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:35.971565  7789 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:35.971974  7871 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.972535  7789 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:35.933727  4333 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:35.931478  4250 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:35.934468  4334 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:35.936208  4247 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:35.940326  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 131515us
W20260709 12:21:35.989898  7857 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.630s	user 0.007s	sys 0.000s
I20260709 12:21:35.991060  7740 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:35.995361  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:35.997129  7895 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:35.983448  4991 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.003s	sys 0.019s
W20260709 12:21:35.986330  4984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.004s	sys 0.019s
I20260709 12:21:36.000694  7895 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:35.966220  7566 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:35.974305  7667 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.006386  7566 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.007936  7895 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.007800  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:36.002698  7740 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:36.009984  7894 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.010761  4407 raft_consensus.cc:2368] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8.
I20260709 12:21:35.975204  7871 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.025978  7894 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:36.026836  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:36.027331  4402 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1746) took 1485 ms (client timeout 1537 ms). Trace:
I20260709 12:21:36.028184  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:36.029171  7894 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.029313  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1729) took 1546 ms. Trace:
I20260709 12:21:36.029809  4403 rpcz_store.cc:276] 0709 12:21:34.482847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.483012 (+   165us) service_pool.cc:224] Handling call
0709 12:21:36.028909 (+1545897us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400244ad4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:36.029139 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766126848}
I20260709 12:21:36.030753  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:36.032074  4257 raft_consensus.cc:2410] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:35.964180  7703 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:36.032907  7703 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.034349  7740 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.041468  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:36.027908  4254 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:36.047200  7847 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:36.048110  7847 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.050053  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:36.043201  7672 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.052628  7672 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:36.055804  7874 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.056524  7812 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.056695  7874 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.057711  7812 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.029219  4256 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
W20260709 12:21:36.027894  4402 rpcz_store.cc:269] 0709 12:21:34.541724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.542340 (+   616us) service_pool.cc:224] Handling call
0709 12:21:36.026845 (+1484505us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54000af354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:36.027058 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539858176}
I20260709 12:21:36.043576  4257 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.067865  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:36.072715  4989 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [5.6-9.8]
I20260709 12:21:36.073200  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:36.073495  7672 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.051070  7847 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.045369  7893 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:36.098992  7893 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.104790  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:36.105695  4325 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:36.107163  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.088709  7789 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.113042  7740 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.115064  7566 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:36.116029  7846 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 1.113s	user 0.000s	sys 0.007s
W20260709 12:21:36.117118  7908 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:21:36.118037  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1740) took 1624 ms. Trace:
I20260709 12:21:36.118532  4401 rpcz_store.cc:276] 0709 12:21:34.493922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.611826 (+117904us) service_pool.cc:224] Handling call
0709 12:21:34.631687 (+ 19861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:34.642363 (+ 10676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.642391 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:34.644269 (+  1878us) log.cc:844] Serialized 26 byte log entry
0709 12:21:34.887224 (+242955us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:34.887280 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.887390 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.115037 (+1227647us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:36.117520 (+  2483us) raft_consensus.cc:1685] finished
0709 12:21:36.117539 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.117846 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7438,"raft.queue_time_us":7604,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":277,"spinlock_wait_cycles":2540928,"thread_start_us":233678,"threads_started":1,"wal-append.queue_time_us":335819}
W20260709 12:21:36.133821  7856 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.748s	user 0.000s	sys 0.001s
I20260709 12:21:36.118549  7703 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.145473  7874 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.148285  4401 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:21:36.148156  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:36.151042  7703 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:36.155675  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:36.157907  4248 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:36.158653  7812 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.163892  7889 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:36.184021  7889 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:36.193261  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 45430.4us
I20260709 12:21:36.229890  4257 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:36.322039  4325 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:36.322719  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.402256  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 125524us
W20260709 12:21:36.401770  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.379547  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.411157  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:36.420076  4256 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:36.439651  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1753) took 1100 ms. Trace:
I20260709 12:21:36.440296  4402 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:36.420215  7893 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.445809  4406 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:36.447693  7847 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.449486  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:36.450052  4327 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:21:36.450349  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:36.532419  4257 raft_consensus.cc:2393] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:36.401515  7603 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:36.452287  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:36.539438  4334 raft_consensus.cc:2410] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:21:36.458823  7698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.495s	user 0.021s	sys 0.011s
I20260709 12:21:36.460106  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2510) took 1144 ms. Trace:
I20260709 12:21:36.461170  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:36.461799  7812 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.469741  7853 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 1.301s	user 0.006s	sys 0.000s
W20260709 12:21:36.471937  7876 consensus_meta.cc:287] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.013s
I20260709 12:21:36.472555  4984 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:36.479457  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2503) took 1108 ms. Trace:
I20260709 12:21:36.489254  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2213) took 1345 ms. Trace:
I20260709 12:21:36.496158  7574 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.496654  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:36.506532  7710 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:36.511466  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2508) took 1188 ms. Trace:
W20260709 12:21:36.518018  7851 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 1.374s	user 0.003s	sys 0.003s
I20260709 12:21:36.518947  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2212) took 1381 ms. Trace:
I20260709 12:21:36.519443  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:36.520076  4988 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 1045) took 1895 ms (client timeout 1767 ms). Trace:
W20260709 12:21:36.525380  7887 log.cc:927] Time spent T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.742s	user 0.001s	sys 0.001s
I20260709 12:21:36.529338  4401 rpcz_store.cc:276] 0709 12:21:35.318023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.149437 (+831414us) service_pool.cc:224] Handling call
0709 12:21:36.150006 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.150429 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.150466 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.150536 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:36.179960 (+ 29424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.416844 (+236884us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.417900 (+  1056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.323097  7673 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.351804  7577 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.532021  4327 pending_rounds.cc:85] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 6
I20260709 12:21:36.540416  4407 rpcz_store.cc:276] 0709 12:21:35.315269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.554743 (+239474us) service_pool.cc:224] Handling call
0709 12:21:36.459853 (+905110us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003ae654. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:36.460031 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957360384}
I20260709 12:21:36.542404  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 705) took 1102 ms. Trace:
I20260709 12:21:36.352707  7662 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:36.552392  4988 rpcz_store.cc:269] 0709 12:21:34.624054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.624259 (+   205us) service_pool.cc:224] Handling call
0709 12:21:36.519614 (+1895355us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540064fd54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:36.519817 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436304256}
I20260709 12:21:36.538826  7603 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:36.542364  7698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.819s	user 0.022s	sys 0.011s
I20260709 12:21:36.544975  4405 rpcz_store.cc:276] 0709 12:21:35.313562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.940545 (+626983us) service_pool.cc:224] Handling call
0709 12:21:35.941449 (+   904us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:35.942316 (+   867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.942352 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:35.951207 (+  8855us) log.cc:844] Serialized 78 byte log entry
0709 12:21:36.092276 (+141069us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:36.315626 (+223350us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.411798 (+ 96172us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.420859 (+  9061us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.421121 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.421216 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.421268 (+    52us) raft_consensus.cc:1685] finished
0709 12:21:36.421287 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.421481 (+   194us) inbound_call.cc:177] Queueing success response
0709 12:21:36.523402 (+101921us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b18002c1460. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
Metrics: {"mutex_wait_us":137001,"raft.queue_time_us":171540,"raft.run_cpu_time_us":611,"raft.run_wall_time_us":21341,"spinlock_wait_cycles":21962368,"thread_start_us":269586,"threads_started":2,"wal-append.queue_time_us":112342}
I20260709 12:21:36.550487  4409 rpcz_store.cc:276] 0709 12:21:35.314821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.501722 (+1186901us) service_pool.cc:224] Handling call
0709 12:21:36.502382 (+   660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.502838 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.502874 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.502950 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:36.503024 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.503093 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.503238 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.551934  4330 rpcz_store.cc:276] 0709 12:21:35.137795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.137928 (+   133us) service_pool.cc:224] Handling call
0709 12:21:35.138224 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.559116 (+420892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.515186 (+956070us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002d5854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:36.518777 (+  3591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955270912}
I20260709 12:21:36.545383  4333 rpcz_store.cc:276] 0709 12:21:35.143571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.143687 (+   116us) service_pool.cc:224] Handling call
0709 12:21:35.143967 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.018457 (+874490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.488813 (+470356us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002d5354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:36.489139 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814754560}
I20260709 12:21:36.560007  4406 rpcz_store.cc:276] 0709 12:21:35.435854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.444625 (+1008771us) service_pool.cc:224] Handling call
0709 12:21:36.445163 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.531462 (+ 86299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.538201 (+  6739us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:36.572482  4255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.015s	sys 0.033s
W20260709 12:21:36.578014  4255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.015s	sys 0.033s
I20260709 12:21:36.559540  4327 pending_rounds.cc:107] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:21:36.578462  4327 raft_consensus.cc:2889] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:36.554109  7710 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:36.582389  7774 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:36.576561  7603 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:36.595748  4956 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:36.565290  7574 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:36.625677  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.040s	sys 0.031s
I20260709 12:21:36.638906  4325 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:36.642270  4325 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:36.642746  4325 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:36.643383  7740 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:36.617564  7812 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:36.644433  7740 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.646363  7812 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.607474  7847 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.648043  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 856) took 1196 ms. Trace:
I20260709 12:21:36.648860  7847 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:36.611027  7850 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:36.650571  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.288s	user 0.041s	sys 0.031s
I20260709 12:21:36.539947  7889 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.632700  7566 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:36.668339  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 110143us
I20260709 12:21:36.670519  7870 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:36.671092  7870 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:36.672268  7870 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.674782  7863 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:36.660840  7566 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.675789  7863 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.687624  7850 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.689486  7606 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:36.690179  7850 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.690048  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:36.680047  4407 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:36.600327  7673 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.625365  7893 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:36.701375  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 708) took 1244 ms. Trace:
I20260709 12:21:36.701875  4407 rpcz_store.cc:276] 0709 12:21:35.451698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.568940 (+1117242us) service_pool.cc:224] Handling call
0709 12:21:36.624410 (+ 55470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.695580 (+ 71170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.695819 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.648578  4329 rpcz_store.cc:276] 0709 12:21:35.451698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.454092 (+  2394us) service_pool.cc:224] Handling call
0709 12:21:35.454547 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:35.455012 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:35.455053 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:35.458769 (+  3716us) log.cc:844] Serialized 26 byte log entry
0709 12:21:35.687584 (+228815us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:35.687642 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:35.687734 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.524473 (+836739us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:36.647378 (+122905us) raft_consensus.cc:1685] finished
0709 12:21:36.647412 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.647829 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13305,"spinlock_wait_cycles":14722816,"thread_start_us":228483,"threads_started":1,"wal-append.queue_time_us":288612}
I20260709 12:21:36.621750  7667 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:36.608454  7577 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.606670  7774 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.636351  7662 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.690183  7606 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.773526  7710 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.880759  7710 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:36.753048  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:36.881167  7577 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.868494  7667 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.756345  7893 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.849197  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:36.855054  7852 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
W20260709 12:21:36.878736  4254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.004s	sys 0.048s
W20260709 12:21:36.887755  4254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.004s	sys 0.048s
I20260709 12:21:36.790232  7812 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.878504  4248 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:36.876801  7863 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:36.713290  7740 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.884204  7667 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.892203  7667 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:36.796432  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:36.895005  4955 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.540s (SENT) [suppressed 28 similar messages]
I20260709 12:21:36.769461  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2507) took 1454 ms. Trace:
I20260709 12:21:36.896085  4402 rpcz_store.cc:276] 0709 12:21:35.314562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.117652 (+803090us) service_pool.cc:224] Handling call
0709 12:21:36.421467 (+303815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.529426 (+107959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.762559 (+233133us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54000113d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:36.769385 (+  6826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697819008}
I20260709 12:21:36.789685  7496 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 12:21:36.886724  7606 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.678033  7860 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.857687  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 706) took 1421 ms. Trace:
I20260709 12:21:36.921542  4401 rpcz_store.cc:276] 0709 12:21:35.436134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.567277 (+1131143us) service_pool.cc:224] Handling call
0709 12:21:36.651830 (+ 84553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.792064 (+140234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.792113 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.833032 (+ 40919us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.833096 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.833189 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.857607 (+ 24418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.887717  4983 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:36.889487  7812 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.773203  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:36.728025  4325 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.728816  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:36.710691  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 710) took 1247 ms. Trace:
W20260709 12:21:36.913933  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.886655  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:36.731837  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 270872us
I20260709 12:21:36.881807  4991 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:36.925240  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 1.60654e+06us
W20260709 12:21:36.926299  7859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.055s	sys 0.085s
W20260709 12:21:36.926863  7921 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:21:36.926764  7847 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:36.884863  7662 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.929930  4409 rpcz_store.cc:276] 0709 12:21:35.463560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.583194 (+1119634us) service_pool.cc:224] Handling call
0709 12:21:36.635849 (+ 52655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.695092 (+ 59243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.695131 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.710298 (+ 15167us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.710367 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.710453 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.710620 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.856699  7698 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.878458  7566 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:36.931607  7859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.056s	sys 0.085s
I20260709 12:21:36.941465  7847 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.943940  4325 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:36.948041  7886 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.962976  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 711) took 1415 ms. Trace:
I20260709 12:21:36.967094  4406 rpcz_store.cc:276] 0709 12:21:35.548149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.602979 (+1054830us) service_pool.cc:224] Handling call
0709 12:21:36.917592 (+314613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.962521 (+ 44929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.962563 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.962624 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:36.962678 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.962757 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.962906 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24448}
I20260709 12:21:36.970767  4401 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:21:36.956763  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1917) took 1013 ms. Trace:
I20260709 12:21:36.974876  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 714) took 1371 ms. Trace:
I20260709 12:21:36.975586  4401 rpcz_store.cc:276] 0709 12:21:35.600367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.932892 (+1332525us) service_pool.cc:224] Handling call
0709 12:21:36.956885 (+ 23993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.971218 (+ 14333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.971551 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:36.950627  7863 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:36.989540  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1748) took 2382 ms. Trace:
I20260709 12:21:36.990039  7637 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:36.990321  7770 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:36.949757  7898 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:36.949479  7594 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.235s
W20260709 12:21:37.012642  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:36.952987  7860 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:37.001834  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.002939  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:37.007642  7517 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:37.112700  7774 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:36.973611  4255 rpcz_store.cc:276] 0709 12:21:35.943979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.944272 (+   293us) service_pool.cc:224] Handling call
0709 12:21:35.944856 (+   584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:35.945452 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:36.581088 (+635636us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.951195 (+370107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.951258 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:36.951342 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.951453 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.956669 (+  5216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44943,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":54,"raft.queue_time_us":116,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6814,"thread_start_us":951258,"threads_started":2}
I20260709 12:21:37.113332  7517 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.115319  7606 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:37.115880  7606 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:37.116365  7606 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:37.117383  7517 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.013095  4408 rpcz_store.cc:276] 0709 12:21:34.573314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:34.675981 (+102667us) service_pool.cc:224] Handling call
0709 12:21:34.687484 (+ 11503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:34.691961 (+  4477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:34.691989 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:34.707055 (+ 15066us) log.cc:844] Serialized 26 byte log entry
0709 12:21:34.958540 (+251485us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:34.969233 (+ 10693us) log.cc:844] Serialized 14 byte log entry
0709 12:21:34.979734 (+ 10501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:34.979821 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:36.516970 (+1537149us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:36.931531 (+414561us) raft_consensus.cc:1685] finished
0709 12:21:36.938309 (+  6778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:36.955733 (+ 17424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5263,"prepare.queue_time_us":10470,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":11686,"raft.queue_time_us":82894,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":30017,"spinlock_wait_cycles":211349632,"thread_start_us":205946,"threads_started":1,"wal-append.queue_time_us":374574}
I20260709 12:21:36.991427  7886 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:37.120556  7898 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:37.128539  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 152214us
W20260709 12:21:37.133189  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 238190us
I20260709 12:21:36.989711  7815 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:37.009274  7795 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:37.186256  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 715) took 1189 ms. Trace:
I20260709 12:21:37.186856  4409 rpcz_store.cc:276] 0709 12:21:35.997473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.949122 (+951649us) service_pool.cc:224] Handling call
0709 12:21:36.988894 (+ 39772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.155035 (+166141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.155061 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:37.169135 (+ 14074us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:37.185936 (+ 16801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.186025 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.186180 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:37.201831  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 269726us
I20260709 12:21:37.201984  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:37.203420  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 233693us
W20260709 12:21:37.205850  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.192755  7770 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.990958  7698 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.208721  7698 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.209338  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:37.210230  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:37.210664  7886 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.147082  7574 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.211658  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:37.211999  7924 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 12:21:37.212450  4408 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.212173  7815 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.213068  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:37.214445  7847 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.121831  7863 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.215322  7637 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:36.948740  4989 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:37.216543  7898 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.234222  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 718) took 1067 ms. Trace:
I20260709 12:21:37.244091  4325 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:37.244712  4325 pending_rounds.cc:85] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 8
I20260709 12:21:37.249871  4325 pending_rounds.cc:107] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:21:37.250154  4325 raft_consensus.cc:2889] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:37.233001  7740 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:37.255769  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:37.238719  4254 rpcz_store.cc:276] 0709 12:21:36.151631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.162637 (+ 11006us) service_pool.cc:224] Handling call
0709 12:21:36.163105 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.163744 (+   639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.163785 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:36.164442 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:21:36.888329 (+723887us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.888675 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.888861 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.888931 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.218813 (+329882us) raft_consensus.cc:1685] finished
0709 12:21:37.218839 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.219001 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":13253,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":48560,"thread_start_us":723389,"threads_started":1,"wal-append.queue_time_us":827529}
I20260709 12:21:37.256794  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.233204  7667 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.275767  4328 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:37.276419  4328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 2534) took 1163 ms (client timeout 1514 ms). Trace:
W20260709 12:21:37.276995  4328 rpcz_store.cc:269] 0709 12:21:36.112905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.244101 (+1131196us) service_pool.cc:224] Handling call
0709 12:21:37.276342 (+ 32241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:37.274013  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.281306  4401 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:37.257805  7740 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:37.284807  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 74541.6us
I20260709 12:21:37.279434  7885 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:37.253820  7673 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.258140  7637 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.286550  7928 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:37.262722  7852 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:37.282348  7603 consensus_meta.cc:287] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.005s
I20260709 12:21:37.298187  4408 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:37.287933  7740 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.251163  7795 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.307144  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:37.300341  7917 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.723s	user 0.009s	sys 0.013s
I20260709 12:21:37.315228  4329 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:37.316032  7932 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:37.316186  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.285656  7667 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.300081  7812 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:37.331404  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 90723.5us
I20260709 12:21:37.294814  7898 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:37.336990  7933 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.338073  7933 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:37.340329  7927 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:21:37.318588  7889 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:37.335786  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:37.303007  7703 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:37.300877  7603 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.352391  7939 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:37.352450  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.353199  4249 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:37.353797  7603 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.354074  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.354328  7860 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.355016  7893 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.319823  7795 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.353823  4255 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:37.357288  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.355433  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.355581  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:37.362442  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.364540  4401 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:37.363611  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.372301  4247 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:37.375142  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.375838  4327 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:37.379832  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.380162  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.320720  7852 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.380162  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.382524  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:37.385502  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:37.321604  7885 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.386556  4328 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:37.396194  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.385780  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 50887.3us
I20260709 12:21:37.370780  7795 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.386121  7770 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.387769  7662 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:37.362571  7703 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.386535  7698 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:37.574918  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.370023  7898 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.537941  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.571389  7770 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:37.605062  7931 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:21:37.606809  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2505) took 2292 ms. Trace:
I20260709 12:21:37.607587  4401 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:21:37.609094  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 303045us
I20260709 12:21:37.607348  4403 rpcz_store.cc:276] 0709 12:21:35.314061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.118893 (+804832us) service_pool.cc:224] Handling call
0709 12:21:36.211984 (+ 93091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.548949 (+336965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.549005 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:36.583886 (+ 34881us) log.cc:844] Serialized 26 byte log entry
0709 12:21:36.953704 (+369818us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.974516 (+ 20812us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.974763 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.974832 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.606470 (+631638us) raft_consensus.cc:1685] finished
0709 12:21:37.606506 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.606722 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103135,"prepare.queue_time_us":22749,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5176,"raft.queue_time_us":188921,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6508,"spinlock_wait_cycles":23386368,"thread_start_us":328916,"threads_started":1,"wal-append.queue_time_us":710946}
I20260709 12:21:37.605011  7770 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.610229  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:37.611469  7603 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:37.611779  7770 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.617059  7566 consensus_queue.cc:1059] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:37.618198  7566 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.619027  7566 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:37.619385  7566 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:37.620450  7566 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.621793  7667 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.622599  7667 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:21:37.623149  7936 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:21:37.623057  7667 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:37.624186  7667 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.624925  7852 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.625584  7667 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.635432  7673 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:37.636569  7870 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:37.637130  7870 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:37.638361  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:37.639326  7673 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:37.638588  7870 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.639706  7673 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.640118  7673 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.640594  7870 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:37.643428  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 286911us
I20260709 12:21:37.644241  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:37.645282  7568 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:21:37.645629  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:37.646456  7568 raft_consensus.cc:2764] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Leader election decision vote started in defunct term 4: won
I20260709 12:21:37.646854  7889 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:37.647109  4408 raft_consensus.cc:2410] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:37.648490  7889 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:37.653219  7606 consensus_meta.cc:287] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:21:37.653625  7889 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.653718  7606 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.661675  7606 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:37.654846  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 211720us
I20260709 12:21:37.657194  7885 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.489320  7863 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.664222  7740 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.666388  7740 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.666777  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.667460  4252 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:37.668716  7898 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.635229  7671 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:37.538147  7860 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:37.658869  7929 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:21:37.666985  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 867) took 1548 ms. Trace:
I20260709 12:21:37.658389  7933 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.674455  4252 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:37.531409  7662 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.490586  7939 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:37.682902  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.573556  7698 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:37.688223  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.692142  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.621924  7566 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:37.686833  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:37.675381  4326 rpcz_store.cc:276] 0709 12:21:36.045994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.066857 (+ 20863us) service_pool.cc:224] Handling call
0709 12:21:36.067506 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.068218 (+   712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.068254 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:36.068879 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:21:36.407673 (+338794us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.407734 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.407825 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.159290 (+751465us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:37.532575 (+373285us) raft_consensus.cc:1685] finished
0709 12:21:37.532607 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.572993 (+ 40386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2334,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":206,"spinlock_wait_cycles":121591552,"thread_start_us":161236,"threads_started":1,"wal-append.queue_time_us":502756}
I20260709 12:21:37.695591  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.697628  4325 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:37.695231  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.684731  7662 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:37.705152  4218 leader_election.cc:336] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 2.002s (SENT)
W20260709 12:21:37.706238  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:37.707749  7937 log.cc:927] Time spent T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.368s	user 0.000s	sys 0.006s
I20260709 12:21:37.684342  7863 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:37.710062  4984 consensus_meta.cc:287] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.113s	user 0.009s	sys 0.001s
I20260709 12:21:37.718107  4984 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:37.718743  4984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 858) took 1542 ms (client timeout 1757 ms). Trace:
I20260709 12:21:37.712425  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.695189  7703 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.729400  4988 raft_consensus.cc:2410] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:37.714191  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.693960  7698 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.713274  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.730914  4327 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:37.720105  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:37.720014  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.686631  7770 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 12:21:37.719165  4984 rpcz_store.cc:269] 0709 12:21:36.176212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.176376 (+   164us) service_pool.cc:224] Handling call
0709 12:21:37.718674 (+1542298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:37.718791  7517 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:37.736747  7517 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.736979  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.738305  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:37.738811  4401 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:37.732862  4326 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:37.724865  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.741317  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 709) took 2284 ms. Trace:
I20260709 12:21:37.741593  4405 rpcz_store.cc:276] 0709 12:21:35.456568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.576956 (+1120388us) service_pool.cc:224] Handling call
0709 12:21:36.631084 (+ 54128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.957026 (+325942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.957073 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.957137 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:36.957198 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.741091 (+783893us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400010ed4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:37.741148 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.741271 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708363648}
I20260709 12:21:37.725064  7740 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.726967  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.727698  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.735661  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.737195  7517 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:37.724684  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.746991  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:37.747548  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.749402  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.749992  4984 raft_consensus.cc:2410] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:21:37.752635  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.730373  7863 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.757194  7795 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:37.757447  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.758376  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.760061  4403 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:37.760488  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.763031  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.763862  4332 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
W20260709 12:21:37.765704  4402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.046s	sys 0.079s
W20260709 12:21:37.766213  4402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.046s	sys 0.080s
I20260709 12:21:37.709977  7860 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.768011  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 713) took 2174 ms. Trace:
I20260709 12:21:37.768688  4329 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
W20260709 12:21:37.767537  4406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.052s	sys 0.073s
W20260709 12:21:37.773281  4406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.052s	sys 0.073s
I20260709 12:21:37.746717  7933 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.779908  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.782245  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.785159  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.765383  7703 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:37.790494  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:37.785468  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.769248  7774 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:37.694252  7939 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:37.791144  4405 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:37.792999  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 716) took 1703 ms. Trace:
I20260709 12:21:37.794442  4326 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:37.795063  4409 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 13: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:37.796180  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 108993us
I20260709 12:21:37.798202  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:37.795372  4372 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:37.799194  4984 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:37.801848  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:37.802521  4254 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:37.770500  4402 rpcz_store.cc:276] 0709 12:21:35.593418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.929271 (+1335853us) service_pool.cc:224] Handling call
0709 12:21:36.969955 (+ 40684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.008131 (+ 38176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:37.008545 (+   414us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.253985 (+245440us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.707028 (+453043us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:37.766947 (+ 59919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:37.767016 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:37.767081 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.767797 (+   716us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.767943 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7237,"prepare.queue_time_us":878,"prepare.run_cpu_time_us":17195,"prepare.run_wall_time_us":125902,"raft.queue_time_us":119534,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":20983,"spinlock_wait_cycles":10278272,"thread_start_us":753747,"threads_started":2,"wal-append.queue_time_us":284204}
I20260709 12:21:37.802749  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:37.802645  4329 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:37.751410  7740 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:37.806686  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 118048us
I20260709 12:21:37.815094  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.816802  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:37.815797  4255 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:37.820884  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.832540  4247 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:37.833905  4372 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:37.835445  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2506) took 2503 ms. Trace:
I20260709 12:21:37.836557  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 722) took 1589 ms. Trace:
I20260709 12:21:37.837018  4253 rpcz_store.cc:276] 0709 12:21:36.153766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.516761 (+362995us) service_pool.cc:224] Handling call
0709 12:21:36.517122 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.883195 (+366073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:36.883227 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.883287 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:36.883342 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.742624 (+859282us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540019a854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:37.742659 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.742747 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841297792}
I20260709 12:21:37.839267  7815 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.851117  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:37.855713  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:37.855907  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.857235  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.830657  7703 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:37.857857  4250 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:37.858132  7703 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.860780  7703 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:37.812970  7932 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:37.867185  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:37.869699  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.821384  7606 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.802007  7933 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.887849  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.889022  4247 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:37.813817  7673 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:37.890681  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.855800  7943 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.886891  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.894966  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:37.898917  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 87243.6us
W20260709 12:21:37.899962  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:37.901196  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:37.835863  4404 rpcz_store.cc:276] 0709 12:21:35.314320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.521130 (+1206810us) service_pool.cc:224] Handling call
0709 12:21:36.521703 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:36.582093 (+ 60390us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:36.582487 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.046544 (+464057us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.046666 (+   122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:37.175907 (+129241us) log.cc:844] Serialized 26 byte log entry
0709 12:21:37.176086 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:37.177066 (+   980us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.177721 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.177822 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:37.817958 (+640136us) raft_consensus.cc:1685] finished
0709 12:21:37.817986 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.818149 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58960,"prepare.queue_time_us":21942,"prepare.run_cpu_time_us":204,"prepare.run_wall_time_us":26697,"raft.queue_time_us":60475,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":9763,"thread_start_us":431842,"threads_started":1,"wal-append.queue_time_us":760855}
I20260709 12:21:37.904737  7861 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:37.919255  7861 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:37.919703  7861 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:37.900609  7932 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.924039  4326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:57108
I20260709 12:21:37.924796  4326 raft_consensus.cc:606] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:37.925155  4326 raft_consensus.cc:614] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:37.927181  7944 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:21:37.928099  7740 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.931499  7943 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.905663  7889 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:37.893945  7606 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.954506  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:37.954793  4401 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:37.953200  7889 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.977648  7616 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:37.981513  7662 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:37.987095  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 712) took 2414 ms. Trace:
I20260709 12:21:37.987607  4407 rpcz_store.cc:276] 0709 12:21:35.572470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.741020 (+1168550us) service_pool.cc:224] Handling call
0709 12:21:37.986285 (+1245265us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b58001c3298. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:21:37.986493 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.986720 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:37.986750 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:37.986811 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:37.986844 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.986897 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.987031 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69041024}
I20260709 12:21:37.968246  7673 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:37.972007  7889 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:37.994268  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 864) took 1261 ms. Trace:
I20260709 12:21:37.993772  7740 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:37.998556  4989 rpcz_store.cc:276] 0709 12:21:36.729227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.742345 (+ 13118us) service_pool.cc:224] Handling call
0709 12:21:36.858340 (+115995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.931904 (+ 73564us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:37.681800 (+749896us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.990340 (+308540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:37.990408 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:37.990474 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.990567 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.990702 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":872,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":2276,"thread_start_us":295359,"threads_started":1}
I20260709 12:21:37.991525  7662 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:38.005044  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 61925.9us
I20260709 12:21:38.010564  7698 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.013895  7698 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:37.994831  7815 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:21:38.015511  7939 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.015897  7606 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.016158  7939 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:38.016471  7606 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.017158  7606 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:37.998688  7860 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.018567  7933 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.021039  7517 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.016587  7939 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.018960  7860 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.019230  7933 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:38.024976  7860 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.027221  7860 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.027559  7606 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.023239  7517 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.024573  7939 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.034184  7889 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.025117  7933 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.044710  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:38.042972  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 192010us
I20260709 12:21:38.047798  7616 tablet_bootstrap.cc:492] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Bootstrap complete.
I20260709 12:21:38.053690  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.054778  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.055789  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.056718  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.056710  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.057061  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:38.063357  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 59186us
I20260709 12:21:38.063690  4405 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.057978  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.064245  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.058856  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.059640  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.060345  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.065555  4989 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:38.065578  4402 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.067358  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.067932  4252 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:38.068569  7933 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.064862  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.066242  7606 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:38.079686  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.079618  7606 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.080686  4330 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:38.082217  7606 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.061196  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.075238  4402 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:38.078318  7861 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.051276  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.071583  4405 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.084142  7889 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.084261  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.085018  4407 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:38.085958  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.086548  4407 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:38.084438  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.049431  7568 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:38.088733  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.090873  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2502) took 2777 ms. Trace:
I20260709 12:21:38.095788  4254 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:38.093089  4405 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.102188  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.104362  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.105858  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.107440  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.108047  4401 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.108882  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.109433  4401 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:38.111395  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.112959  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.113837  4405 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:38.115190  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.116297  4989 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:38.090184  7774 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.119519  7774 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.121428  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:38.127162  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.128521  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.128096  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.093834  4400 rpcz_store.cc:276] 0709 12:21:35.313309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:35.696624 (+383315us) service_pool.cc:224] Handling call
0709 12:21:36.048727 (+352103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:36.049456 (+   729us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:21:36.124414 (+ 74958us) log.cc:844] Serialized 14 byte log entry
0709 12:21:36.872306 (+747892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:36.872379 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:36.872446 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:36.872566 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:38.090564 (+1217998us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003c55d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:38.090697 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":501937,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":148469,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":122,"spinlock_wait_cycles":796745088,"thread_start_us":576336,"threads_started":2,"wal-append.queue_time_us":733074,"wal-append.run_cpu_time_us":1413,"wal-append.run_wall_time_us":1007487}
I20260709 12:21:38.123543  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.136634  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:38.136861  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.136747  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.111231  7616 ts_tablet_manager.cc:1403] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Time spent bootstrapping tablet: real 2.354s	user 0.043s	sys 0.056s
I20260709 12:21:38.139564  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.137322  7568 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:38.152361  7874 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:38.152765  7568 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.153312  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.154199  4252 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:38.155987  7861 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.156119  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.156847  4402 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 5.
I20260709 12:21:38.157222  4400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:38.158216  4402 raft_consensus.cc:1275] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:38.139706  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.164500  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:38.165030  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 95285.4us
I20260709 12:21:38.165555  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.166457  4254 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:38.170161  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:38.171975  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.148346  7889 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:38.175433  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:38.176600  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:38.178369  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:38.179932  4401 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:38.169054  7861 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:38.180794  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:38.175900  7928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.018s	sys 0.024s
I20260709 12:21:38.173024  7606 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.173012  7933 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:38.164798  7874 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:21:38.181237  7815 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:38.181131  7703 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:38.189039  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:38.181964  7662 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:38.188040  7928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.018s	sys 0.024s
I20260709 12:21:38.198194  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.201529  4402 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:38.199685  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.203428  7952 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:21:38.192054  7933 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.204788  7933 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.215620  7956 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:38.216629  7956 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.196417  7815 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:38.219831  7815 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.220819  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.221676  4408 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.198305  7662 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:38.226670  7662 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.182149  7957 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:21:38.227990  7957 consensus_queue.cc:1243] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:38.200791  7898 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:38.228945  7898 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.229368  7898 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:38.228231  7934 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.959s	user 0.003s	sys 0.005s
I20260709 12:21:38.201085  7928 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:38.231767  7928 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.234668  7932 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.237659  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.237843  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.238777  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.239184  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.200271  7616 raft_consensus.cc:359] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:38.245995  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.238775  4327 raft_consensus.cc:2393] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:38.236769  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.270829  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:38.193301  7698 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:38.279856  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.280010  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.280819  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.281383  4331 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:38.196307  7703 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:38.290699  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.275499  4334 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.294885  4333 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:38.294894  4400 raft_consensus.cc:606] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:38.295511  4400 raft_consensus.cc:614] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:38.296595  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.270020  7616 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Initialized, Role: LEARNER
I20260709 12:21:38.278993  7698 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:38.228147  7939 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.297171  4402 raft_consensus.cc:2376] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10. Re-sending same reply.
W20260709 12:21:38.302381  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.294021  7703 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.299762  7900 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:38.321233  4405 raft_consensus.cc:2368] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10.
I20260709 12:21:38.307893  7698 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:38.334699  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.319612  7956 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.320493  7900 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:38.369242  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 171970us
W20260709 12:21:38.372478  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 188731us
I20260709 12:21:38.358886  7568 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.372020  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:38.368484  4401 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:38.365257  7962 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:38.385900  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:38.370011  7956 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:38.379673  7961 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:21:38.379920  7568 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.396776  7968 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.396564  7900 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.398000  7966 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.398451  7956 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.327838  7616 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:38.401589  7943 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.412922  7939 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.428525  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.429215  4327 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.430164  7943 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.430864  7900 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:38.418344  7966 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.451783  7943 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.452845  7616 ts_tablet_manager.cc:1434] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Time spent starting tablet: real 0.292s	user 0.007s	sys 0.002s
I20260709 12:21:38.453636  7966 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.453956  7943 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.454937  7815 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:38.455529  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 74568us
I20260709 12:21:38.457403  7698 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.458640  4256 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:38.459474  7964 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:38.461475  7964 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:38.461822  7964 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:38.425997  7662 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.464422  7662 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:38.444042  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:37.795390  4406 rpcz_store.cc:276] 0709 12:21:36.089578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:36.973322 (+883744us) service_pool.cc:224] Handling call
0709 12:21:37.021776 (+ 48454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:37.119699 (+ 97923us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:37.196617 (+ 76918us) log.cc:844] Serialized 14 byte log entry
0709 12:21:37.781143 (+584526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:37.781225 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:37.792753 (+ 11528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:37.792824 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:37.792939 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56537,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":7418,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9268,"thread_start_us":605187,"threads_started":2}
I20260709 12:21:38.466017  7963 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:38.407719  7774 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.467535  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:38.468376  7774 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.469002  7774 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.469444  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:38.470230  7874 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:38.470552  4371 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.470743  7956 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.470949  7874 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:38.471269  7606 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:38.471737  7969 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:38.472220  7969 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.472587  7969 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:38.473196  7963 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:38.457376  7815 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:38.475365  7815 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.477334  7815 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:38.480476  7930 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 1.189s	user 0.003s	sys 0.003s
I20260709 12:21:38.480901  7568 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.481531  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 726) took 1105 ms. Trace:
I20260709 12:21:38.482194  7815 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.462371  4331 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:21:38.479445  7898 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.459019  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:38.484740  7898 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:38.476831  7698 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:38.486864  7957 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:38.488945  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.490717  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.491436  4986 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:38.489992  7703 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.462711  7964 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.493861  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.494221  7964 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:38.495822  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.496445  4992 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.499737  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.500818  7943 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:38.501200  7943 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:38.501540  7943 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.501701  7969 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:38.508831  7969 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:38.475697  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.501518  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.481967  4409 rpcz_store.cc:276] 0709 12:21:37.376445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:37.380604 (+  4159us) service_pool.cc:224] Handling call
0709 12:21:38.481321 (+1100717us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003764d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:38.481458 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315843968}
I20260709 12:21:38.521960  7963 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:38.523407  7963 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.539397  7859 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.540307  7859 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.510221  7863 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.510044  7943 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.543715  4327 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:38.544669  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.544947  7606 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:38.547104  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 94472.2us
I20260709 12:21:38.554459  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:38.557053  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.566371  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:38.566505  7603 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.567268  7603 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.568725  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.569610  7603 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:38.621313  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.617645  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:38.626267  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 74399.7us
W20260709 12:21:38.598549  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.597869  4984 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:38.599656  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.597288  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.598184  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:38.621752  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.628381  4987 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:38.582726  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.569943  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:38.631081  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.631451  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.632692  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.633350  7874 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:38.633728  7874 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.634148  7874 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.633721  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.636488  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.637233  7958 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.639585  7932 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.630995  4986 raft_consensus.cc:2376] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10. Re-sending same reply.
I20260709 12:21:38.645714  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.646255  4331 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:38.647392  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.494242  7703 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:38.649962  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:38.654062  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.545754  7740 raft_consensus.cc:2764] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:21:38.655050  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.655777  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.657239  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.657938  4401 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:38.658967  4333 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:38.659130  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.660411  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.660617  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.661074  4405 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:38.662401  4405 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:38.663031  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.660430  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.582813  7952 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:38.669271  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.662427  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:38.670694  4256 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:38.469483  7774 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.672607  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.674105  7774 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.674866  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.678915  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.675530  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.601382  7951 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.680186  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:38.680320  7951 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.681262  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:38.681813  4986 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.682869  7951 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.629477  7863 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:21:38.676100  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.676174  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:38.644332  7939 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:38.676761  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.675530  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.694802  4253 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:38.682873  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.663815  4400 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:38.675760  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.680433  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:38.669207  7603 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:21:38.696357  4254 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:38.685591  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.685724  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.676782  4406 pending_rounds.cc:85] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 6
I20260709 12:21:38.698218  4406 pending_rounds.cc:107] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:21:38.698398  4406 raft_consensus.cc:2889] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:38.686585  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.668891  7898 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:38.706458  7898 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:38.706630  4400 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:21:38.706956  7898 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:38.668869  7966 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:38.687958  4404 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:38.603070  7943 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.582741  7606 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:38.645066  7928 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:38.693738  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 46451.8us
I20260709 12:21:38.685365  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:38.697717  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.699380  4408 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:38.701014  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.702584  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.703743  4991 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:38.697317  4988 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 5.
I20260709 12:21:38.691709  7962 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.725127  4332 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:38.725279  7861 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:38.697811  4403 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:21:38.699517  7964 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.725174  7962 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.726617  7964 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.713306  4219 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.714296  4409 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
W20260709 12:21:38.718469  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.720096  7517 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:38.722350  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.723793  4956 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.724112  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.731835  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:38.731905  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.732303  4986 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:38.692507  7859 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:38.731457  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:38.734922  4984 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:38.735028  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.652884  7933 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.738663  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.733841  7863 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:38.741071  7863 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.736406  7951 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:38.747219  4983 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:38.730198  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:38.711975  7952 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:38.771224  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 57982.5us
I20260709 12:21:38.772179  4219 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.773908  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.760816  7703 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:38.775454  7703 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.775954  7703 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.776862  7967 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:38.778764  7967 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:21:38.780874  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 98668.5us
I20260709 12:21:38.779881  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:38.745607  7517 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:38.690358  7874 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.754499  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.745604  7943 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:38.796211  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:38.796782  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 108105us
I20260709 12:21:38.811364  4984 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:21:38.790117  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:38.770815  7928 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:38.828366  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.791173  7973 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:38.820262  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:38.780666  7962 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:38.831408  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 76979.6us
I20260709 12:21:38.787992  7958 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.821058  4256 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:38.835585  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:38.838107  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 125533us
I20260709 12:21:38.815511  7517 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.810714  7967 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:38.840399  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:38.828488  7698 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:38.853814  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:38.854516  4402 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.853936  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:38.858976  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.835651  7969 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:38.860085  4333 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:38.829699  7982 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:38.846916  7517 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:38.862069  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.866549  4252 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:38.853629  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:38.867313  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.868086  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.868402  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.871428  4331 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:38.864059  4325 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:38.872874  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.872964  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:38.864710  7982 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:38.875509  4256 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:38.875559  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.876560  4329 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:38.877853  4401 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:38.855165  7957 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.874557  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:38.880699  4252 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:38.867708  7662 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:38.855894  7698 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:38.884080  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49955.9us
I20260709 12:21:38.886273  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:38.889413  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.890252  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:38.891764  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:38.893076  7977 log.cc:927] Time spent T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:21:38.893589  7964 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:38.896406  7975 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:21:38.883658  7984 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:21:38.883883  7874 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:38.919569  4402 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:38.876736  7963 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:38.838702  7606 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.866281  7603 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:21:38.879606  7982 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:38.888094  7952 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:38.884603  7698 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:38.958034  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:38.911216  7662 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:38.885905  7957 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:38.979995  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:38.954890  7967 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:38.966903  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 112657us
I20260709 12:21:38.982468  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:38.965553  7963 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:38.986894  4253 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:38.992384  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:38.985653  4328 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:38.981818  7967 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.983632  7662 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:38.995395  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 255367us
I20260709 12:21:39.192759  4401 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:39.037575  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:39.044970  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.196554  4409 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:39.123361  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:39.031608  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:39.197741  4408 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:39.152274  4247 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:39.198001  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:39.031121  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:39.027557  7969 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:39.053699  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:39.154134  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 165693us
I20260709 12:21:39.098320  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:39.134377  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 280807us
I20260709 12:21:39.095794  4329 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:39.008738  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:39.022316  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:38.994181  7963 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.238373  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:39.236114  4407 raft_consensus.cc:606] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:39.246362  4407 raft_consensus.cc:614] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:39.227778  4403 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:39.212067  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:39.213135  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 220866us
I20260709 12:21:39.237175  4252 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:39.249655  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:39.251077  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 194340us
I20260709 12:21:38.997323  7933 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:39.046576  7986 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:39.256647  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:39.268317  4247 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:39.268525  4254 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:39.257822  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:39.258805  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46876.2us
I20260709 12:21:39.097846  7740 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.162s
I20260709 12:21:39.226114  7973 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.260484  4983 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:21:39.260646  7606 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:38.996986  7989 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.260s
I20260709 12:21:39.260969  7968 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:39.261210  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:39.282609  4248 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.119906  7861 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:39.262315  7939 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.199857  7970 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.288379  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:39.289022  4257 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:39.264196  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:39.264856  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:38.994539  7985 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:39.050200  7964 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:39.001570  7967 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.139320  7958 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.000981  7900 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.147459  7957 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:39.152789  7874 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:39.200239  7980 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.260192  8002 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.272816  4218 leader_election.cc:400] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10.
I20260709 12:21:39.274318  4983 pending_rounds.cc:85] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 6
I20260709 12:21:39.227101  7943 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.142868  7517 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.288962  7861 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.291514  7962 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.251246  7951 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.294431  4408 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:39.296162  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:39.257476  7969 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:39.298887  7958 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.044888  7898 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:39.338289  4992 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:21:39.142365  7982 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.311514  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:39.312935  4218 leader_election.cc:403] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:39.313010  4983 pending_rounds.cc:107] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:21:39.340893  4983 raft_consensus.cc:2889] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:39.316736  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:39.341282  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 102039us
I20260709 12:21:39.280920  4955 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:39.329777  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:39.299785  7933 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.330303  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:39.331377  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:39.343727  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 62897us
I20260709 12:21:39.295773  7964 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:39.318697  7932 consensus_meta.cc:287] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.007s
I20260709 12:21:39.328395  7861 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:39.342303  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 72181.9us
I20260709 12:21:39.342039  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:39.298133  7939 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.291872  7606 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.354821  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:39.337634  7774 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:39.338011  7958 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:39.362805  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:39.317719  7874 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.345202  7952 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:39.300372  7970 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.329195  7951 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.347882  7999 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10.
I20260709 12:21:39.373347  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:39.354018  7978 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:39.353722  7932 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:39.334204  7943 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.360684  7988 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:39.335418  7962 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.379370  7657 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:39.380610  7982 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:39.362408  7774 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:39.381026  8001 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:21:39.366168  7933 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:39.323213  8002 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.303681  7985 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:39.323050  7980 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.398079  7988 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.383875  7978 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:39.420608  7774 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:39.497906  7993 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:21:39.406167  7657 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:39.376691  7989 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:39.602444  4149 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.422415  7964 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:39.490499  7969 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.603371  7657 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.140533  7898 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:39.598472  7988 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.093127  7874 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.132035  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:39.603839  8000 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.233s	user 0.000s	sys 0.003s
W20260709 12:21:39.986579  4333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.004s	sys 0.010s
I20260709 12:21:39.999023  4402 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:21:39.629792  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:39.600279  7978 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:39.968961  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2536) took 1013 ms. Trace:
W20260709 12:21:40.143378  7958 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.760s	user 0.011s	sys 0.000s
W20260709 12:21:40.121022  8006 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.800s	user 0.003s	sys 0.000s
I20260709 12:21:40.146733  7962 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.152412  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:40.152017  4333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.008s	sys 0.013s
I20260709 12:21:40.153872  4256 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:40.118076  7859 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:40.143280  4149 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 8, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 8 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.162011  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "752b8a9170934f31b770429d237cdb43"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
W20260709 12:21:39.944284  4248 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 12:21:40.155541  4400 rpcz_store.cc:276] 0709 12:21:38.955258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.955430 (+   172us) service_pool.cc:224] Handling call
0709 12:21:38.955748 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:39.135113 (+179365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:39.135158 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:39.139658 (+  4500us) log.cc:844] Serialized 26 byte log entry
0709 12:21:39.261618 (+121960us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:21:39.261661 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:39.261726 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:39.968730 (+707004us) raft_consensus.cc:1685] finished
0709 12:21:39.968754 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:39.968888 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178184,"raft.queue_time_us":186511,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":184,"thread_start_us":121615,"threads_started":1,"wal-append.queue_time_us":141746}
I20260709 12:21:39.600781  7993 consensus_queue.cc:1243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:39.586091  7982 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.169242  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:39.792191  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.147578  7943 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.147730  7932 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:40.159114  4328 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.008s	sys 0.032s
I20260709 12:21:39.740285  7951 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.160698  4331 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.218132  7932 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.221575  7606 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.221392  7932 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:39.584988  7966 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:39.654644  7517 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:39.790472  8005 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:21:39.736158  8003 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.277s	user 0.004s	sys 0.000s
I20260709 12:21:40.227615  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.228350  4329 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:40.227617  7966 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.159090  8013 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:39.701854  8004 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.302s	user 0.001s	sys 0.002s
W20260709 12:21:39.761829  7703 consensus_meta.cc:287] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.004s
I20260709 12:21:40.203217  7964 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.169510  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:40.196130  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 404021us
I20260709 12:21:40.197214  4326 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:40.261135  4332 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:40.263478  4332 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:21:40.264931  4371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.008s	sys 0.009s
W20260709 12:21:40.265455  4371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.009s	sys 0.009s
W20260709 12:21:40.266175  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 911347us
I20260709 12:21:40.267608  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:40.202651  4327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.004s	sys 0.012s
I20260709 12:21:39.746037  7985 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:40.175982  7698 consensus_meta.cc:287] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 1.185s	user 0.012s	sys 0.000s
W20260709 12:21:40.212603  4328 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.008s	sys 0.036s
I20260709 12:21:40.177357  7958 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:39.604080  7989 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:39.768352  7970 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:39.735698  7995 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.241s	user 0.004s	sys 0.000s
W20260709 12:21:39.967216  7861 consensus_meta.cc:287] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.590s	user 0.001s	sys 0.009s
I20260709 12:21:39.762815  7939 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:40.163473  4219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.011s	sys 0.004s
W20260709 12:21:40.328061  4219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.012s	sys 0.004s
I20260709 12:21:39.757212  7980 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.162540  7859 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:39.741457  8009 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:21:40.189252  7928 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:40.331979  7928 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.334650  7928 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:40.336372  4250 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:40.278223  7703 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.330344  7859 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.339825  7859 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:40.340039  7703 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.291339  7951 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:21:40.256074  4331 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
W20260709 12:21:40.202713  7662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.013s	sys 0.032s
I20260709 12:21:40.256268  4149 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.187911  4248 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:40.349601  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1906) took 1129 ms. Trace:
I20260709 12:21:40.202417  7962 raft_consensus.cc:2764] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:21:40.277078  4327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.004s	sys 0.012s
I20260709 12:21:40.280272  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.281087  7932 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:40.158646  7740 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.292872  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2537) took 1314 ms. Trace:
I20260709 12:21:40.364607  4402 rpcz_store.cc:276] 0709 12:21:38.978476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.982129 (+  3653us) service_pool.cc:224] Handling call
0709 12:21:40.292713 (+1310584us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54000aee54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:40.292815 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165731584}
I20260709 12:21:40.288319  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.365453  4407 raft_consensus.cc:606] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:40.366027  4407 raft_consensus.cc:614] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:40.297581  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.366864  4252 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:40.299726  4329 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:40.361591  4149 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 10, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 10 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.368376  4329 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:40.302183  4372 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.305716  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:40.308720  4152 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 385) took 31842 ms (client timeout 15000 ms). Trace:
I20260709 12:21:40.309916  4247 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:40.313062  7966 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:40.319412  7991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.015s	sys 0.093s
I20260709 12:21:40.320106  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:40.322396  4256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1925) took 1349 ms (client timeout 1687 ms). Trace:
I20260709 12:21:40.350663  4219 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.350057  4248 rpcz_store.cc:276] 0709 12:21:39.232642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.250931 (+ 18289us) service_pool.cc:224] Handling call
0709 12:21:40.349516 (+1098585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:40.360071  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 907) took 1001 ms. Trace:
I20260709 12:21:40.293686  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.295642  7698 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:40.373975  7963 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 1.107s	user 0.010s	sys 0.002s
I20260709 12:21:40.301429  7943 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:21:40.374118  7967 consensus_meta.cc:287] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 1.043s	user 0.010s	sys 0.002s
W20260709 12:21:40.358377  7662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.013s	sys 0.033s
W20260709 12:21:40.374912  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 114126us
I20260709 12:21:40.383260  7703 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:40.359516  7861 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:40.380650  7991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.015s	sys 0.094s
I20260709 12:21:40.384085  4149 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.378307  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:40.376936  4256 rpcz_store.cc:269] 0709 12:21:38.963650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.967415 (+  3765us) service_pool.cc:224] Handling call
0709 12:21:40.304587 (+1337172us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000852d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:40.304728 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605012352}
I20260709 12:21:40.390792  4149 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 6, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:40.348438  7970 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.376772  4253 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:40.377522  4327 rpcz_store.cc:276] 0709 12:21:39.358173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.358299 (+   126us) service_pool.cc:224] Handling call
0709 12:21:39.358574 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.358774 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:21:39.369008 (+ 10234us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.359383 (+990375us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.359591 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.359647 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:40.359724 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.359815 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.359993 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46221,"prepare.queue_time_us":28776,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":6969,"raft.queue_time_us":4103,"raft.run_wall_time_us":13184,"spinlock_wait_cycles":10602112,"thread_start_us":989718,"threads_started":1}
I20260709 12:21:40.388701  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:40.376839  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 74744.4us
W20260709 12:21:40.391688  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 238146us
I20260709 12:21:40.394824  4372 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:40.395793  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 233228us
I20260709 12:21:40.374960  8017 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.365388  7939 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:40.397465  4254 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:40.398175  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:40.423544  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45330us
I20260709 12:21:40.431962  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.394913  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.363286  7898 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:21:40.360062  7606 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:21:40.445801  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 47737.7us
I20260709 12:21:40.385063  7932 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.376012  7980 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:40.433135  4219 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.450724  7859 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:21:40.438364  7774 consensus_meta.cc:287] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.000s
W20260709 12:21:40.371212  4152 rpcz_store.cc:269] 0709 12:21:08.466412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:08.480841 (+ 14429us) service_pool.cc:224] Handling call
0709 12:21:40.308453 (+31827612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:34.379342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:34.472257 (+ 92915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:34.472973 (+   716us) write_op.cc:435] Acquired schema lock
0709 12:21:34.476147 (+  3174us) tablet.cc:662] Decoding operations
0709 12:21:34.716580 (+240433us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:34.740100 (+ 23520us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:34.749415 (+  9315us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:21:34.841168 (+ 91753us) tablet.cc:701] Row locks acquired
0709 12:21:34.843155 (+  1987us) write_op.cc:260] PREPARE: finished
0709 12:21:34.866575 (+ 23420us) write_op.cc:270] Start()
0709 12:21:34.875921 (+  9346us) write_op.cc:276] Timestamp: P: 1783599694863151 usec, L: 0
0709 12:21:34.875954 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:21:34.960004 (+ 84050us) log.cc:844] Serialized 2049 byte log entry
0709 12:21:36.110532 (+1150528us) op_driver.cc:464] REPLICATION: finished
0709 12:21:36.691389 (+580857us) write_op.cc:301] APPLY: starting
0709 12:21:36.691535 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:36.691750 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:36.743090 (+ 51340us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:36.965073 (+221983us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:37.175842 (+210769us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:21:37.192990 (+ 17148us) write_op.cc:312] APPLY: finished
0709 12:21:37.302031 (+109041us) log.cc:844] Serialized 47 byte log entry
0709 12:21:37.791827 (+489796us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:37.820389 (+ 28562us) write_op.cc:454] Released schema lock
0709 12:21:37.826847 (+  6458us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:37.925084 (+ 98237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:37.925113 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3450037,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":580443,"apply.run_cpu_time_us":32872,"apply.run_wall_time_us":1211555,"num_ops":5,"prepare.queue_time_us":29302,"prepare.run_cpu_time_us":40210,"prepare.run_wall_time_us":802045,"raft.queue_time_us":277377,"raft.run_cpu_time_us":29014,"raft.run_wall_time_us":452460,"replication_time_us":1233730,"thread_start_us":1234078,"threads_started":5,"wal-append.queue_time_us":1000799,"wal-append.run_cpu_time_us":37809,"wal-append.run_wall_time_us":2716628}]]}
I20260709 12:21:40.441174  7861 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.442483  7698 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:40.443782  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 48944.4us
I20260709 12:21:40.434134  7703 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:40.435242  7662 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.429096  4329 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.555732  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:40.436694  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:40.425420  7968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.021s	sys 0.024s
I20260709 12:21:40.556700  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:40.557046  7968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.021s	sys 0.024s
I20260709 12:21:40.557365  7968 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:40.557626  4401 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:40.384963  7963 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.558290  7968 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.559837  4406 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:40.451197  4149 catalog_manager.cc:5697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.560649  7963 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:40.561473  7963 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:40.561899  4149 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.562808  7963 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:40.393839  7967 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.454243  8015 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:40.565308  7967 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:40.424402  8017 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:40.566130  8017 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:40.566646  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.458637  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 906) took 1100 ms. Trace:
I20260709 12:21:40.422758  7951 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:40.567696  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.567876  7951 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:40.568298  7951 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:40.493405  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.460230  7928 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:40.570290  7928 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.570665  7928 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.571692  7963 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:40.573011  7963 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.577327  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.577420  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.578222  7963 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.578629  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.452859  7932 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.579644  7932 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.389329  7943 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.426810  7970 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.584882  7943 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.585335  7970 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.446617  7939 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.588325  7939 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.495018  7966 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:40.589340  7966 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:40.553503  4402 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:40.554733  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:40.585393  7943 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.593958  7943 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.594889  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.594504  4149 catalog_manager.cc:5697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 6, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.596482  7943 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:40.555660  4408 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:40.447860  8023 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.557516  4329 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.590581  7966 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:40.597292  8023 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.599714  4400 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:21:40.600734  8023 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:40.601227  7970 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:40.601320  8023 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:40.601804  7970 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:40.601994  8023 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.558344  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.602784  7970 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.603597  4984 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
W20260709 12:21:40.559916  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.430860  7962 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:40.605579  7962 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:40.606006  7962 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:40.606343  7939 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.375572  7740 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.597295  7967 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:40.608794  7740 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.454756  7980 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:40.575461  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 80098.6us
I20260709 12:21:40.575721  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.609798  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.567518  4328 rpcz_store.cc:276] 0709 12:21:39.357782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.358743 (+   961us) service_pool.cc:224] Handling call
0709 12:21:39.370944 (+ 12201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.371123 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:40.291867 (+920744us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.456333 (+164466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.456381 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:40.458386 (+  2005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:40.458474 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:40.458584 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258201,"prepare.queue_time_us":215627,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":40934,"thread_start_us":1073302,"threads_started":2}
I20260709 12:21:40.610602  4253 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:40.610713  7980 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:40.494784  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.611711  4250 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:40.575883  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.612605  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.596088  4149 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 5, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:40.606856  7939 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:40.613124  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.614210  4149 catalog_manager.cc:5697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 7, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 7 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.615271  4256 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:40.615489  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.616029  4333 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.611539  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.616371  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.616930  4257 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:40.616995  4252 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 4.
I20260709 12:21:40.618083  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.619053  4327 raft_consensus.cc:2410] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:40.613065  4249 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:40.502362  7952 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.003s	sys 0.008s
W20260709 12:21:40.620576  7952 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.004s	sys 0.010s
I20260709 12:21:40.621272  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.622040  4328 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:40.606900  7962 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:40.624814  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.615904  4149 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 6, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.627315  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.648675  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.649312  4249 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:40.628093  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.629208  7932 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.629949  4329 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:21:40.642076  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:40.644693  4333 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:40.652841  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.646495  7970 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:40.651129  4149 catalog_manager.cc:5697] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 1 to 4, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 4 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.656908  7952 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:40.656811  7932 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.654838  7970 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.657919  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:40.658892  4989 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:40.661772  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:40.655349  4149 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.646611  7966 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.664551  7966 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.665683  7970 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.667683  7952 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:40.668188  7952 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:40.668694  7952 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:40.674803  4989 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:40.676386  8023 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:40.679286  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.715482  7928 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.678798  7952 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.716863  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.718554  7952 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.683488  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:40.664624  4149 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 7, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 7 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.689481  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.689723  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:40.703088  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.710520  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.503043  7662 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.714128  7966 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.720109  4149 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 8, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 8 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.734583  4985 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:40.733120  4328 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:40.492070  7774 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:40.555408  4955 connection.cc:256] RPC call timeout handler was delayed by -1.4107975460001398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:21:40.718807  7698 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:40.745673  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.746248  4333 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.747658  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:40.749985  7657 consensus_meta.cc:287] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.002s
I20260709 12:21:40.750460  7657 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.752854  4333 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:40.752960  7774 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.753629  7774 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:40.753973  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:40.754098  7774 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:40.740945  4955 connection.cc:256] RPC call timeout handler was delayed by -1.4089975460001369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 12:21:40.754971  4955 connection.cc:256] RPC call timeout handler was delayed by -1.3945975460001137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:21:40.755077  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:40.755326  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0282975459999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:21:40.755658  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0264975459999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:21:40.757571  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:40.720082  7928 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.754562  4325 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.760270  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.720285  7932 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:40.455410  7989 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.555163  8028 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.734469  8013 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:40.745224  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.720225  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:40.764086  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.735023  7662 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.761620  4149 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 8, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 8 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.770399  4405 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:40.771328  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:40.781591  4402 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 6: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:40.775662  4325 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:40.739029  8015 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:40.789737  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.793011  8044 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:40.793116  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.793989  8050 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:40.793872  8044 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:40.796072  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.796300  4149 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 2 to 6, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:40.797324  8044 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:40.798216  8044 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:40.797729  4149 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 5, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.789045  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:40.789546  4250 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:40.800961  4404 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:40.552399  7861 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.209s
W20260709 12:21:40.785300  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 65133.9us
I20260709 12:21:40.806131  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:40.804643  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:40.807191  4255 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:40.767051  7698 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:40.784253  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:40.800586  8020 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:21:40.800228  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:40.813638  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:40.814370  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.815871  4256 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:40.788640  4409 raft_consensus.cc:1240] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:40.833725  4405 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:21:40.816689  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 380031us
I20260709 12:21:40.834573  4991 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:40.836457  4404 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:40.837963  4252 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:40.779028  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 349977us
I20260709 12:21:40.838585  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:40.843936  8022 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 12:21:40.844151  4267 tablet_copy_service.cc:342] P 0aa405b398df42edbf74ee643aeb18dc: Request end of tablet copy session 0952d204644f41a88e5e463e697dcc27-374e8fa3690a41af9874f32b270bf3e1 received from {username='slave'} at 127.0.0.1:57876
I20260709 12:21:40.844715  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:40.846182  8026 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:21:40.847008  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:40.847566  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:40.848268  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:40.805859  8039 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.844002  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:40.849576  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:40.850260  4402 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:40.845961  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.801615  7932 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:40.855518  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:40.844756  4267 tablet_copy_service.cc:434] P 0aa405b398df42edbf74ee643aeb18dc: ending tablet copy session 0952d204644f41a88e5e463e697dcc27-374e8fa3690a41af9874f32b270bf3e1 on tablet 374e8fa3690a41af9874f32b270bf3e1 with peer 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:40.787786  8028 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.799857  8013 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:40.815567  8023 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:40.859686  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.046901  4256 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:41.081378  4991 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
W20260709 12:21:41.110034  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:41.112468  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 354946us
I20260709 12:21:40.939162  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:41.036974  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.152875  8058 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.967437  8017 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:41.153245  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:40.991005  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.153402  8058 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.007424  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:40.963387  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:41.031971  4334 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:40.814832  8015 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:21:41.151623  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 315276us
W20260709 12:21:41.153781  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.153831  4332 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:41.154402  4250 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.155706  8058 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.156234  8058 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.156653  8058 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.158731  8058 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.159575  7703 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:40.808633  8032 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.160669  8017 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.160980  8032 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.012605  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:40.923245  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:40.812424  7958 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:40.849552  7988 consensus_meta.cc:287] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.003s
W20260709 12:21:41.168110  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:40.988220  7964 consensus_meta.cc:287] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 12:21:41.164621  4402 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:40.803918  8025 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:41.009975  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 164072us
I20260709 12:21:41.168893  4250 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:40.845976  7770 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.817672  8030 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:40.967173  7978 consensus_meta.cc:287] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.001s
I20260709 12:21:40.971076  7943 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.963035  7980 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.892814  7740 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.299s
I20260709 12:21:41.125818  8055 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.125733  8036 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.208130  4334 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:21:40.856720  7968 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:40.946063  7874 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.178895  4372 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:40.854301  8039 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:41.183903  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.022095  7774 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:40.833514  7952 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.350s
I20260709 12:21:41.186601  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:41.223155  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.240712  4408 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:41.007972  8037 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.021173  7657 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.189989  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.191131  4256 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:41.111971  7969 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.165457  8023 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.028582  7972 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:40.944868  7928 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:41.159237  8058 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.012602  4243 tablet_service.cc:1558] Processing DeleteTablet for tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:41690
I20260709 12:21:41.164585  7993 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.192230  4331 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:21:41.260819  4331 pending_rounds.cc:85] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 3
I20260709 12:21:41.261125  4331 pending_rounds.cc:107] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:21:41.261523  4331 raft_consensus.cc:2889] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:41.169503  8032 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.210686  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:41.209388  7943 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.243077  7874 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.212527  7968 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:40.824508  7951 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.279974  7951 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.280750  4403 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:41.281306  7968 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.185648  8017 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:41.034003  7662 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.250898  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 72058.4us
I20260709 12:21:41.255496  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:41.027377  7698 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.194871  8035 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 12:21:41.309327  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:41.197518  8015 raft_consensus.cc:697] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:41.319187  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:41.240433  8039 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.175845  7988 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.327864  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:41.328685  4988 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:41.329769  7988 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.330940  4248 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:41.210971  8056 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:41.305338  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:41.310993  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:41.194490  7958 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:21:41.337546  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:41.362942  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 469344us
I20260709 12:21:41.194725  7980 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.192050  7770 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.367334  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:41.260455  8002 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.368021  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:41.368903  4253 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:41.335093  4991 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.365640  4142 maintenance_manager.cc:419] P a6ff35c4ac1544009dec2b8d57867ced: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033395
I20260709 12:21:41.386348  4987 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:41.370478  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:41.365204  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 59963.1us
I20260709 12:21:41.389058  4372 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:40.856158  8044 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.333134  8064 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:41.376456  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:41.307340  7657 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:41.306816  7964 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.306754  8032 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:41.195129  7932 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.198940  7978 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.382745  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 523127us
I20260709 12:21:41.384833  4985 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:41.262826  8023 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.186054  8025 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.375423  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 186475us
I20260709 12:21:41.393318  4408 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:41.394083  4991 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:41.396692  4989 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:41.366885  7951 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:41.399865  4409 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.448024  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.197685  8030 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.378753  4405 consensus_meta.cc:287] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:21:41.448875  4405 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:41.449231  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.332409  8017 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.390964  8051 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:41.260803  7969 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.377836  8056 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:41.331437  7928 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.307083  7993 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.213497  8055 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.256085  8037 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.424321  4406 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:41.400051  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:41.452268  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.420054  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:41.302194  7972 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.400569  8002 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.470697  4252 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:41.429602  8013 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.428884  8028 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.405195  7740 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:41.467621  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:41.469422  4328 raft_consensus.cc:2368] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9.
I20260709 12:21:41.426082  7770 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.472339  4984 raft_consensus.cc:2393] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:41.485939  4956 leader_election.cc:400] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9.
I20260709 12:21:41.486459  4956 leader_election.cc:403] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:21:41.428886  7874 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.430945  7980 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.490139  8066 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.492106  8056 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.493613  8030 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.494467  7993 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.494565  7662 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.450845  8041 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.495584  8041 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.455421  4255 consensus_meta.cc:287] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.003s
I20260709 12:21:41.461733  7966 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.483675  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:41.404670  7964 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.421640  8042 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:21:41.405136  7657 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.469182  7703 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:21:41.421873  8015 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.496357  7928 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.595842  7943 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.579537  4252 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:41.598115  4328 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:41.598662  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.510210  4409 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:41.600736  4255 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
W20260709 12:21:41.601840  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.479803  7958 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.478870  7740 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:41.607661  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.490082  7770 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9.
W20260709 12:21:41.604944  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 204971us
W20260709 12:21:41.603055  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 150876us
I20260709 12:21:41.618531  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:41.620258  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.622442  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:41.634758  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 444794us
I20260709 12:21:41.521281  8066 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:41.502210  7980 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.638057  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:41.638271  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 170753us
I20260709 12:21:41.520292  8017 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.492031  8070 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:41.639822  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.591656  7969 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.578014  8025 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.520658  8037 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.636906  7928 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:41.628528  7740 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:41.627560  8042 consensus_queue.cc:1243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:41.708396  7928 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:41.708848  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.519204  8055 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.704667  7657 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.707600  8075 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41690 (request call id 96) took 1192 ms. Trace:
I20260709 12:21:41.709352  7928 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.604851  7972 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:41.757010  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 119035us
I20260709 12:21:41.627985  7943 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.640592  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:41.739745  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.709884  8075 rpcz_store.cc:276] 0709 12:21:40.721673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.811768 (+ 90095us) service_pool.cc:224] Handling call
0709 12:21:41.706918 (+895150us) ts_tablet_manager.cc:1151] Deleting tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0
0709 12:21:41.707041 (+   123us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:21:41.707434 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":399603,"thread_start_us":240857,"threads_started":1}
I20260709 12:21:41.760210  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:41.767897  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 128059us
I20260709 12:21:41.640341  8066 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:41.771483  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.640820  7951 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:41.640106  8073 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.607712  7968 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:41.820040  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 59912.2us
I20260709 12:21:41.836912  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:41.837690  7968 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.838064  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:41.624197  7958 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.766593  7980 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:41.838881  7966 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.766394  8055 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.839463  7969 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.839742  8055 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.768731  7657 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:41.833405  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:41.843703  8055 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.847414  7966 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.817269  8066 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:41.821084  8036 consensus_meta.cc:287] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 12:21:41.772800  8081 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:41.850754  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 79390.5us
I20260709 12:21:41.852802  4371 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.768744  7703 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:21:41.857771  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.850538  8080 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.859094  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:41.710649  8070 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.866020  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:41.868234  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:41.866287  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:41.870973  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:41.871135  8068 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:41.872604  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:41.872946  8041 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.873082  8068 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.874682  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:41.875362  4406 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:41.876315  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:41.876546  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2574) took 1262 ms. Trace:
I20260709 12:21:41.876797  4406 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.876938  4332 rpcz_store.cc:276] 0709 12:21:40.614569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.619739 (+  5170us) service_pool.cc:224] Handling call
0709 12:21:40.619973 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.155398 (+535425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.876321 (+720923us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54003d3e54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:41.876491 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227345280}
I20260709 12:21:41.877534  8023 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:41.878278  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:41.878769  4402 raft_consensus.cc:2368] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9.
I20260709 12:21:41.851742  7978 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:41.879475  8071 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:21:41.851500  8027 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:41.880576  7951 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.872439  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:41.815840  8039 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.884927  8068 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:41.886077  8039 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.886819  4137 catalog_manager.cc:5028] TS 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): tablet 4079a3fa5d6b4cafa2f9b17573d0e1b0 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:21:41.861907  7980 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:41.853893  8081 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:41.888710  8072 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 12:21:41.889850  8081 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.890151  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2554) took 1031 ms. Trace:
I20260709 12:21:41.860293  7874 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:41.890538  4409 rpcz_store.cc:276] 0709 12:21:40.858765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.893413 (+ 34648us) service_pool.cc:224] Handling call
0709 12:21:41.889829 (+996416us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54002355d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:41.889930 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563919104}
I20260709 12:21:41.892428  8070 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.890841  7958 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:41.894096  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:41.895216  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:41.897336  4333 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:41.882923  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:41.899132  4332 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:41.902273  4404 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:41.851656  7943 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:41.856529  8036 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:41.868084  8073 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:41.934684  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.941133  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:41.907045  8013 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:41.945359  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:41.946111  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:41.939459  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:41.946647  4256 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:41.947000  4334 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:41.953950  8023 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:41.944860  8074 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:41.955580  7698 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:41.853945  8077 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:21:41.928645  7740 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.988418  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:42.012027  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.048787  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.049892  4333 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:42.050047  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:41.938853  8073 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:41.910713  7943 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.060930  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.062295  4334 raft_consensus.cc:2410] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:21:41.958089  7962 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:41.936875  8068 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:21:42.020726  7698 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:42.054044  8029 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:42.078460  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.050966  7978 consensus_queue.cc:1059] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:21:42.085670  4406 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:41.959869  8013 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:41.965337  8074 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 12:21:42.053115  8042 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:21:42.088673  4328 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:42.090235  4334 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:42.089810  7980 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:42.143350  4334 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:42.145774  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 132655us
I20260709 12:21:42.138027  8068 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.156539  8090 consensus_queue.cc:1059] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:42.157678  8090 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:42.160390  8052 raft_consensus.cc:3055] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.160806  8052 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.158902  8090 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:42.173341  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.154341  8068 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.180979  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.181869  4406 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:42.173316  7978 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:42.171205  8066 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.142092  8073 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.185977  7978 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.173712  7698 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.199671  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.203285  7943 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.204200  8023 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.193688  8090 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.211999  4406 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:42.192713  7740 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.204214  8013 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:42.209757  8023 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:42.215150  8023 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.216424  8023 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.221271  7978 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.222642  7978 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.223075  8066 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.211356  8068 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:42.224337  4403 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1769) took 1669 ms (client timeout 1915 ms). Trace:
I20260709 12:21:42.224749  8068 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.225723  4400 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:42.224761  4403 rpcz_store.cc:269] 0709 12:21:40.555400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.555508 (+   108us) service_pool.cc:224] Handling call
0709 12:21:42.224136 (+1668628us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54003c73d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.224281 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665285376}
I20260709 12:21:42.230365  4403 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.191790  8052 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.232594  8052 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.232973  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2568) took 2968 ms. Trace:
I20260709 12:21:42.233598  4330 rpcz_store.cc:276] 0709 12:21:39.264376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:39.264523 (+   147us) service_pool.cc:224] Handling call
0709 12:21:39.275930 (+ 11407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:39.655970 (+380040us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:39.917916 (+261946us) log.cc:844] Serialized 14 byte log entry
0709 12:21:40.426644 (+508728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:40.426721 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:40.426786 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.232619 (+1805833us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400203fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:42.232688 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.232854 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24577,"prepare.queue_time_us":643802,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":47649,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":873316224,"thread_start_us":484503,"threads_started":1,"wal-append.queue_time_us":577140,"wal-append.run_cpu_time_us":1865,"wal-append.run_wall_time_us":1345527}
W20260709 12:21:42.242101  4252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1923) took 1387 ms (client timeout 1546 ms). Trace:
W20260709 12:21:42.242544  4252 rpcz_store.cc:269] 0709 12:21:40.854874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.855272 (+   398us) service_pool.cc:224] Handling call
0709 12:21:42.241925 (+1386653us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540019a854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.242031 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745246080}
I20260709 12:21:42.244330  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2547) took 1387 ms. Trace:
I20260709 12:21:42.244736  4402 rpcz_store.cc:276] 0709 12:21:40.856868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.177118 (+320250us) service_pool.cc:224] Handling call
0709 12:21:42.244152 (+1067034us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400375fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.244272 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385582336}
I20260709 12:21:42.249150  4255 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:42.253544  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.255263  4992 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:42.255777  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.256331  4991 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:42.256910  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:42.259284  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.260294  4406 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:42.261989  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.262853  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.263417  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:42.265628  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:42.266726  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:42.265931  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:42.267606  4992 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:42.257295  7932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.000s	sys 0.018s
I20260709 12:21:42.278975  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.279598  4402 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:42.279488  4990 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEARNER]: Advancing to term 6
I20260709 12:21:42.280344  4404 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:42.280365  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.280829  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.281790  4988 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:42.290153  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.290457  4985 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:42.291769  4987 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:42.212674  8090 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.292516  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:42.265611  8066 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:42.261682  7703 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.296411  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.301604  7703 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.303782  7703 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:42.281424  7932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.000s	sys 0.019s
I20260709 12:21:42.312425  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.268585  7982 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.291581  7943 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.316815  4402 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:42.318312  4409 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.315474  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.280833  8093 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:42.320255  4992 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:42.320472  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.321473  4992 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:21:42.328027  8090 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.329334  8090 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.323077  7943 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:42.336445  4371 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.132:43853 timed out after 1.718s (SENT) [suppressed 4 similar messages]
I20260709 12:21:42.336380  4991 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:42.337545  4218 leader_election.cc:400] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9.
I20260709 12:21:42.337976  4218 leader_election.cc:403] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:21:42.341030  8015 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:42.341414  8015 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.342319  8015 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.346208  4990 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:42.347693  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1090) took 1770 ms. Trace:
I20260709 12:21:42.348140  4983 rpcz_store.cc:276] 0709 12:21:40.577371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.578460 (+  1089us) service_pool.cc:224] Handling call
0709 12:21:40.578775 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:40.578998 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:40.631323 (+ 52325us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.232235 (+1600912us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18003dc0c0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e23a
0709 12:21:42.347226 (+114991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.347273 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.347340 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.347501 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.347638 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20349,"prepare.queue_time_us":191967,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":67020,"spinlock_wait_cycles":62155008,"thread_start_us":331100,"threads_started":3,"wal-append.queue_time_us":308183,"wal-append.run_cpu_time_us":1236,"wal-append.run_wall_time_us":1107286}
W20260709 12:21:42.364697  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 111851us
I20260709 12:21:42.315094  8066 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.347107  8015 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.350066  7991 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.319654  7982 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.351500  7703 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.379305  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.380571  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:42.381395  4990 raft_consensus.cc:2410] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:21:42.379850  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39902 (request call id 42) took 2221 ms. Trace:
I20260709 12:21:42.382818  4407 rpcz_store.cc:276] 0709 12:21:40.155340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.161801 (+  6461us) service_pool.cc:224] Handling call
0709 12:21:42.376978 (+2215177us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002445d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d78853 00007fdbb5d4660a 00007fdbaf2cc7d4 00007fdbaf2cc762 00007fdbaf2cc691 00007fdbaf2cc60c 00007fdbaf2cb8c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.377096 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463092608}
I20260709 12:21:42.353662  7969 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:21:42.349915  7698 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:21:42.389204  4407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5f00fff96847178a1970711feff2f0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:21:42.389786  4407 raft_consensus.cc:606] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:42.390081  4407 raft_consensus.cc:614] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:42.389225  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2575) took 1774 ms. Trace:
I20260709 12:21:42.392390  4331 rpcz_store.cc:276] 0709 12:21:40.614840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.615370 (+   530us) service_pool.cc:224] Handling call
0709 12:21:40.615613 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.300944 (+685331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.388952 (+1088008us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540013c754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:42.389154 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325294464}
I20260709 12:21:42.336099  8093 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.396575  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.399886  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.409464  4955 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.411793  7978 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:42.412420  7978 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.413627  7978 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.416553  7982 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:42.386775  7703 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.418870  7703 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.421260  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2548) took 1564 ms. Trace:
I20260709 12:21:42.421648  4408 rpcz_store.cc:276] 0709 12:21:40.857138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.448147 (+591009us) service_pool.cc:224] Handling call
0709 12:21:41.454149 (+  6002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.481095 (+ 26946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.481144 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.481203 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:41.481256 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.421024 (+939768us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:42.421065 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.421201 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61362560}
I20260709 12:21:42.422887  8099 consensus_queue.cc:1059] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:42.424182  8099 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.424139  8098 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:42.398072  7973 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.410950  8063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.010s	sys 0.011s
W20260709 12:21:42.425127  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 88701.9us
I20260709 12:21:42.427917  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:42.429358  8093 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.429857  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:42.430702  7964 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.427945  7994 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.437182  7997 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:42.437753  7997 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:42.438660  7997 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:42.439705  4253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1938) took 1828 ms (client timeout 2031 ms). Trace:
I20260709 12:21:42.439977  7997 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:42.440122  4253 rpcz_store.cc:269] 0709 12:21:40.611385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.612317 (+   932us) service_pool.cc:224] Handling call
0709 12:21:42.439504 (+1827187us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400259c54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.439647 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737208192}
I20260709 12:21:42.443310  4257 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:42.443847  7943 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:42.444872  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.445079  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 745) took 1701 ms. Trace:
I20260709 12:21:42.445787  4986 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.446136  4986 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.446331  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2582) took 1594 ms. Trace:
I20260709 12:21:42.446890  4986 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:42.447507  4984 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 1092) took 1758 ms (client timeout 1718 ms). Trace:
I20260709 12:21:42.447865  4986 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.443360  7973 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:42.447873  4984 rpcz_store.cc:269] 0709 12:21:40.688959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.689131 (+   172us) service_pool.cc:224] Handling call
0709 12:21:42.447319 (+1758188us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54006018d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.447436 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730585344}
I20260709 12:21:42.446677  4326 rpcz_store.cc:276] 0709 12:21:40.851599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.851739 (+   140us) service_pool.cc:224] Handling call
0709 12:21:40.851995 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.463168 (+611173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.463219 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:41.463284 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:41.463353 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.446124 (+982771us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540013d154. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:42.446164 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.446280 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404973312}
I20260709 12:21:42.453989  8028 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:42.456139  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.445437  4257 rpcz_store.cc:276] 0709 12:21:40.744116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.744222 (+   106us) service_pool.cc:224] Handling call
0709 12:21:42.443082 (+1698860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.444243 (+  1161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.444899 (+   656us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400259c50. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.445027 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3847100160}
I20260709 12:21:42.405508  8052 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:42.454365  8028 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.424638  8099 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.455844  7973 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.466457  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:42.467702  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:42.455761  8063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.010s	sys 0.012s
I20260709 12:21:42.476504  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.493870  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.495823  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:42.461797  8052 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.518422  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.518071  8093 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:42.524936  8099 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.515654  8098 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:42.515348  7943 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.528046  7943 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:42.528599  7943 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.522814  8052 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:42.526974  8061 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.950s	user 0.000s	sys 0.006s
I20260709 12:21:42.461135  7657 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:21:42.479156  8092 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:42.539090  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 167679us
W20260709 12:21:42.539448  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 43728.8us
I20260709 12:21:42.548931  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.552590  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.553174  4408 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:42.555120  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:42.555136  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.556161  4405 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:42.558638  4402 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:42.558271  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.534515  8023 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:21:42.557736  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.545902  8098 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:42.561379  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.577330  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.581146  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.561735  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:42.551441  8064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.009s	sys 0.019s
I20260709 12:21:42.586747  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.584916  4253 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
W20260709 12:21:42.590930  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.591045  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:42.591692  4252 raft_consensus.cc:2376] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12. Re-sending same reply.
I20260709 12:21:42.592842  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.593793  4253 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.596025  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 737) took 1834 ms. Trace:
I20260709 12:21:42.596386  4401 rpcz_store.cc:276] 0709 12:21:40.761688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.769318 (+  7630us) service_pool.cc:224] Handling call
0709 12:21:40.769657 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:40.785230 (+ 15573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:40.785274 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:40.801532 (+ 16258us) log.cc:844] Serialized 52 byte log entry
0709 12:21:41.303246 (+501714us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:41.362639 (+ 59393us) log.cc:844] Serialized 14 byte log entry
0709 12:21:41.362940 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:41.363038 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:41.873882 (+510844us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b1800275f20. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:42.462730 (+588848us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:42.595821 (+133091us) raft_consensus.cc:1685] finished
0709 12:21:42.595846 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.595971 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20393,"prepare.queue_time_us":60759,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2105,"raft.queue_time_us":32064,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8273,"spinlock_wait_cycles":54977664,"thread_start_us":449362,"threads_started":1,"wal-append.queue_time_us":663340}
I20260709 12:21:42.567860  8050 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.584177  7703 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.601024  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.583369  7657 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.557853  8099 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.606942  4405 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:21:42.583563  8098 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.591800  7517 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:21:42.603610  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.604370  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:42.610792  4986 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:42.538820  8028 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.595187  7898 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:21:42.592864  8074 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:21:42.588379  7967 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.588078  8073 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:21:42.588881  8064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.012s	sys 0.019s
I20260709 12:21:42.617447  4257 raft_consensus.cc:2376] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9. Re-sending same reply.
I20260709 12:21:42.620076  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:42.650439  4254 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.621927  4253 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.626663  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.606297  7703 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.633244  8065 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:42.633409  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 1.01608e+06us
I20260709 12:21:42.633723  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 918) took 1445 ms. Trace:
I20260709 12:21:42.656747  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:42.656454  7703 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.657903  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.628676  7967 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.608330  8050 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.659508  8079 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:42.649960  8064 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:42.660065  8079 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:42.660815  8064 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.661445  8017 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:42.661549  7985 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:21:42.637352  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.662998  7859 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:42.663141  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.663407  7859 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:42.664350  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.664280  7859 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.664978  4252 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:42.664850  7943 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.665518  7859 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.665998  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.666592  4249 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:42.606491  8066 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.617846  8098 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.638019  8025 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.638146  7994 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9.
W20260709 12:21:42.639941  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.640216  8090 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.643890  4372 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:42.642501  8073 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:42.676610  4372 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:42.644851  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.629273  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.656091  4402 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:42.655239  8030 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:21:42.637653  7973 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:21:42.668138  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.668818  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:42.656497  4329 rpcz_store.cc:276] 0709 12:21:41.188366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.190365 (+  1999us) service_pool.cc:224] Handling call
0709 12:21:41.212039 (+ 21674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.212259 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:41.455141 (+242882us) log.cc:844] Serialized 14 byte log entry
0709 12:21:42.633346 (+1178205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:42.633396 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:42.633449 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.633511 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.633651 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1033878,"prepare.queue_time_us":94279,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1034364,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":343188,"threads_started":2,"wal-append.queue_time_us":249995}
I20260709 12:21:42.641613  8028 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.667264  8056 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.672456  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:42.659534  7967 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.683570  4254 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
W20260709 12:21:42.684229  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55097.5us
I20260709 12:21:42.690896  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.686506  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.667243  7943 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.687147  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.688127  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.688413  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:42.688586  4372 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:42.695163  4331 raft_consensus.cc:2393] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:42.674911  4252 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.689489  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:42.690241  4296 connection.cc:256] RPC call timeout handler was delayed by -2.6562651369995365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 12:21:42.685422  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.691624  4256 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.686669  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:42.696492  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.696836  4332 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:42.688127  8017 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.698302  4330 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:42.698700  4330 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:42.698583  8017 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.699570  4330 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.700356  7740 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.700476  4330 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:42.700791  8017 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.651834  7970 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:42.688789  8056 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:42.702054  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 743) took 1930 ms. Trace:
I20260709 12:21:42.687398  7972 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:42.674804  8065 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:42.703913  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 751) took 1934 ms. Trace:
I20260709 12:21:42.702438  4400 rpcz_store.cc:276] 0709 12:21:40.771255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.846875 (+ 75620us) service_pool.cc:224] Handling call
0709 12:21:42.225518 (+1378643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:42.226136 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.701886 (+475750us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54003c73d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:42.702000 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3169950464}
I20260709 12:21:42.704280  4248 rpcz_store.cc:276] 0709 12:21:40.769366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:40.788964 (+ 19598us) service_pool.cc:224] Handling call
0709 12:21:40.789227 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:41.331669 (+542442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.703703 (+1372034us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54000de654. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:42.703856 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245286144}
I20260709 12:21:42.654197  8083 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:21:42.701529  8042 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.708984  4372 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.706740  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:42.709834  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.710215  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.687690  7985 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.681772  7973 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:42.708019  4257 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:42.707974  4326 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:42.681391  8090 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:42.722520  8086 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.588s	user 0.005s	sys 0.000s
I20260709 12:21:42.726914  7970 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:42.727371  7970 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:42.711812  8042 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.728206  7970 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.729388  8042 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.730856  8042 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.732726  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2272) took 1218 ms. Trace:
I20260709 12:21:42.692869  8002 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:42.733150  4333 rpcz_store.cc:276] 0709 12:21:41.514554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.146110 (+631556us) service_pool.cc:224] Handling call
0709 12:21:42.146846 (+   736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.639526 (+492680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.639578 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.640061 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.687234 (+ 47173us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:42.687271 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.687492 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.732535 (+ 45043us) raft_consensus.cc:1685] finished
0709 12:21:42.732555 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.732671 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492261,"raft.queue_time_us":493110,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":46810,"threads_started":1,"wal-append.queue_time_us":86864}
I20260709 12:21:42.712524  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.713019  4372 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:42.735558  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:42.736588  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.737499  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.738061  4331 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:42.738847  4331 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:42.692699  7962 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:42.694762  7957 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:42.739961  7962 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.740674  7957 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.742023  7962 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.742664  7957 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.717552  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.718389  4329 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:42.711176  7972 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.743749  4329 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:42.721387  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:42.721913  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.729590  7970 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.739686  8073 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.724684  8110 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:21:42.760057  8073 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.703286  8109 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:42.770900  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.704368  7928 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.772032  7928 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.746300  4372 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.688098  8015 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:42.745368  4332 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:42.772511  7928 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.780435  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.747459  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.711037  7985 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.747084  8055 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:42.748324  7973 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.700877  7740 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:42.682287  8025 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.744525  8002 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.751091  7703 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.751940  7939 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.754155  8065 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.800403  7740 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.721369  8023 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:42.758548  4330 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:21:42.774151  4372 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:42.802860  4330 pending_rounds.cc:85] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:42.780620  7988 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:42.782743  4326 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:42.805590  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.806214  4326 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:21:42.808696  8098 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.785426  7985 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.810819  4404 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:42.811945  8098 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:42.721729  7774 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.813385  7774 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:42.813798  7774 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.702656  8056 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.787474  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.785776  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1920) took 1967 ms. Trace:
I20260709 12:21:42.817242  4325 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:42.816226  4250 rpcz_store.cc:276] 0709 12:21:40.818689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:41.175559 (+356870us) service_pool.cc:224] Handling call
0709 12:21:41.209176 (+ 33617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:41.641651 (+432475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:41.660475 (+ 18824us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:41.766145 (+105670us) log.cc:844] Serialized 26 byte log entry
0709 12:21:42.141788 (+375643us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:42.141845 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:42.785377 (+643532us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400120554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:42.785431 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:42.785480 (+    49us) raft_consensus.cc:1685] finished
0709 12:21:42.785494 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:42.785712 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18712,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":19581,"spinlock_wait_cycles":617361792,"thread_start_us":456446,"threads_started":2,"wal-append.queue_time_us":351172}
I20260709 12:21:42.660836  8079 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.822492  7774 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.783475  8080 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.791531  4407 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:21:42.784796  8109 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:42.800063  7703 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:42.780653  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:42.848124  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.849867  4956 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:42.786405  7991 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:42.851513  7991 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:42.851682  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.784689  8050 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.852416  8028 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:42.852909  8028 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:42.853330  8028 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.854213  8025 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.854902  4334 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:42.851246  4956 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:42.856338  7982 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:42.803592  8002 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.856765  7982 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:42.857276  7982 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:42.859061  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.860921  4401 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.861548  7928 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:42.862733  8099 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:42.863659  8099 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:42.865688  7982 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:42.866907  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.868220  7982 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:42.786712  8055 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:42.801283  8015 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.873908  8099 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:42.874249  8055 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.874439  8015 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.875221  8113 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:42.875656  8113 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.876899  8113 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.877796  8013 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.878522  8113 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:42.878393  8013 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.803158  4330 pending_rounds.cc:107] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:21:42.880551  4330 raft_consensus.cc:2889] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:42.815194  4326 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:21:42.693236  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:42.837275  8052 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.841882  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:42.846782  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:42.857302  7774 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:42.793320  4256 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:42.886407  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:42.886328  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 112231us
I20260709 12:21:42.892760  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.815965  8056 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.898388  7939 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:42.894759  8109 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:42.904709  8109 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.905112  8109 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.899158  8064 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:42.912106  8013 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.912922  7774 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:21:42.916400  4296 connection.cc:256] RPC call timeout handler was delayed by -2.6364651369995045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 12:21:42.916950  4296 connection.cc:256] RPC call timeout handler was delayed by -2.440265136999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 12:21:42.906500  8090 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:42.917254  4296 connection.cc:256] RPC call timeout handler was delayed by -2.4240651369996158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:21:42.917549  4296 connection.cc:256] RPC call timeout handler was delayed by -2.4231651369996143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 12:21:42.917853  4296 connection.cc:256] RPC call timeout handler was delayed by -2.3331651369994688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 12:21:42.918118  4296 connection.cc:256] RPC call timeout handler was delayed by -2.2665651369998159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 12:21:42.918399  4296 connection.cc:256] RPC call timeout handler was delayed by -2.2638651369998115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 12:21:42.918702  4296 connection.cc:256] RPC call timeout handler was delayed by -2.2611651369998071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:21:42.918967  4296 connection.cc:256] RPC call timeout handler was delayed by -1.9413551389998247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:21:42.919227  4296 connection.cc:256] RPC call timeout handler was delayed by -1.9413551389998247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:21:42.914013  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 219878us
W20260709 12:21:42.921064  4296 connection.cc:256] RPC call timeout handler was delayed by -1.9116551389997767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 12:21:42.923746  4296 connection.cc:256] RPC call timeout handler was delayed by -1.9116551389997767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 12:21:42.924312  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6803551389998574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
I20260709 12:21:42.920271  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:42.915670  8052 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.921753  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.895368  7973 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:42.926015  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:42.927227  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.927662  4330 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:42.925209  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5759551389996886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:21:42.928213  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5759551389996886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:21:42.929544  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1946651369999017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3289s for a response
I20260709 12:21:42.930050  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:42.931704  7932 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:42.929345  8073 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:42.892663  8042 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:21:42.940645  4330 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:42.930933  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:42.942180  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:42.948576  7985 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:21:42.951603  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.952167  4249 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:42.952765  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:42.961110  4988 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.962603  4989 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:42.963831  8028 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.964355  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.965070  8064 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:42.967175  4988 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:42.945540  8029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.015s	sys 0.030s
W20260709 12:21:42.969453  8029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.015s	sys 0.031s
I20260709 12:21:42.969714  8029 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:42.969921  4984 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:42.968943  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.970989  4988 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:21:42.970605  8029 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.941592  8090 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:42.975448  8028 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.976101  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:42.977563  7972 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:42.981346  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.983104  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.985185  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:42.990118  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59242.9us
I20260709 12:21:42.991660  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:42.996369  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:42.998380  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.998413  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.004137  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:42.994972  7939 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:43.005751  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:43.009640  8002 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:42.967239  7991 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.013307  7991 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:43.014171  8073 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:43.014611  8073 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.014936  8073 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:43.017740  7943 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:43.018321  7943 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:43.020874  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:42.993623  8027 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:43.033326  4331 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:43.045389  4987 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:43.043929  4371 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:42.999048  7932 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.057121  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:43.058300  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:43.062005  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.062781  4403 raft_consensus.cc:2368] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:43.062803  4400 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:43.063642  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.064218  4409 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:21:43.066277  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:43.066412  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.068214  4409 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:21:43.069759  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.071772  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.073441  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:43.075353  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.075508  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:43.076869  4989 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:21:43.078480  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.023265  8055 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.084143  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:43.045805  7939 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.085790  8055 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.092929  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:43.081617  8056 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:21:43.081866  8065 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.097044  7972 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:43.106833  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:43.097807  8055 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.078270  8027 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.107684  8002 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:43.021977  7943 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:43.161837  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55127us
I20260709 12:21:43.104077  8128 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:43.101109  8079 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:43.126565  8109 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.127918  8073 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.138550  4257 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:43.139513  4254 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:21:43.139540  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:43.143395  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.147541  4253 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:21:43.150851  8121 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:43.151330  4400 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:43.160054  4401 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:21:43.160151  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 139906us
I20260709 12:21:43.097282  7939 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.177361  4406 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:43.164063  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:43.163779  7957 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:43.172631  4250 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.174386  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.176355  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.173842  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.180297  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.180630  4253 raft_consensus.cc:2393] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:43.109285  7985 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:21:43.171689  8079 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:43.181773  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.181901  8079 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:43.182865  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.183946  7939 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:43.184141  4257 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:43.187389  8025 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:21:43.187932  8025 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:43.188344  8025 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:43.179144  4405 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:21:43.191359  8065 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:43.174796  8128 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:43.192715  7972 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:43.182005  7985 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.193181  4250 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:43.193504  7985 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:43.194329  7985 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.195662  7985 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.179909  7957 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:43.196384  7957 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.198088  8040 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:43.192873  8128 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.195593  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.203071  4407 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: [11.13-11.13]
I20260709 12:21:43.203267  4986 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:43.195654  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:43.169335  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:43.200498  4403 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:43.199774  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:43.193135  7972 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:43.199920  4329 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.208911  7963 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:43.208801  7740 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.277583  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:43.299796  4408 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:43.285051  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.300909  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.301783  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:43.302150  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:43.302348  4328 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:43.304127  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:43.306036  4988 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
W20260709 12:21:43.291630  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.293027  4329 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:43.310066  8122 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:21:43.311888  4402 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:43.312167  8123 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:21:43.311707  8025 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.308400  4330 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:43.383670  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:43.313030  7967 consensus_meta.cc:287] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.003s
I20260709 12:21:43.384124  8074 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:43.384394  8025 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:43.384467  7967 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.386816  7967 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:43.312983  8068 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.387480  8068 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:43.017201  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:43.388588  8068 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.389866  8068 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.391691  4255 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:43.371686  7970 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:21:43.387099  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:43.395017  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.395243  4332 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 4. Current term is 5. Ops: []
I20260709 12:21:43.209213  8099 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:43.318867  4331 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:43.320050  7859 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:43.322067  8027 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:43.322872  8126 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:21:43.324110  8073 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:43.324570  8109 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:43.328301  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.422374  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.423149  4256 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:43.424196  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.425541  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.426177  4256 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:43.329075  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.329504  4983 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:43.428181  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.429211  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.428181  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.429984  4991 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:43.430212  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.330273  4990 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:43.430747  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.294786  7963 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:43.330819  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.431725  7963 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:43.431926  4985 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:43.331470  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.335765  4328 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:21:43.432955  7978 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:43.431861  4990 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:43.342065  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 909) took 1018 ms. Trace:
I20260709 12:21:43.420488  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:43.347985  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.348390  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:43.436507  4329 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:43.350500  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:43.437218  4325 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:43.336730  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:43.353622  7928 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:43.353423  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.354264  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.435472  4987 rpcz_store.cc:276] 0709 12:21:42.323670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.323859 (+   189us) service_pool.cc:224] Handling call
0709 12:21:42.337443 (+ 13584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.055696 (+718253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.341710 (+286014us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400498254. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:43.341964 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627668736}
I20260709 12:21:43.355473  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:43.358712  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.444178  4333 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.444260  4250 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:43.359905  4257 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:43.359946  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.360400  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:43.360623  7898 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.365042  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:43.446184  4248 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.365881  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.366133  4408 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:43.366310  7997 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:43.366485  8055 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.373407  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 762) took 1007 ms. Trace:
I20260709 12:21:43.458684  4404 rpcz_store.cc:276] 0709 12:21:42.366243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.366459 (+   216us) service_pool.cc:224] Handling call
0709 12:21:42.378128 (+ 11669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.811193 (+433065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.373143 (+561950us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54002346d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:43.373347 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994568448}
I20260709 12:21:43.373988  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:43.460291  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 86377us
I20260709 12:21:43.454151  4372 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:43.286947  4956 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:43.378518  4403 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:43.401623  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:43.394358  4247 raft_consensus.cc:2376] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7. Re-sending same reply.
W20260709 12:21:43.461977  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 175112us
I20260709 12:21:43.405448  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:43.462833  4255 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:43.406505  4332 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.463639  4332 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:43.464499  4332 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.465206  8025 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.465395  4332 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.465624  8025 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:43.466408  8025 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.469792  8025 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.471788  4402 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 9. Ops: []
I20260709 12:21:43.471947  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.473848  4329 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.474211  4329 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:43.475524  8040 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:43.475749  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 115420us
I20260709 12:21:43.476471  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:43.477555  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:43.478237  8040 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.478830  7740 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.478956  8040 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:43.455552  8027 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:43.479650  8027 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:43.479785  8057 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:43.430759  4983 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.481026  8027 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.482257  8027 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.407080  8099 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:43.449999  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.451553  4406 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:43.455117  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.456387  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:43.493192  4334 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:43.371205  7972 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.449043  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:43.494706  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:43.479655  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:43.496573  4407 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:43.488054  4983 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:43.474931  4329 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.501948  4329 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.491415  4405 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } }
I20260709 12:21:43.512347  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:43.460342  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:43.517959  4401 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:43.518921  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 58691.5us
W20260709 12:21:43.525439  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.474853  7970 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:21:43.466823  7957 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.492066  8093 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:43.491680  7898 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:43.529273  8012 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:43.538425  8083 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:21:43.540568  8029 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:43.541271  8015 consensus_queue.cc:1059] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:21:43.542145  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 47532.1us
I20260709 12:21:43.539067  8109 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.543919  4248 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
W20260709 12:21:43.543551  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 89503.6us
I20260709 12:21:43.546578  4407 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:43.553140  4956 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:43.543537  4333 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
W20260709 12:21:43.563391  4149 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 386) took 13777 ms (client timeout 15000 ms). Trace:
I20260709 12:21:43.535418  8002 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:43.565670  4328 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:43.582870  4334 raft_consensus.cc:2468] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:43.572851  7898 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:43.576408  8092 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:43.591276  8092 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:43.552098  8091 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:43.586833  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 64423us
I20260709 12:21:43.579834  8015 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:43.599201  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:43.568440  4256 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:43.599776  4329 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:21:43.535257  8074 consensus_queue.cc:1059] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:21:43.580925  7939 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:43.617391  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:43.626153  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.616640  4328 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:21:43.618593  4334 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:43.618857  4329 pending_rounds.cc:85] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 3
I20260709 12:21:43.627278  4329 pending_rounds.cc:107] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:21:43.627825  4329 raft_consensus.cc:2889] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:43.564792  4149 rpcz_store.cc:269] 0709 12:21:29.742067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:29.742283 (+   216us) service_pool.cc:224] Handling call
0709 12:21:43.519485 (+13777202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:41.291770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:41.292395 (+   625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:41.292453 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:21:41.292472 (+    19us) tablet.cc:662] Decoding operations
0709 12:21:41.294193 (+  1721us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:41.294274 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:41.294305 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:21:41.300135 (+  5830us) tablet.cc:701] Row locks acquired
0709 12:21:41.366024 (+ 65889us) write_op.cc:260] PREPARE: finished
0709 12:21:41.395915 (+ 29891us) write_op.cc:270] Start()
0709 12:21:41.449545 (+ 53630us) write_op.cc:276] Timestamp: P: 1783599701383068 usec, L: 0
0709 12:21:41.454639 (+  5094us) op_driver.cc:348] REPLICATION: starting
0709 12:21:41.576356 (+121717us) log.cc:844] Serialized 7469 byte log entry
0709 12:21:42.225285 (+648929us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbadc740ac 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b
0709 12:21:42.546232 (+320947us) op_driver.cc:464] REPLICATION: finished
0709 12:21:42.716427 (+170195us) write_op.cc:301] APPLY: starting
0709 12:21:42.716504 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:42.719609 (+  3105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:42.719632 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:42.747431 (+ 27799us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:42.747726 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=38
0709 12:21:42.747782 (+    56us) write_op.cc:312] APPLY: finished
0709 12:21:42.748169 (+   387us) log.cc:844] Serialized 132 byte log entry
0709 12:21:42.748344 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:42.748525 (+   181us) write_op.cc:454] Released schema lock
0709 12:21:42.748580 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:42.761346 (+ 12766us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:42.761375 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":702059,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":147300,"apply.run_cpu_time_us":5490,"apply.run_wall_time_us":44863,"num_ops":19,"prepare.queue_time_us":156941,"prepare.run_cpu_time_us":29453,"prepare.run_wall_time_us":1223213,"raft.queue_time_us":187663,"raft.run_cpu_time_us":13945,"raft.run_wall_time_us":135507,"replication_time_us":1081860,"spinlock_wait_cycles":37605632,"thread_start_us":1108680,"threads_started":4,"wal-append.queue_time_us":746045}]]}
I20260709 12:21:43.619366  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:43.603804  4372 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:43.624264  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 71201.4us
I20260709 12:21:43.591190  8029 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.632797  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:43.637002  4332 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:44.496255  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 950) took 1193 ms. Trace:
W20260709 12:21:44.123649  4249 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.025s
W20260709 12:21:45.165783  4249 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.653s	user 0.009s	sys 0.034s
W20260709 12:21:44.099020  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.010s	sys 0.018s
W20260709 12:21:44.151959  4325 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.007s	sys 0.027s
W20260709 12:21:45.250423  4325 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.759s	user 0.008s	sys 0.028s
I20260709 12:21:44.233129  4329 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:45.253764  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2294) took 1794 ms. Trace:
I20260709 12:21:45.254158  4329 rpcz_store.cc:276] 0709 12:21:43.458912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.232221 (+773309us) service_pool.cc:224] Handling call
0709 12:21:44.232814 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.253475 (+1020661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.253705 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:44.280226  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:43.630887  4153 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 6 to 7, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.178517  4141 maintenance_manager.cc:643] P a6ff35c4ac1544009dec2b8d57867ced: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.752s	user 0.144s	sys 0.056s Metrics: {"bytes_written":29907,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1063,"dirs.run_cpu_time_us":439,"dirs.run_wall_time_us":1198,"drs_written":1,"lbm_read_time_us":429,"lbm_reads_lt_1ms":4,"lbm_write_time_us":111488,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":1146,"threads_started":2,"update_count":19,"wal-append.queue_time_us":846}
W20260709 12:21:44.416261  4220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.013s	sys 0.019s
W20260709 12:21:45.450102  4220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.922s	user 0.016s	sys 0.019s
I20260709 12:21:45.174156  4249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1945) took 1803 ms. Trace:
W20260709 12:21:44.291139  4253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.026s	sys 0.016s
I20260709 12:21:45.454420  4249 rpcz_store.cc:276] 0709 12:21:43.370299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.483532 (+113233us) service_pool.cc:224] Handling call
0709 12:21:43.483819 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.484002 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:45.166195 (+1682193us) log.cc:844] Serialized 14 byte log entry
0709 12:21:45.173765 (+  7570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.173818 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:45.173880 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.173948 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.174093 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":380931,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":2167,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":1660246,"threads_started":2,"wal-append.queue_time_us":7605}
W20260709 12:21:45.455874  4253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.967s	user 0.034s	sys 0.016s
I20260709 12:21:45.187697  8170 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.189067  8171 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.456346  8145 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.456728  8170 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:45.456889  8145 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.456823  8171 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.458976  8145 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.459173  8040 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:45.458977  8170 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:45.460242  8145 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.102169  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.256719  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2287) took 1911 ms. Trace:
I20260709 12:21:45.467542  4325 rpcz_store.cc:276] 0709 12:21:43.345835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.437885 (+ 92050us) service_pool.cc:224] Handling call
0709 12:21:43.438228 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.438476 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:21:45.250858 (+1812382us) log.cc:844] Serialized 14 byte log entry
0709 12:21:45.256348 (+  5490us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.256402 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:45.256476 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.256548 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.256663 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":516001,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":961,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":1764555,"threads_started":3,"wal-append.queue_time_us":887}
I20260709 12:21:43.649242  4328 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:45.470881  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2605) took 2101 ms. Trace:
I20260709 12:21:44.532975  4332 rpcz_store.cc:276] 0709 12:21:43.302795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.396130 (+ 93335us) service_pool.cc:224] Handling call
0709 12:21:43.406346 (+ 10216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:44.495938 (+1089592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:44.496188 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:21:45.130441  4334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.011s	sys 0.003s
W20260709 12:21:45.473595  4334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.012s	sys 0.004s
I20260709 12:21:45.474587  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2614) took 1838 ms. Trace:
W20260709 12:21:45.143654  4331 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.605s	user 0.009s	sys 0.011s
W20260709 12:21:44.418330  4333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.000s	sys 0.008s
W20260709 12:21:44.138485  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 505734us
I20260709 12:21:45.487432  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:43.649641  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45926us
I20260709 12:21:45.488816  4372 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:44.307286  4401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.006s	sys 0.005s
I20260709 12:21:44.423539  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2578) took 1216 ms. Trace:
W20260709 12:21:44.265532  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.111385  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 480780us
W20260709 12:21:44.411082  4957 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.006s	sys 0.004s
W20260709 12:21:45.495559  4957 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.868s	user 0.009s	sys 0.004s
W20260709 12:21:44.156390  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:44.162133  4984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.009s	sys 0.016s
W20260709 12:21:45.169368  5013 debug-util.cc:398] Leaking SignalData structure 0x7b080035f3a0 after lost signal to thread 3105
W20260709 12:21:45.500506  5013 debug-util.cc:398] Leaking SignalData structure 0x7b0800351ea0 after lost signal to thread 4187
I20260709 12:21:43.672006  7928 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:21:45.503443  7928 consensus_queue.cc:1243] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:21:45.179675  7943 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.506388  7943 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.770728  7963 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:43.851965  7774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.002s	sys 0.021s
I20260709 12:21:44.554265  7973 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.509929  7963 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.510027  7973 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:45.511404  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9340 after lost signal to thread 4281
I20260709 12:21:45.512178  7973 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:43.628301  7517 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.730233  7859 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:45.527108  7517 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:44.072379  7972 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:43.628190  7939 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.650153  7951 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:43.758839  7957 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:44.014900  8002 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:43.938263  8012 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:45.565260  8012 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.566287  8180 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:43.617148  8015 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:43.638188  8023 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:43.730826  8029 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:44.036079  8090 raft_consensus.cc:3055] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:45.574185  8090 raft_consensus.cc:740] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:44.112093  8091 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:21:43.832958  8128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.001s	sys 0.027s
W20260709 12:21:45.577986  8128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.266s	user 0.001s	sys 0.028s
I20260709 12:21:43.756691  8129 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:44.312251  8139 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.307s	user 0.003s	sys 0.000s
I20260709 12:21:44.183992  8142 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.595993  8142 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.761636  8055 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:43.591480  8057 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:21:45.602763  8057 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:44.141310  8073 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:43.644042  8079 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.642503  8092 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.614912  8079 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.615456  8092 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:43.594440  8093 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:43.594561  8099 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:43.565212  8109 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:43.994128  8132 log.cc:927] Time spent T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:21:43.671020  8113 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.622790  8188 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.634212  8113 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.634994  8188 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.635820  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2285) took 2702 ms. Trace:
I20260709 12:21:43.602974  8127 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:21:44.269925  8146 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.640393  8146 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:44.141150  8150 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.644459  8150 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:44.144042  8156 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.648489  8156 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:44.198246  8158 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.652355  8158 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:44.435658  8160 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:45.658905  8160 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.662009  8160 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.103879  8162 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:45.664847  8162 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.116024  8163 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.668488  8163 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.123484  8165 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.676664  8165 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:45.679929  4406 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:45.128552  8166 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:45.682991  8166 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:45.683480  8166 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:45.684549  8166 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.686196  8166 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:45.159166  8167 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.688445  8167 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.167551  8168 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:45.083719  8161 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:45.692610  8168 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.693292  8161 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.695585  8161 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.140257  8164 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:45.404914  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.697028  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.696923  8164 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:45.425034  4218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.842s	user 0.024s	sys 0.031s
W20260709 12:21:45.698588  4218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.171s	user 0.025s	sys 0.032s
W20260709 12:21:45.698923  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 2.17953e+06us
I20260709 12:21:45.699014  8164 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:45.699453  8079 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.699976  8079 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.700511  8165 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.701850  8079 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.636397  4326 rpcz_store.cc:276] 0709 12:21:42.933463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:42.934633 (+  1170us) service_pool.cc:224] Handling call
0709 12:21:42.934991 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:42.938063 (+  3072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:42.938097 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:42.938586 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:21:43.293732 (+355146us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b1800443020. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:43.548269 (+254537us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:43.548324 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.548411 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.635399 (+2086988us) raft_consensus.cc:1685] finished
0709 12:21:45.635440 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.635725 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2895,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3795,"spinlock_wait_cycles":20886272,"thread_start_us":254320,"threads_started":1,"wal-append.queue_time_us":904589}
I20260709 12:21:45.449031  4142 maintenance_manager.cc:419] P a6ff35c4ac1544009dec2b8d57867ced: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10540 bytes on disk
I20260709 12:21:45.449544  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:45.247376  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.894s	user 0.010s	sys 0.021s
I20260709 12:21:45.707022  8162 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:44.350492  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.446375  4153 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.710158  4153 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.710943  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:45.461011  8145 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.711575  8012 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:45.712791  7963 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:45.713325  7967 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:21:45.466468  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.715417  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.702363  8079 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.716972  8079 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.471242  4328 rpcz_store.cc:276] 0709 12:21:43.369596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.648647 (+279051us) service_pool.cc:224] Handling call
0709 12:21:43.649028 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.470596 (+1821568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.470821 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:45.717983  8145 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.718654  7972 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.719075  8079 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.719141  7972 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.719751  8079 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.721208  8165 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:45.721865  7972 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.475029  4334 rpcz_store.cc:276] 0709 12:21:43.636302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.284426 (+648124us) service_pool.cc:224] Handling call
0709 12:21:44.284787 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:44.285473 (+   686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:44.285501 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:44.286225 (+   724us) log.cc:844] Serialized 26 byte log entry
0709 12:21:45.474135 (+1187910us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:45.474194 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.474287 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.474347 (+    60us) raft_consensus.cc:1685] finished
0709 12:21:45.474365 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.474520 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":204,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":64,"thread_start_us":1187434,"threads_started":1,"wal-append.queue_time_us":16776,"wal-append.run_cpu_time_us":13584,"wal-append.run_wall_time_us":1108594}
W20260709 12:21:45.483525  4331 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.950s	user 0.011s	sys 0.011s
W20260709 12:21:45.483531  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080015a740 after lost signal to thread 3105
W20260709 12:21:45.512650  4333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.870s	user 0.002s	sys 0.009s
I20260709 12:21:45.490619  4405 rpcz_store.cc:276] 0709 12:21:43.207492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.207624 (+   132us) service_pool.cc:224] Handling call
0709 12:21:43.276479 (+ 68855us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:43.288041 (+ 11562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.288071 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:43.292252 (+  4181us) log.cc:844] Serialized 518 byte log entry
0709 12:21:43.491283 (+199031us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:43.564632 (+ 73349us) log.cc:844] Serialized 14 byte log entry
0709 12:21:43.564927 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:43.564996 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:44.423261 (+858265us) raft_consensus.cc:1685] finished
0709 12:21:44.423281 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:44.423461 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17518,"raft.queue_time_us":7621,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":23145,"thread_start_us":198679,"threads_started":1,"wal-append.queue_time_us":545592,"wal-append.run_cpu_time_us":5355,"wal-append.run_wall_time_us":1002870}
I20260709 12:21:45.722637  8173 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.725185  8168 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.725499  7963 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.725052  8173 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.725972  7963 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:45.516022  4401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.973s	user 0.008s	sys 0.005s
I20260709 12:21:45.728017  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 781) took 2187 ms. Trace:
I20260709 12:21:45.728211  7963 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.728369  4401 rpcz_store.cc:276] 0709 12:21:43.541042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.541218 (+   176us) service_pool.cc:224] Handling call
0709 12:21:43.541525 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.541846 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.541874 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.542328 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:21:45.727670 (+2185342us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.727728 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.727805 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.727845 (+    40us) raft_consensus.cc:1685] finished
0709 12:21:45.727856 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.727962 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":888,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7922,"thread_start_us":2184988,"threads_started":1,"wal-append.queue_time_us":464226,"wal-append.run_cpu_time_us":2187,"wal-append.run_wall_time_us":1005645}
W20260709 12:21:45.520217  4984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.191s	user 0.011s	sys 0.017s
I20260709 12:21:45.730479  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1116) took 2402 ms. Trace:
I20260709 12:21:45.519505  7928 raft_consensus.cc:2804] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:45.655182  8158 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:45.731742  7928 raft_consensus.cc:697] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:45.720203  8079 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.651197  8156 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:45.643225  8146 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.630924  8109 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:45.732754  7928 consensus_queue.cc:237] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.733544  8150 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.734328  8167 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.735108  8163 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.521365  8177 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.736196  8177 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.734661  7963 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.737483  7963 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.738533  8177 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.739560  7963 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:45.520601  7774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.364s	user 0.003s	sys 0.022s
I20260709 12:21:45.525482  7943 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.522270  4956 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:45.743649  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 221444us
I20260709 12:21:45.527746  7517 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.748214  8099 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:45.748878  8099 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:45.749238  7517 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:45.750464  7517 consensus_queue.cc:1059] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:45.750065  8099 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.516304  8170 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:45.751332  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2291) took 2404 ms. Trace:
I20260709 12:21:45.751720  4331 rpcz_store.cc:276] 0709 12:21:43.347083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.463435 (+116352us) service_pool.cc:224] Handling call
0709 12:21:43.463726 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:43.463930 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:45.722969 (+2259039us) log.cc:844] Serialized 14 byte log entry
0709 12:21:45.750954 (+ 27985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.751005 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:45.751066 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.751145 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.751258 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27188,"prepare.queue_time_us":500692,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":2216601,"threads_started":2,"wal-append.queue_time_us":26727}
I20260709 12:21:45.752841  8187 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:45.753226  8187 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:45.754005  8187 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.516036  7973 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:45.548548  8181 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:45.755134  7973 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.757208  7973 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.541980  8175 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.527666  7859 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.757915  8175 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.548926  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:45.549772  7939 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:45.759512  7859 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:45.759922  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 211065us
I20260709 12:21:45.760035  7859 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.760392  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2292) took 2308 ms. Trace:
I20260709 12:21:45.542600  8176 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:21:45.551088  4330 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.760780  4327 rpcz_store.cc:276] 0709 12:21:43.452164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:44.035698 (+583534us) service_pool.cc:224] Handling call
0709 12:21:44.035987 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.759536 (+1723549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:45.759565 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:45.759603 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:45.759644 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.760184 (+   540us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54003d3954. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:45.760224 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.760337 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3963382016}
I20260709 12:21:45.762143  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:45.557124  4955 connection.cc:256] RPC call timeout handler was delayed by -1.0667187879998892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 12:21:45.762897  4334 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:45.553233  8178 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.763593  8178 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.764415  8090 consensus_queue.cc:260] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:45.550622  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61886.4us
I20260709 12:21:45.711668  4153 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 4 to 7, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.572933  8023 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:45.575371  8029 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.583597  4409 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:45.771437  8173 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.772796  4409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 1785) took 2685 ms. Trace:
I20260709 12:21:45.773242  4409 rpcz_store.cc:276] 0709 12:21:43.087796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.088016 (+   220us) service_pool.cc:224] Handling call
0709 12:21:43.101431 (+ 13415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:45.771839 (+2670408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.772490 (+   651us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b5400375fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:45.772718 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5708013312}
I20260709 12:21:45.588119  7951 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:45.589056  8182 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.599213  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1944) took 2229 ms. Trace:
I20260709 12:21:45.601150  8091 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.603242  8057 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:45.604286  8073 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:45.606685  8186 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.607273  8142 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.608708  8042 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.613076  8183 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:45.622656  8093 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.637349  8188 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.663607  8179 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:45.704595  8113 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:45.707183  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.803592  8090 raft_consensus.cc:3060] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:45.704638  4141 maintenance_manager.cc:643] P a6ff35c4ac1544009dec2b8d57867ced: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":322,"lbm_reads_lt_1ms":4}
W20260709 12:21:45.514358  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08001196c0 after lost signal to thread 4358
W20260709 12:21:45.832649  5013 debug-util.cc:398] Leaking SignalData structure 0x7b080031f280 after lost signal to thread 4359
W20260709 12:21:45.833916  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc160 after lost signal to thread 4433
I20260709 12:21:45.733670  8079 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.723615  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2600) took 2355 ms. Trace:
I20260709 12:21:45.571187  8015 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.566874  8180 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.765640  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:45.723960  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080014d960 after lost signal to thread 4187
W20260709 12:21:45.842703  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08001403a0 after lost signal to thread 4281
W20260709 12:21:45.843842  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080010d360 after lost signal to thread 4358
W20260709 12:21:45.844213  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08001be480 after lost signal to thread 4359
W20260709 12:21:45.845243  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080039b8a0 after lost signal to thread 4433
I20260709 12:21:45.730813  4984 rpcz_store.cc:276] 0709 12:21:43.327959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.328068 (+   109us) service_pool.cc:224] Handling call
0709 12:21:43.328394 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.328622 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.328646 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.329048 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 12:21:45.730128 (+2401080us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.730166 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.730239 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.730278 (+    39us) raft_consensus.cc:1685] finished
0709 12:21:45.730289 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.730392 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2400702,"threads_started":1,"wal-append.queue_time_us":630390,"wal-append.run_cpu_time_us":3565,"wal-append.run_wall_time_us":1046219}
I20260709 12:21:45.770687  4330 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:45.760579  7859 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:45.766065  8170 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:45.776201  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:45.852634  4256 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.776252  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:45.827569  8150 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.860306  4256 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:45.783020  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.861626  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.862408  4331 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:45.783756  4153 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 4 to 6, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:45.864068  4153 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 9 to 10, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.784665  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.866487  4332 raft_consensus.cc:2410] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:45.786721  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.788861  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.868337  4252 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:45.869169  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.869733  4252 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:45.789505  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.796535  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.870963  4329 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:45.798485  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.796761  4253 rpcz_store.cc:276] 0709 12:21:43.370021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.487203 (+117182us) service_pool.cc:224] Handling call
0709 12:21:43.487586 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.487850 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.487888 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.488463 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 12:21:44.311652 (+823189us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:45.456263 (+1144611us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:45.456306 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.456388 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.598808 (+142420us) raft_consensus.cc:1685] finished
0709 12:21:45.598837 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.599099 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569536,"thread_start_us":1967455,"threads_started":1,"wal-append.queue_time_us":505807}
I20260709 12:21:45.810302  8191 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.722388  7972 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.814215  8189 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:45.817418  4983 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:21:45.881778  4983 pending_rounds.cc:85] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 7
I20260709 12:21:45.882004  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.883230  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:45.883862  4330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 2601) took 2506 ms (client timeout 2864 ms). Trace:
I20260709 12:21:45.884044  4252 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
W20260709 12:21:45.884306  4330 rpcz_store.cc:269] 0709 12:21:43.368862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.383433 (+ 14571us) service_pool.cc:224] Handling call
0709 12:21:45.875609 (+2492176us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54001d60d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:45.875727 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4983268224}
I20260709 12:21:45.819816  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.820299  4986 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:45.820461  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:45.823578  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.825465  4987 pending_rounds.cc:85] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 5
I20260709 12:21:45.886428  4250 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:45.886601  4987 pending_rounds.cc:107] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:45.821152  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:45.828104  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.888082  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.890627  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:45.459241  8171 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:45.827280  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.891945  4990 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:45.829773  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.892580  4992 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:45.830291  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:45.831568  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 66563us
I20260709 12:21:45.795758  7967 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.835811  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:45.824657  8174 consensus_queue.cc:1059] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:21:45.837196  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.837013  4333 rpcz_store.cc:276] 0709 12:21:43.368628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.581162 (+212534us) service_pool.cc:224] Handling call
0709 12:21:43.603248 (+ 22086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:43.623396 (+ 20148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:43.623455 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:43.631355 (+  7900us) log.cc:844] Serialized 26 byte log entry
0709 12:21:45.723278 (+2091923us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:45.723337 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:45.723401 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:45.723436 (+    35us) raft_consensus.cc:1685] finished
0709 12:21:45.723449 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:45.723557 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9196,"thread_start_us":2080830,"threads_started":1,"wal-append.queue_time_us":352648,"wal-append.run_cpu_time_us":12037,"wal-append.run_wall_time_us":1185323}
I20260709 12:21:45.839406  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.813143  8091 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.914467  4985 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:45.811074  8182 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.841234  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:45.923535  4407 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:21:45.824532  8165 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:45.811257  7943 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:21:45.855717  4406 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:45.875975  8015 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:45.846338  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3720 after lost signal to thread 5016
W20260709 12:21:45.943840  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800401b00 after lost signal to thread 7517
W20260709 12:21:45.944201  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003da060 after lost signal to thread 7774
W20260709 12:21:45.944471  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080035c640 after lost signal to thread 7859
W20260709 12:21:45.944792  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003f52c0 after lost signal to thread 7928
W20260709 12:21:45.945096  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3fe0 after lost signal to thread 7939
W20260709 12:21:45.945402  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08002af9e0 after lost signal to thread 7951
W20260709 12:21:45.945678  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003eeb80 after lost signal to thread 7957
W20260709 12:21:45.945945  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003440c0 after lost signal to thread 7963
W20260709 12:21:45.946257  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800341460 after lost signal to thread 7972
W20260709 12:21:45.946580  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8380 after lost signal to thread 8002
W20260709 12:21:45.946856  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800397620 after lost signal to thread 8012
W20260709 12:21:45.947136  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080030b9c0 after lost signal to thread 8015
W20260709 12:21:45.947429  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7080 after lost signal to thread 8023
I20260709 12:21:45.776254  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:45.747160  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.872632  4248 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:45.863219  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.881461  4153 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:45.819936  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.886883  4987 raft_consensus.cc:2889] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.826244  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:45.949559  4401 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:21:45.950091  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.882050  4983 pending_rounds.cc:107] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 12:21:45.835208  5013 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5f80 after lost signal to thread 5016
I20260709 12:21:45.951711  4983 raft_consensus.cc:2889] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:45.826135  8042 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.841244  8178 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.904883  8173 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:45.973380  4153 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.976507  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.910336  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:45.812598  8187 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:45.915762  4247 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:45.911816  7972 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:45.917769  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:45.917465  8189 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.918262  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.918339  7957 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:21:45.919343  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.920763  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.993237  4333 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
W20260709 12:21:45.933758  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:45.994397  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:45.933562  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.995394  4329 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:45.935202  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:45.996665  4330 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:45.948493  4331 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
W20260709 12:21:45.965335  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800367ce0 after lost signal to thread 8029
W20260709 12:21:45.997594  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08000598a0 after lost signal to thread 8055
W20260709 12:21:45.997865  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080025f880 after lost signal to thread 8057
W20260709 12:21:45.998106  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1980 after lost signal to thread 8073
W20260709 12:21:45.998317  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2ba0 after lost signal to thread 8079
W20260709 12:21:45.998533  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800325a80 after lost signal to thread 8090
W20260709 12:21:45.998718  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0820 after lost signal to thread 8091
W20260709 12:21:45.998898  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003a18e0 after lost signal to thread 8092
W20260709 12:21:45.999083  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800383c80 after lost signal to thread 8093
W20260709 12:21:45.999269  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080027b920 after lost signal to thread 8099
W20260709 12:21:45.999533  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc980 after lost signal to thread 8109
W20260709 12:21:45.999758  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080039f5a0 after lost signal to thread 8113
W20260709 12:21:45.999998  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800361800 after lost signal to thread 8127
W20260709 12:21:46.000207  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08002854e0 after lost signal to thread 8128
W20260709 12:21:46.000422  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0f00 after lost signal to thread 8129
W20260709 12:21:46.000654  4355 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1460 after lost signal to thread 8132
I20260709 12:21:45.827500  8183 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.971267  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.001451  4983 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:45.992507  4332 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:45.973351  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:45.981920  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 71676.7us
I20260709 12:21:45.987493  4988 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:21:45.983335  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.990511  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:45.913697  8175 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:45.964524  7943 consensus_queue.cc:1243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:21:45.824730  8186 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.004686  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.006215  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.964775  8099 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.964605  8188 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.010937  4989 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:45.964389  8146 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.011819  4326 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:45.880995  8150 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.014557  4328 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:46.014828  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:45.974304  8173 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.858968  8023 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.017405  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.974049  8177 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.973907  8029 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:45.991123  8079 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:46.022657  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:45.922268  7967 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:45.986416  8176 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:46.030587  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:45.902878  7951 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.054052  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.054685  4333 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:46.015309  8092 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:45.900983  8191 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.002272  8178 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:21:45.964459  8165 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.028609  8173 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:46.057897  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:46.084347  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 166636us
I20260709 12:21:46.086066  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:46.086867  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.095368  4333 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:46.056201  7517 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:46.023340  8188 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.023478  8099 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:46.104321  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 178399us
I20260709 12:21:46.093528  7859 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.023904  8146 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.059037  8079 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:46.107285  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.040918  8177 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.117233  4333 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:46.052714  8029 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.119628  4153 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 6, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.124660  4986 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:21:46.094374  8073 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.093174  8057 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.093176  8165 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.122946  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:46.161149  4333 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.115763  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.106752  7517 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.124513  4983 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:46.110078  8092 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:46.164839  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.165594  4331 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:46.060146  8176 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:46.172752  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 57039.4us
I20260709 12:21:46.167816  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.177212  4331 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:46.179481  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.181030  4331 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:46.158595  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.182060  8209 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:46.182441  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.182629  8209 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:46.183071  4325 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:46.183959  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:46.168529  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 53475.1us
I20260709 12:21:46.184517  8091 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.186201  8191 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.125013  7859 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.186245  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.183638  8209 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.230886  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:46.187343  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.167793  7517 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.234150  4333 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
W20260709 12:21:46.225283  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.226249  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.196518  4331 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:46.235673  4325 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:46.235967  4333 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:21:46.236456  4333 pending_rounds.cc:85] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 10
I20260709 12:21:46.236937  4333 pending_rounds.cc:107] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:21:46.237251  4333 raft_consensus.cc:2889] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:46.241014  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 54830.1us
I20260709 12:21:46.241775  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.195633  8092 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:46.232664  8165 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:46.184409  7939 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.227804  8145 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.196354  8214 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:46.251801  8205 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:21:46.238581  8057 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:46.259768  7972 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.226832  7859 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.264966  8214 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:46.269901  8216 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.267544  8219 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:46.289276  8183 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.293980  8099 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.294528  8189 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.295656  8176 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:46.295804  8215 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:46.269229  8145 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:46.302438  8166 consensus_meta.cc:287] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
I20260709 12:21:46.303334  8145 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.297111  8146 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.289594  8219 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.304066  8219 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:46.304800  8150 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.297987  8188 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.271657  8165 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.309111  8165 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.285979  8214 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.309947  8173 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.313735  8173 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.299707  8177 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.287834  8216 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.315702  8216 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.321663  8186 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.326154  8202 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:46.326606  8202 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:46.327498  8202 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.332304  8219 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.332161  8214 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.333856  8180 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.335243  8219 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.323767  8216 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.339563  8216 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.335280  8214 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.341439  8212 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:46.341866  8212 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:46.342736  8212 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.343925  8212 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.344173  8182 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.382423  4153 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 2 to 5, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 5 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:46.387080  4153 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 4 to 7, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.399277  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:46.408324  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd900 after lost signal to thread 3105
W20260709 12:21:46.409503  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800119f60 after lost signal to thread 4141
I20260709 12:21:46.409581  4247 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:46.411263  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800119ea0 after lost signal to thread 4187
I20260709 12:21:46.412607  4249 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:21:46.413990  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 409187us
I20260709 12:21:46.414752  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.415556  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.254314  4333 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:46.420486  4332 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 14: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:46.420934  4255 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:46.420480  4372 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.423815  4325 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:46.425381  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:46.425480  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 434930us
I20260709 12:21:46.426514  4325 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:46.427034  4334 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:46.427057  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:46.428225  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.429864  4372 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.448527  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:46.449716  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.450809  4983 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:46.450851  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.451963  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:46.264137  8079 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.291572  8092 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.453245  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:46.466157  7774 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.278602  8042 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.484743  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.485715  4326 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 6.
I20260709 12:21:46.486162  7939 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.487361  8174 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:46.487675  8166 consensus_queue.cc:1059] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:46.488601  8174 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:46.489409  7951 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:46.489575  8002 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:46.490186  7951 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:46.490466  8002 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:46.490787  7951 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:46.492692  8055 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:46.493377  8055 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:46.494135  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.494473  7774 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.495204  4986 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:46.497012  8073 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:46.497606  7774 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:46.497877  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.498461  7774 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:46.498534  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 95279.6us
I20260709 12:21:46.502517  8211 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:46.503036  8040 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:21:46.497521  8073 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:46.497433  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.284061  7967 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.509514  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.510264  4983 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
W20260709 12:21:46.511435  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 269550us
I20260709 12:21:46.511575  8212 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:46.512282  8212 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:46.512598  4955 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.512852  8212 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:46.513681  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 82355.1us
I20260709 12:21:46.517763  8093 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:46.518237  8093 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.518607  8093 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.519666  8142 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:46.520135  8142 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:46.521569  7859 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.521449  8142 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.522737  4331 raft_consensus.cc:1240] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:21:46.523927  8073 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.527473  4988 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:46.527642  8002 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:46.529462  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.494827  8055 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.515064  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.499015  7774 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:46.523185  8142 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:46.552338  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800385220 after lost signal to thread 4281
I20260709 12:21:46.548485  7774 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:46.559442  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.560743  4986 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:46.569097  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.572096  7943 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:46.572751  7943 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.573207  7943 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.590245  8228 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.591120  8228 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.593654  8228 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:46.594914  8015 consensus_meta.cc:287] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 12:21:46.596093  4991 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:46.602494  4956 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:46.603412  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.604966  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.606074  8171 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.606532  8171 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.606562  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.606968  8171 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.610311  8079 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:46.610994  8079 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.611733  8015 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.612185  8015 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:46.612303  4296 connection.cc:256] RPC call timeout handler was delayed by -2.270933161999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:21:46.612599  8015 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:46.612819  4296 connection.cc:256] RPC call timeout handler was delayed by -2.25113316199986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 12:21:46.613389  8079 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:46.616941  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.619019  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:46.620081  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003defe0 after lost signal to thread 4358
W20260709 12:21:46.620421  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800374d00 after lost signal to thread 4359
W20260709 12:21:46.620914  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba4e0 after lost signal to thread 4371
W20260709 12:21:46.621186  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003eebe0 after lost signal to thread 4372
I20260709 12:21:46.622491  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.624199  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.626235  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.627682  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:46.629040  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 94026us
I20260709 12:21:46.632620  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.634137  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.634850  4329 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
W20260709 12:21:46.619091  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.640517  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:46.643766  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800302a00 after lost signal to thread 4401
W20260709 12:21:46.644287  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800419560 after lost signal to thread 4405
W20260709 12:21:46.645201  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800399e20 after lost signal to thread 4433
W20260709 12:21:46.645691  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7b20 after lost signal to thread 4955
W20260709 12:21:46.645961  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800269f40 after lost signal to thread 4956
W20260709 12:21:46.646209  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080037d940 after lost signal to thread 4957
W20260709 12:21:46.646483  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080037e3c0 after lost signal to thread 4958
I20260709 12:21:46.649217  8029 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.654522  4985 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 5.
I20260709 12:21:46.658854  7939 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:46.659040  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.659678  8179 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:21:46.659852  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 113403us
I20260709 12:21:46.660638  7928 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:21:46.613313  4296 connection.cc:256] RPC call timeout handler was delayed by -2.1854331620002085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260709 12:21:46.682052  7928 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:46.682188  4296 connection.cc:256] RPC call timeout handler was delayed by -2.1845331620002071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 12:21:46.682693  7928 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:21:46.682763  4296 connection.cc:256] RPC call timeout handler was delayed by -2.1278331620001154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:21:46.683408  4296 connection.cc:256] RPC call timeout handler was delayed by -2.1161331620000965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 12:21:46.683773  4296 connection.cc:256] RPC call timeout handler was delayed by -2.1071331620000819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 12:21:46.684121  4296 connection.cc:256] RPC call timeout handler was delayed by -2.0567331620000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:21:46.685087  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8722331620001569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 12:21:46.685083  8079 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:46.685497  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8722331620001569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 12:21:46.685868  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8425331620001089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 12:21:46.685768  8079 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:46.663349  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 56827.1us
I20260709 12:21:46.687238  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:46.687791  8091 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:46.688215  8091 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:46.688731  8091 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:46.689750  4371 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:46.647208  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800290840 after lost signal to thread 4984
W20260709 12:21:46.691236  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800155580 after lost signal to thread 5016
W20260709 12:21:46.691723  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08001d36a0 after lost signal to thread 7517
W20260709 12:21:46.691998  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800258cc0 after lost signal to thread 7774
W20260709 12:21:46.692269  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800310040 after lost signal to thread 7859
W20260709 12:21:46.692490  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc520 after lost signal to thread 7928
W20260709 12:21:46.692731  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08004027c0 after lost signal to thread 7939
W20260709 12:21:46.693012  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7ec0 after lost signal to thread 7951
W20260709 12:21:46.693240  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd240 after lost signal to thread 7957
W20260709 12:21:46.693495  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800290dc0 after lost signal to thread 7963
W20260709 12:21:46.693758  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800346f00 after lost signal to thread 7972
W20260709 12:21:46.694022  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080031ba60 after lost signal to thread 8002
W20260709 12:21:46.694263  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800407040 after lost signal to thread 8012
W20260709 12:21:46.694489  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003f9d00 after lost signal to thread 8015
I20260709 12:21:46.679709  8179 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:46.695894  8179 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.699316  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:46.700397  4327 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.695266  8109 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.702158  8109 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.702607  8109 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.703455  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.704265  4329 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:46.705237  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.681416  7939 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:46.688292  8079 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.707551  7939 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.707906  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:46.686257  4296 connection.cc:256] RPC call timeout handler was delayed by -1.8425331620001089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 12:21:46.711544  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7768331620000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:21:46.711452  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:46.712071  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7768331620000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 12:21:46.712502  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7345789370001512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:21:46.712813  4296 connection.cc:256] RPC call timeout handler was delayed by -1.451978937000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:21:46.713097  4296 connection.cc:256] RPC call timeout handler was delayed by -1.2935789369998929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 12:21:46.713376  4296 connection.cc:256] RPC call timeout handler was delayed by -1.2755789369998638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 12:21:46.713414  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:46.713760  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1783789370001614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:21:46.714082  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1783789370001614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:21:46.714666  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1081789370000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:21:46.715133  4331 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:21:46.715783  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1081789370000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:21:46.714227  4328 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 14: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:46.719929  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1a80 after lost signal to thread 8023
I20260709 12:21:46.668357  4984 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
W20260709 12:21:46.730087  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:46.733490  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080012bf60 after lost signal to thread 8029
W20260709 12:21:46.734144  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800351be0 after lost signal to thread 8055
W20260709 12:21:46.734431  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080032f460 after lost signal to thread 8057
W20260709 12:21:46.734707  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080034e160 after lost signal to thread 8073
I20260709 12:21:46.735904  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:46.737703  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:46.745054  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:46.748242  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080040d4c0 after lost signal to thread 8079
W20260709 12:21:46.748631  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003aac60 after lost signal to thread 8090
W20260709 12:21:46.748924  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800359920 after lost signal to thread 8091
W20260709 12:21:46.749193  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080041b7c0 after lost signal to thread 8092
W20260709 12:21:46.749472  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9860 after lost signal to thread 8093
W20260709 12:21:46.749750  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6360 after lost signal to thread 8099
W20260709 12:21:46.753464  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8000 after lost signal to thread 8109
W20260709 12:21:46.753868  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0c60 after lost signal to thread 8113
W20260709 12:21:46.754155  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08004152e0 after lost signal to thread 8127
W20260709 12:21:46.754370  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080015af00 after lost signal to thread 8128
W20260709 12:21:46.758191  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 68504.1us
W20260709 12:21:46.759428  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08004152a0 after lost signal to thread 8129
W20260709 12:21:46.760143  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800415280 after lost signal to thread 8132
I20260709 12:21:46.759927  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.759270  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:46.763203  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3b60 after lost signal to thread 8139
W20260709 12:21:46.763646  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8680 after lost signal to thread 8142
W20260709 12:21:46.763940  4278 debug-util.cc:398] Leaking SignalData structure 0x7b080031c660 after lost signal to thread 8146
I20260709 12:21:46.764425  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.764907  4255 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.767750  8181 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.767654  8168 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:46.769083  8042 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.769670  8042 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:46.770206  8042 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.775565  8092 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.776325  4331 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:46.776206  8092 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.776755  4331 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:46.777861  4331 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.779875  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.780821  4401 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:46.783890  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:46.775599  4296 leader_election.cc:400] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:46.785887  4296 leader_election.cc:403] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:21:46.786206  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 67342.9us
I20260709 12:21:46.778400  8092 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.779106  4331 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.667763  7951 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.762710  4409 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:46.800843  8208 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:46.804100  8073 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:46.804600  4255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:46.805351  4255 raft_consensus.cc:606] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:46.805694  4255 raft_consensus.cc:614] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:46.806651  8073 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.809803  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.810055  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.810840  4254 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:46.810945  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.811693  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:46.812063  7517 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.007s
I20260709 12:21:46.812321  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:46.812793  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 60354us
I20260709 12:21:46.812608  7517 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.813014  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.813894  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.814355  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.815330  4407 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:46.815647  8173 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:46.816560  4249 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:46.816798  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.817811  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:46.818511  4406 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:46.819686  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.819851  7517 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.820454  4247 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:46.820585  4333 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:21:46.821595  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:46.821683  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:46.822477  4405 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.822695  4991 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:21:46.825495  4278 debug-util.cc:398] Leaking SignalData structure 0x7b08004153c0 after lost signal to thread 8150
W20260709 12:21:46.825829  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800326e80 after lost signal to thread 8156
I20260709 12:21:46.678678  8093 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.834637  8181 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:46.813041  4257 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:46.837435  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:46.818697  7943 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:46.843254  4278 debug-util.cc:398] Leaking SignalData structure 0x7b0800151c80 after lost signal to thread 8158
I20260709 12:21:46.848999  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.845961  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:46.858651  4327 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:46.860168  4332 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:46.860471  4985 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.855590  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.869760  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1962) took 1057 ms. Trace:
I20260709 12:21:46.870221  4253 rpcz_store.cc:276] 0709 12:21:45.812617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:45.871631 (+ 59014us) service_pool.cc:224] Handling call
0709 12:21:45.871941 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.085094 (+213153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.085124 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.086210 (+  1086us) log.cc:844] Serialized 26 byte log entry
0709 12:21:46.640081 (+553871us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:46.640172 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:46.869164 (+228992us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000d5f54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:46.869219 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:46.869268 (+    49us) raft_consensus.cc:1685] finished
0709 12:21:46.869280 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:46.869567 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1795,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1745,"spinlock_wait_cycles":465647488,"thread_start_us":439900,"threads_started":1,"wal-append.queue_time_us":485059}
I20260709 12:21:46.872445  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.873152  4252 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
W20260709 12:21:46.874027  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48312.2us
I20260709 12:21:46.871462  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.876824  8093 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:46.863029  8091 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:46.883510  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.884651  4409 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:46.887548  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 103812us
I20260709 12:21:46.891777  4329 pending_rounds.cc:85] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 6
I20260709 12:21:46.892166  4329 pending_rounds.cc:107] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:21:46.892434  4329 raft_consensus.cc:2889] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.858008  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:46.893553  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46245us
I20260709 12:21:46.894750  7963 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:46.895131  7963 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:46.895551  7963 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:46.897410  8109 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.891798  4407 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:46.901201  7943 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:46.903861  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:46.905243  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.907238  7963 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.908053  8170 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:46.908916  8167 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:46.909685  7963 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:46.910403  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 64082.9us
I20260709 12:21:46.910718  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:46.835633  8142 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:21:46.912122  8029 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.912240  8142 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:46.912746  8142 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:46.912752  8029 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.913282  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.913791  8142 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.914307  8092 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:46.818702  8015 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.933256  7517 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:21:46.935009  8142 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.935470  4255 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:46.936317  4333 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:46.935626  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.944607  4984 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:46.944988  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:46.945773  4989 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:46.945776  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.950055  4257 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:46.960129  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:46.961009  7963 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:46.961954  7963 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:46.962318  7963 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.962661  7963 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.962904  7517 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:46.963335  7517 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:46.963856  7517 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:46.964428  8208 raft_consensus.cc:1064] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: attempting to promote NON_VOTER 0952d204644f41a88e5e463e697dcc27 to VOTER
I20260709 12:21:46.966930  8229 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:21:46.966885  8208 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.969375  8202 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.971434  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:46.973440  7963 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.975281  4986 raft_consensus.cc:1275] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:21:46.975675  4986 pending_rounds.cc:85] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 6
I20260709 12:21:46.975955  4986 pending_rounds.cc:107] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:21:46.976204  4986 raft_consensus.cc:2889] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.976502  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:46.977098  4332 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.976820  8179 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:46.978521  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.978804  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.979357  4247 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:46.980945  4331 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:46.983289  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:46.984642  4409 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:46.985005  4985 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:46.981071  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:46.986243  4405 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:46.981340  4331 pending_rounds.cc:85] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:46.987058  4331 pending_rounds.cc:107] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:46.987421  4331 raft_consensus.cc:2889] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:46.990639  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:46.990897  8171 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:46.991459  4253 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:46.993237  8171 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:47.009063  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 76078.9us
I20260709 12:21:47.010599  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:47.046715  4252 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:47.046432  4406 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:21:46.983179  8029 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:47.052937  7973 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:47.063493  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 148285us
I20260709 12:21:47.064334  8091 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:47.072510  8002 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.072664  7967 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.073123  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:47.074129  8002 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.074198  7967 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.076498  8079 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.076736  8002 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.077365  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:47.078440  8079 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.012913  8109 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:46.942878  8212 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.076716  7967 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.068707  7973 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:47.112814  4406 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:47.115748  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.122684  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 46523.3us
I20260709 12:21:47.124594  4405 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:47.125085  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:47.125278  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:47.125730  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:47.126111  4404 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:47.125941  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:47.127104  4402 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:47.127194  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:47.127350  8182 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:21:47.128968  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:47.130005  8163 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:47.130483  8168 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:47.131040  8168 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.131469  8168 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.131503  8167 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.132721  8073 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:47.134148  8209 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:47.134711  8209 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.135106  8209 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:47.137405  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.145663  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:47.085870  7928 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.148072  4332 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:47.152029  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:47.152859  8109 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:21:47.153971  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:47.062731  8224 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:47.102332  7963 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.158617  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:47.166208  4331 raft_consensus.cc:2410] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:21:47.139999  7951 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.161612  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:47.186117  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:47.192095  4401 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:47.196764  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:47.197140  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.191524  7973 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.197605  4256 raft_consensus.cc:2393] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:47.198263  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.198755  4256 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:47.199993  8210 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.200599  8210 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.203485  4407 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:47.204133  4325 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:21:47.211150  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.158104  8211 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.214138  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.215963  4250 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:47.180626  8228 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.208580  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:47.190428  8179 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.220619  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.219103  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.216389  8163 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:47.225807  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 73898.4us
I20260709 12:21:47.227149  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.231484  4252 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:47.228302  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.222657  4256 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:47.233933  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:47.213131  8210 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:47.224608  7939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.020s
I20260709 12:21:47.245498  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:47.246647  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 305195us
W20260709 12:21:47.250723  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 337559us
I20260709 12:21:47.249116  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.231559  8224 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:47.230729  8163 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:47.242268  7939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.019s	sys 0.020s
I20260709 12:21:47.272521  4247 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:47.274794  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.278316  4252 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:47.277714  4249 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:21:47.287928  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 144268us
W20260709 12:21:47.266510  7774 consensus_meta.cc:287] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.002s
I20260709 12:21:47.294449  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:47.303268  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.273957  8163 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.306896  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.307982  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:47.255281  8228 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.326246  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.327106  4249 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:21:47.274535  7517 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.343741  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:47.355535  7928 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.364363  8146 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:21:47.372035  7973 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:47.397468  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:47.398502  4329 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.399310  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:47.399705  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:47.407549  8165 raft_consensus.cc:2764] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:47.409437  4329 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:47.284217  8211 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.353674  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:47.420933  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.421614  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.301859  7774 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:47.429921  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 115870us
I20260709 12:21:47.431622  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:47.343338  8212 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.447880  4255 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:47.455606  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:47.414733  8168 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.470151  8099 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:47.470727  8099 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:47.474439  4403 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:47.475255  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.481186  4401 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:47.481945  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:47.482939  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 129383us
I20260709 12:21:47.484086  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:47.503721  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45090.6us
I20260709 12:21:47.437563  7928 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:21:47.451619  8029 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.348023  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:47.534307  4253 consensus_meta.cc:287] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.000s
W20260709 12:21:47.535197  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 45136.4us
I20260709 12:21:47.535269  4253 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:47.529701  8257 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:47.542487  8257 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.547533  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:47.542357  8259 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:47.550741  8257 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:47.550174  8142 consensus_meta.cc:287] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.002s
I20260709 12:21:47.558326  4956 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:47.582365  4247 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:21:47.582916  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 98894.4us
W20260709 12:21:47.586081  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.559417  8251 log.cc:927] Time spent T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:21:47.547557  8212 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.555671  8259 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:47.602448  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44205.2us
W20260709 12:21:47.601506  8042 consensus_meta.cc:287] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.831s	user 0.014s	sys 0.001s
I20260709 12:21:47.608970  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:47.611650  4253 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:47.639199  4956 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:47.616061  8057 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:47.607157  8259 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:47.659946  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50794.4us
I20260709 12:21:47.605732  8212 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.557677  8099 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.640991  8228 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:47.688952  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.640861  7517 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:47.654659  7774 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:47.725415  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:47.725143  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:47.652714  8057 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:47.741986  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51834.1us
I20260709 12:21:47.728283  4253 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:47.654908  8260 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:47.745491  8057 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:47.749272  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 57292.1us
I20260709 12:21:47.617960  8042 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.751368  4252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:47.753332  8258 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:47.684173  8091 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:21:47.696839  8211 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.736963  8229 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:47.755254  8209 consensus_meta.cc:287] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.001s
I20260709 12:21:47.750744  8260 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:47.790166  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 329692us
I20260709 12:21:47.769053  8212 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.774068  8042 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:47.687566  8142 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:21:47.760949  7517 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:21:47.779349  8168 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:47.782366  8073 consensus_meta.cc:287] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 12:21:47.751726  7774 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:47.790961  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:47.798313  8229 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:47.843263  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:47.842860  8055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.009s
W20260709 12:21:47.850912  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 60043.8us
I20260709 12:21:47.845273  4401 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:47.792910  8260 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:47.844280  8146 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:21:47.876575  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 528694us
W20260709 12:21:47.879604  8202 consensus_meta.cc:287] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.910s	user 0.012s	sys 0.003s
I20260709 12:21:47.880438  4248 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:47.881464  8212 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:47.883672  8229 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.848626  7973 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.887655  7973 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.890514  7973 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:47.891353  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:47.892338  4334 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:21:47.891469  7967 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.848014  7517 consensus_queue.cc:1243] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:21:47.873150  4218 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.978s (SENT) [suppressed 7 similar messages]
I20260709 12:21:47.861251  7774 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:47.861799  8073 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:47.771283  8057 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.793936  8209 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:47.873586  8091 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:21:47.908026  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 64885.5us
I20260709 12:21:47.912199  4252 raft_consensus.cc:606] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:47.865010  8055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.006s	sys 0.009s
I20260709 12:21:47.877540  8146 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:47.917639  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:47.920881  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:47.905844  7774 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.908643  8091 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:47.939826  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 196866us
I20260709 12:21:47.920152  8146 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:47.947180  4329 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:47.903368  7967 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:47.950733  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.961066  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45598.3us
I20260709 12:21:47.937749  8275 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:47.954111  8163 consensus_meta.cc:287] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.005s
W20260709 12:21:47.971053  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 55820.3us
W20260709 12:21:47.971911  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:47.976933  8167 consensus_meta.cc:287] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.845s	user 0.007s	sys 0.007s
I20260709 12:21:47.977417  8167 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:47.973281  8272 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:47.979637  8261 log.cc:927] Time spent T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.430s	user 0.009s	sys 0.003s
I20260709 12:21:47.983516  8091 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.984772  8163 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:47.985460  8015 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:47.987494  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:47.994050  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:47.997748  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 307933us
I20260709 12:21:47.999540  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:47.997538  8023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.010s
W20260709 12:21:48.038942  8023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.012s	sys 0.013s
I20260709 12:21:48.003218  8257 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.042439  8257 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:48.031642  8142 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:48.044111  8142 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:47.987176  8163 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:48.047554  8270 log.cc:927] Time spent T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:21:48.048451  8057 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:48.048911  8269 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:21:48.048580  8142 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:47.997166  8272 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:48.060042  8264 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:21:48.060921  8275 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:48.062412  8275 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:48.064566  4328 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.065611  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:48.067706  8142 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:48.068259  8142 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.068958  8142 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:48.070359  7774 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:48.071709  8267 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.089s	user 0.003s	sys 0.000s
W20260709 12:21:48.071774  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 72359.5us
I20260709 12:21:47.972612  8276 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:21:48.068302  8209 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.074420  4955 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:48.075614  8284 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:21:48.076216  8284 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:48.077711  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.049439  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 77393.3us
W20260709 12:21:48.078454  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.085189  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.083868  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1142) took 1145 ms. Trace:
W20260709 12:21:48.093976  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 213635us
W20260709 12:21:48.097721  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 224607us
I20260709 12:21:48.093469  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.098791  4401 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:48.098764  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.097077  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 805) took 1114 ms. Trace:
I20260709 12:21:48.104498  4406 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:48.108757  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:48.112573  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.113399  4407 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:48.114547  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.094892  8092 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:48.101550  4991 rpcz_store.cc:276] 0709 12:21:46.931860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.931993 (+   133us) service_pool.cc:224] Handling call
0709 12:21:46.936204 (+  4211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.219033 (+282829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.219062 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.236953 (+ 17891us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.647361 (+410408us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:47.647424 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.652326 (+  4902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.077387 (+425061us) raft_consensus.cc:1685] finished
0709 12:21:48.077407 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.077561 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146705,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3396,"thread_start_us":615068,"threads_started":2,"wal-append.queue_time_us":614590}
I20260709 12:21:48.083660  8015 consensus_queue.cc:1059] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:21:48.093439  8029 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:21:48.118649  8163 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:48.138155  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53095.6us
I20260709 12:21:48.124219  8042 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:48.146979  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.150180  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.077312  8284 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.133296  8257 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.106274  4408 rpcz_store.cc:276] 0709 12:21:46.809590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.823534 (+ 13944us) service_pool.cc:224] Handling call
0709 12:21:46.823931 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:46.824331 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:21:47.245101 (+420770us) log.cc:844] Serialized 14 byte log entry
0709 12:21:47.923327 (+678226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:47.923396 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:47.923463 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.923542 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:47.923686 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15134,"prepare.queue_time_us":485451,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":339911,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5731,"thread_start_us":1019043,"threads_started":3,"wal-append.queue_time_us":378540}
I20260709 12:21:48.158793  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.159597  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.161728  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.116307  8274 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:21:48.162297  4250 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.145308  8163 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.173022  8163 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.163811  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.163739  8287 consensus_queue.cc:1048] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:21:48.175616  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.171042  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.180116  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.180666  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.181100  8042 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.182324  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.171711  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.183753  4402 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:48.139901  8092 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:48.172767  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.185920  4404 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:48.186890  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.187651  4328 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:21:48.191155  4250 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:48.172513  4407 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:21:48.193881  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.184890  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.202090  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.203619  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.204039  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.204748  4403 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:48.205473  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.206050  4331 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.205899  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.206326  8092 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.206851  4403 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
W20260709 12:21:48.221982  8259 consensus_meta.cc:287] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:21:48.231606  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.242823  8142 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:48.232414  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52416.1us
I20260709 12:21:48.250075  8178 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.183281  8042 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.223806  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.233088  8224 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:48.227483  8260 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.250305  8015 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.225044  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.217255  4331 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:48.220206  7774 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:48.214138  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 791) took 1025 ms. Trace:
I20260709 12:21:48.248549  8057 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:48.238196  8265 log.cc:927] Time spent T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.471s	user 0.000s	sys 0.001s
I20260709 12:21:48.222468  7967 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:48.215662  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.311702  8057 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.314028  4333 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:48.314360  4333 pending_rounds.cc:85] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 8
I20260709 12:21:48.211534  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.314654  8057 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.317433  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.317610  8283 raft_consensus.cc:3055] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:48.318203  4989 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:48.318086  8283 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:48.249099  8029 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:48.319218  8029 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.320041  4402 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:48.247784  8182 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.230759  8091 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:48.284631  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.166484  8146 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.288887  4401 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:48.292133  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.295563  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.298833  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.302639  4255 rpcz_store.cc:276] 0709 12:21:47.188277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.194394 (+  6117us) service_pool.cc:224] Handling call
0709 12:21:48.213909 (+1019515us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540019a854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:48.214058 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515752192}
I20260709 12:21:48.200516  8229 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:48.297971  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.308027  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.308797  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.314584  4333 pending_rounds.cc:107] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:21:48.339941  4333 raft_consensus.cc:2889] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:48.331835  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.341557  4407 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.339847  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.335433  4403 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:21:48.338302  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 193567us
I20260709 12:21:48.350822  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.352303  4401 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:48.290509  8259 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.358855  4334 raft_consensus.cc:2393] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:48.360846  4404 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:21:48.369239  4401 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:48.334237  8146 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:48.351714  8179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.017s
I20260709 12:21:48.374904  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.338222  8272 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:48.338784  8229 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:48.384057  4402 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:48.322974  8015 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.389694  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.393329  4401 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:48.340902  8224 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:48.397392  4403 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
W20260709 12:21:48.400436  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 56320.3us
W20260709 12:21:48.377351  8179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.017s
I20260709 12:21:48.408198  4407 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:48.331107  8178 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.341300  8182 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.397226  8212 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:48.409953  4404 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:48.410403  8029 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.411082  8015 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:48.412189  8142 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:48.413326  8260 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.390552  8042 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.420995  8272 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.430346  4986 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:48.323362  8283 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.429175  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.458328  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.458873  4989 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:48.448359  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:48.424129  8289 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
W20260709 12:21:48.451016  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 142047us
I20260709 12:21:48.458935  4403 raft_consensus.cc:2376] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9. Re-sending same reply.
I20260709 12:21:48.447635  8057 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:21:48.446550  8212 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:48.469033  8212 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:48.472855  8182 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.472975  8272 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:48.479610  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.480204  8099 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.480332  4404 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:21:48.480624  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.481536  4984 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
W20260709 12:21:48.482462  8242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.024s	sys 0.048s
I20260709 12:21:48.482736  4992 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:48.483856  4990 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
W20260709 12:21:48.482807  8242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.408s	user 0.024s	sys 0.048s
I20260709 12:21:48.495836  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.498172  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.499661  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.500469  4992 raft_consensus.cc:2410] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 13 because replica has last-logged OpId of term: 11 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 12.
I20260709 12:21:48.497625  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.486166  8283 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:48.502051  4991 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:21:48.523032  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.530800  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.531503  4249 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:48.530864  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.527807  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.538162  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.539244  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:48.540295  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53717.7us
I20260709 12:21:48.541249  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:48.542682  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.543422  4987 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:48.545642  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:48.546394  4257 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:48.551015  4256 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:21:48.550642  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.553054  4991 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:48.528128  8015 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:48.554329  4247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 804) took 1247 ms. Trace:
I20260709 12:21:48.555363  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.557168  4992 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.556326  4247 rpcz_store.cc:276] 0709 12:21:47.302777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.302953 (+   176us) service_pool.cc:224] Handling call
0709 12:21:48.550198 (+1247245us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002b4dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:48.550295 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639674240}
I20260709 12:21:48.555698  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.560966  4987 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.561455  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.561303  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2322) took 1163 ms. Trace:
I20260709 12:21:48.563043  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:48.555241  8182 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.562789  4326 rpcz_store.cc:276] 0709 12:21:47.395237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.395369 (+   132us) service_pool.cc:224] Handling call
0709 12:21:47.395651 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.874041 (+478390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.874094 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.910756 (+ 36662us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.130061 (+219305us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:48.130110 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.130540 (+   430us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.558760 (+428220us) raft_consensus.cc:1685] finished
0709 12:21:48.558785 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.558946 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1103,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":652511,"threads_started":2,"wal-append.queue_time_us":365469}
I20260709 12:21:48.558557  8015 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.579819  8015 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.583612  8272 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:48.564633  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.584805  4991 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:48.573622  8182 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:48.575624  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 87687.5us
I20260709 12:21:48.577708  8178 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.501597  8229 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.578543  8259 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.558313  8224 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:48.559877  8303 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.586261  4992 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:21:48.594743  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:21:48.603605  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.604126  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.607154  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.608829  4247 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:48.610857  4253 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:48.612289  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.612833  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.613260  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:48.614140  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 53017.6us
I20260709 12:21:48.615195  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.617774  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:48.626405  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.639676  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.615171  8229 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:48.595423  8212 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:48.623672  8182 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:48.665186  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46429.6us
I20260709 12:21:48.641328  8303 raft_consensus.cc:2764] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:48.684898  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:48.687553  8308 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:21:48.688063  8212 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.689371  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.689733  8091 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:48.690629  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.691767  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.692484  4326 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.685572  4988 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:48.693825  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:48.694927  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:48.695442  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:48.695650  4988 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 5: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:48.696558  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.697248  4988 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:48.698154  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.703166  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:48.711119  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:48.704288  8306 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:21:48.712848  4333 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:48.685727  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.714360  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.716323  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:48.716535  4333 raft_consensus.cc:1217] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.7->[6.8-9.10]   Dedup: 6.8->[7.9-9.10]
I20260709 12:21:48.717187  4333 pending_rounds.cc:85] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 8
I20260709 12:21:48.717147  8091 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:48.717676  8091 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:48.718083  8091 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:48.718524  8178 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.718948  8178 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.719339  8178 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:48.719471  8182 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:48.721053  8182 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:21:48.722891  8163 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
W20260709 12:21:48.705570  8273 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.762s	user 0.002s	sys 0.000s
I20260709 12:21:48.726709  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2321) took 1769 ms. Trace:
I20260709 12:21:48.726630  8091 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.727267  4327 rpcz_store.cc:276] 0709 12:21:46.957685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.394911 (+437226us) service_pool.cc:224] Handling call
0709 12:21:47.395351 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:47.395731 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:47.395760 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:47.396276 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.793770 (+397494us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:47.793834 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.793948 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:48.704794 (+910846us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:48.726395 (+ 21601us) raft_consensus.cc:1685] finished
0709 12:21:48.726418 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:48.726646 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1128,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":2498432,"thread_start_us":395415,"threads_started":1,"wal-append.queue_time_us":506397}
I20260709 12:21:48.728994  8091 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:48.729324  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.730544  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.708731  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1962) took 1899 ms. Trace:
I20260709 12:21:48.731588  4248 rpcz_store.cc:276] 0709 12:21:46.809274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.809408 (+   134us) service_pool.cc:224] Handling call
0709 12:21:48.708459 (+1899051us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400121454. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:48.708627 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2460538112}
W20260709 12:21:48.733589  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46999.2us
I20260709 12:21:48.684515  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.738615  4987 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
W20260709 12:21:48.739549  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 55758.7us
I20260709 12:21:48.740494  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.656881  8304 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:48.666934  8259 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:48.755954  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81790.2us
I20260709 12:21:48.757369  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:48.758412  8202 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:48.758832  8202 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.731179  4327 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:48.747437  4333 pending_rounds.cc:107] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.9
W20260709 12:21:48.748279  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 62940.3us
I20260709 12:21:48.750046  4983 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:48.749817  8015 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.745723  8163 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.754799  7973 raft_consensus.cc:993] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:48.759166  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.760964  4334 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:48.766155  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:48.763453  4333 raft_consensus.cc:2889] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:48.764873  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:48.768303  4327 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:48.769562  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:48.770356  4327 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:48.774188  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.774847  4986 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:21:48.759227  8202 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:48.778699  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.764842  4991 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:48.778863  4987 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:48.781765  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.765662  8182 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.793880  4988 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:48.784910  4326 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:48.789151  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.800148  4400 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:48.788750  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 69466.4us
I20260709 12:21:48.803429  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:48.849505  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 60454.2us
W20260709 12:21:48.854610  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 95588.6us
I20260709 12:21:48.862221  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.863657  4956 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:48.762392  8091 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:21:48.864861  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 66381.2us
I20260709 12:21:48.780249  8042 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.799041  8208 raft_consensus.cc:1081] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:21:48.797968  8146 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:48.788018  8142 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:48.786044  8099 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:48.792093  8260 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:21:48.784780  8281 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.876801  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:48.906643  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 103355us
I20260709 12:21:48.866804  8259 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:48.869457  8283 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:48.913121  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:48.915402  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 236376us
I20260709 12:21:48.849825  8182 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.887569  8029 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:48.867992  8092 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:21:48.908300  8146 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:48.947543  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:48.949509  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 170395us
I20260709 12:21:48.912513  8283 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.952953  4408 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:48.952852  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.955885  4407 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:48.957760  4405 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:48.956805  4327 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
I20260709 12:21:48.961822  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:48.933914  8260 raft_consensus.cc:2764] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:21:48.933112  8029 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:48.992043  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55845.2us
I20260709 12:21:48.993114  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:48.937693  8208 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:48.969542  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:48.970677  8311 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:21:48.975751  8146 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:48.956318  7973 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:48.974617  8202 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:48.988009  8314 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:48.989224  4401 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:49.022548  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:49.022925  4330 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
W20260709 12:21:48.969653  8313 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:21:48.995676  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:49.027690  4406 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:48.960736  8283 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.023391  4402 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:49.026486  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:48.997104  8029 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.031153  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:49.031174  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 167604us
W20260709 12:21:49.027842  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 165722us
I20260709 12:21:49.034049  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:49.040920  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.050949  4991 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:21:49.053018  8316 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:21:49.053169  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 58580.7us
I20260709 12:21:49.054486  4991 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:49.054807  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1968) took 2118 ms. Trace:
I20260709 12:21:48.999167  8042 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:21:49.055094  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:49.055615  4991 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.059257  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 986) took 1094 ms. Trace:
I20260709 12:21:49.054836  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:49.074245  4401 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:49.063591  4992 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:49.055209  4254 rpcz_store.cc:276] 0709 12:21:46.936811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:46.937004 (+   193us) service_pool.cc:224] Handling call
0709 12:21:46.946102 (+  9098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:46.946341 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:46.946372 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:46.946945 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:21:47.208322 (+261377us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:47.208357 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:47.208413 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:47.978895 (+770482us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:49.053831 (+1074936us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b2400181e98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadb179c4 00007fdbadb15acb 00007fdbadcd0dc9 00007fdbadcd0a55 00007fdbadccffb0 00007fdbb0946488 00007fdbb0946be8 00007fdbb091e398 00007fdbb091976a 00007fdbb0918bb6
0709 12:21:49.054598 (+   767us) raft_consensus.cc:1685] finished
0709 12:21:49.054620 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.054730 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56048384,"thread_start_us":260982,"threads_started":1,"wal-append.queue_time_us":513443}
I20260709 12:21:49.079977  4402 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:49.080586  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:49.041328  8260 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.082778  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.083155  4984 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:49.081838  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:49.003383  8208 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:49.057493  8319 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:21:49.045596  8163 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.073815  4325 rpcz_store.cc:276] 0709 12:21:47.964574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.299254 (+334680us) service_pool.cc:224] Handling call
0709 12:21:48.306093 (+  6839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:48.487036 (+180943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:48.487083 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:48.488630 (+  1547us) log.cc:844] Serialized 26 byte log entry
0709 12:21:48.653498 (+164868us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:21:48.653538 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:48.653612 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:49.059058 (+405446us) raft_consensus.cc:1685] finished
0709 12:21:49.059080 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:49.059199 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20237,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9056,"thread_start_us":237283,"threads_started":2,"wal-append.queue_time_us":319435}
I20260709 12:21:49.064531  8182 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:49.089248  8304 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:49.061136  8202 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.095808  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 2647) took 1022 ms. Trace:
I20260709 12:21:49.092000  8283 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.033326  8178 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.096310  4329 rpcz_store.cc:276] 0709 12:21:48.073092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.199424 (+126332us) service_pool.cc:224] Handling call
0709 12:21:49.095609 (+896185us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54003d3e54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:49.095746 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449966464}
I20260709 12:21:49.098031  8178 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:49.095106  8208 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.058911  8168 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:21:49.099911  8168 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:49.100281  8168 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.101024  8168 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.101652  8283 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:49.102231  8168 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:49.095831  8304 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.104144  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:49.055498  8284 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.057626  8015 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:49.111836  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 235134us
I20260709 12:21:49.111977  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:49.114521  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.128324  4989 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
W20260709 12:21:49.129276  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 46575.5us
I20260709 12:21:49.131963  8202 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:49.136206  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.138890  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:49.116201  8329 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.155499  8329 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.155905  8329 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.142264  8142 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.142263  8332 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:49.163712  8332 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.141716  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:49.139210  8327 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:21:49.143607  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 2330) took 1745 ms. Trace:
I20260709 12:21:49.138335  8165 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:49.138607  8163 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.183183  8163 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.185271  8163 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:49.146363  8309 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.514s	user 0.001s	sys 0.007s
I20260709 12:21:49.147359  4987 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:49.186002  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:49.140484  8208 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:21:49.186877  4331 raft_consensus.cc:2410] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:21:49.187211  8208 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.187656  8208 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.188519  8208 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.130782  8284 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:49.130919  8224 raft_consensus.cc:2764] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:49.136966  8202 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:21:49.175992  4328 rpcz_store.cc:276] 0709 12:21:47.397982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:47.399056 (+  1074us) service_pool.cc:224] Handling call
0709 12:21:49.143435 (+1744379us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54002661d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:49.143533 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528229248}
I20260709 12:21:49.144400  8272 raft_consensus.cc:2764] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:21:49.171016  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.173352  8324 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:49.179211  4334 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.178514  8029 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.194974  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:49.195819  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 151514us
I20260709 12:21:49.196044  8029 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:49.196687  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.166399  7973 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:49.168527  7967 consensus_queue.cc:1059] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:49.182031  8165 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.182649  8327 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.197609  8146 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:49.198006  8327 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.198727  8202 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:49.199186  8202 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.199510  7973 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.200001  8202 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.200642  7973 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.197831  8165 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.205072  8165 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.206314  8165 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.206986  8168 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.206246  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.207674  8168 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.207998  8171 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.209436  8171 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:49.210004  8171 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.210896  8324 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.198840  8327 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.212728  8327 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.213164  8324 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.201335  8202 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:49.217746  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:49.217907  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.211093  8171 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.219333  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.203154  4328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:21:49.219566  8029 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.193463  4334 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:49.220497  8029 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:49.220611  8042 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:21:49.221717  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:49.222502  4332 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 12:21:49.222733  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.223536  8328 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:49.223966  8328 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.219983  4328 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:49.225256  4328 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:49.200052  8284 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:49.228196  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.189733  8208 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.228124  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.197795  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.234530  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:49.239769  4326 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.166152  8332 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.220695  4334 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.245292  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:49.241273  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 43537.9us
I20260709 12:21:49.251857  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:49.257439  4403 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:49.275028  4326 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:49.276791  4326 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:49.240496  8260 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.278894  4956 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.237782  8029 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.253312  8163 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:49.291411  4326 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:21:49.272262  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.294127  4329 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:49.302820  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:49.303752  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.257853  8015 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.298982  4334 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:49.303619  4328 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:49.305563  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 139103us
I20260709 12:21:49.313418  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.305611  8092 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:21:49.292436  8260 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.317935  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.323599  4328 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.250686  8042 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:21:49.253993  8167 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:21:49.306931  8015 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.306347  8002 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.303467  8178 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:49.380398  8178 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:49.381358  8178 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:49.383653  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.306092  8182 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:21:49.317260  8168 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.327261  8320 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:21:49.324366  8179 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:21:49.331568  8042 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:49.224794  8328 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.324565  8260 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.342971  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.324939  8029 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:49.347621  8333 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:21:49.349848  4403 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:49.358440  8329 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.360085  4334 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:49.365264  8015 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.371879  8337 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:49.325525  8330 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
W20260709 12:21:49.416067  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 73204.3us
I20260709 12:21:49.459156  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:49.416754  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.346688  8142 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:49.421509  8029 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.329483  7774 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:49.423606  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 184995us
I20260709 12:21:49.423990  4334 pending_rounds.cc:85] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:49.484203  4334 pending_rounds.cc:107] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:21:49.484571  4334 raft_consensus.cc:2889] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:49.409479  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 295023us
I20260709 12:21:49.370716  8304 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.409296  8002 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.409508  8042 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:49.454994  8182 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:49.311924  8287 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
W20260709 12:21:49.466192  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 153001us
I20260709 12:21:49.449471  8281 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.475852  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:49.476634  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:49.455562  8340 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.465744  8146 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:21:49.491736  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:49.503154  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.505920  4331 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:49.488399  8029 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:49.490415  8341 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.519868  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:49.552984  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:49.556155  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:49.556915  4991 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEARNER]: Advancing to term 7
I20260709 12:21:49.557583  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:49.559043  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:49.562752  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:49.564177  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:49.567088  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 47287us
I20260709 12:21:49.568239  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:49.584609  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 94874.7us
I20260709 12:21:49.517690  8339 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.499581  8182 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.517050  8168 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:21:49.553068  8341 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.504709  8281 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:49.587165  4296 connection.cc:256] RPC call timeout handler was delayed by -1.7046652650001306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 12:21:49.598515  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6884652650001044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 12:21:49.598934  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6884652650001044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 12:21:49.599275  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6596652650000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:21:49.599653  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6596652650000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:21:49.599958  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6335652650000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 12:21:49.600402  4296 connection.cc:256] RPC call timeout handler was delayed by -1.6335652650000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 12:21:49.577710  8167 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:21:49.593730  8336 log.cc:927] Time spent T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:21:49.605329  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5885652649999429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 12:21:49.606426  4296 connection.cc:256] RPC call timeout handler was delayed by -1.5579652650003482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 12:21:49.607438  4296 connection.cc:256] RPC call timeout handler was delayed by -1.4526652650001779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:21:49.608419  4296 connection.cc:256] RPC call timeout handler was delayed by -1.4454652650001663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 12:21:49.594759  8182 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:49.607692  8329 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.588117  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.574575  8352 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.595534  8042 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:49.609511  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3671652650000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 12:21:49.628060  4296 connection.cc:256] RPC call timeout handler was delayed by -1.3437652650000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:21:49.628515  4296 connection.cc:256] RPC call timeout handler was delayed by -1.2150652650002485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:21:49.629034  4296 connection.cc:256] RPC call timeout handler was delayed by -1.1484652650001408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 12:21:49.615008  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.585656  8278 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:49.585379  8344 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.616606  4991 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:49.635174  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:49.609892  8343 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:21:49.590147  8339 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:49.595242  8353 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.598217  8327 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.666530  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:49.668082  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 80063us
I20260709 12:21:49.608734  8341 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.675159  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:49.678828  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 110650us
I20260709 12:21:49.681730  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:49.679986  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.669025  7973 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.669185  8278 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.669876  8339 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.671473  8329 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:21:49.690160  8350 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:21:49.667033  8344 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.635787  8002 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:49.697834  8349 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:21:49.698779  8345 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:21:49.699641  8304 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.678828  8272 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:49.705251  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:49.668592  8340 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.708031  4252 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.719727  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.720809  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.663874  8352 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.723886  4256 raft_consensus.cc:2393] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:49.673276  8327 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:49.723347  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 58103.1us
I20260709 12:21:49.668877  8015 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.730307  4249 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:49.671842  8353 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.732972  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.754755  4248 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:49.679190  8260 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.733204  4255 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:49.717113  8303 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.739142  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.739622  8278 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.740023  8340 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:49.741858  8304 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:49.730161  8272 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:49.718914  8329 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.743971  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.745729  8281 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:49.747896  8163 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:49.748623  8344 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:49.703872  7973 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.751025  8359 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:49.763044  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.732841  8315 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.737826  8339 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.765973  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.770860  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.769066  4255 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:49.771121  4247 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:49.760120  8303 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.771672  4256 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:49.773568  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.774215  8315 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:49.774410  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.788141  4250 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:49.775892  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.776950  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.777504  8339 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:49.781471  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 99805.6us
I20260709 12:21:49.765195  8272 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:49.792780  4255 raft_consensus.cc:2410] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:21:49.796350  4254 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:49.765334  8304 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:49.772804  8341 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.811816  4247 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:49.772174  8163 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.788272  8303 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.787807  8315 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:49.803777  8304 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.824131  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.830461  4250 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:21:49.832861  8342 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.335s	user 0.002s	sys 0.002s
I20260709 12:21:49.838569  4248 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:49.847667  8163 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.849387  8320 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:49.849905  8320 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.851441  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:49.852213  4333 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 5.
I20260709 12:21:49.853434  4329 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:49.854508  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:49.803946  8171 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:21:49.856529  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.856683  8171 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:49.865429  4327 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:49.866364  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:49.865856  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.868369  4248 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:49.870333  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:49.823176  8315 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:49.872205  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.773222  8359 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.819478  8358 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:21:49.880980  4248 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:49.890492  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.890697  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.891431  4248 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 4.
I20260709 12:21:49.866384  8327 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:49.895038  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 155956us
I20260709 12:21:49.866597  8171 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.895823  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:49.897336  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:49.905212  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:49.881855  8284 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:21:49.850859  8320 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.834257  8365 consensus_queue.cc:1059] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:21:49.909684  8355 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.909677  8356 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:21:49.909788  8360 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:21:49.925755  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:49.926288  4248 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:49.930017  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:49.886533  8182 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:21:49.937587  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:49.944726  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:49.912792  8356 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:49.906500  8327 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:49.908205  8284 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:49.891881  8340 consensus_queue.cc:1059] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:21:49.874636  8329 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:49.950351  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:49.925257  8208 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:49.936290  8358 raft_consensus.cc:3055] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:49.935693  8339 raft_consensus.cc:2764] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:21:49.947208  8355 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:49.958590  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:49.948293  8356 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:49.953275  8284 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:49.951845  8092 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:49.951503  8260 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:49.968298  4248 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:49.956827  8358 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:49.959335  7973 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.958214  8353 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:49.990041  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:49.963371  8327 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:49.968737  8092 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:49.989454  8165 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.013669  4248 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
W20260709 12:21:50.019265  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 195207us
I20260709 12:21:49.955052  8171 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.001258  8360 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:50.000355  8327 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:50.026170  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 154646us
I20260709 12:21:50.014074  8354 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:50.031105  8356 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.014008  8372 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:50.033638  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:50.043673  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:50.083693  4329 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:50.128533  4329 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:50.092391  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.110845  4257 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:21:50.078629  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.082952  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.072355  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 122243us
W20260709 12:21:50.052667  8346 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.464s	user 0.001s	sys 0.001s
I20260709 12:21:50.139585  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:50.136338  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 102821us
I20260709 12:21:50.046476  8358 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.135473  4329 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.141811  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:50.147192  4329 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:50.147516  4250 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.071192  8327 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.143419  4333 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:50.045038  7774 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:50.131412  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.071589  8360 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:50.040336  8341 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.155686  8378 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:21:50.156140  8358 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:50.161840  4252 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:50.162936  4252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:50.168874  4252 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:50.169260  4252 raft_consensus.cc:614] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:50.170583  4252 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:50.151660  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:50.166587  8359 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.137428  8171 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.168145  8363 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:50.165446  8330 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.172433  4329 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:21:50.220448  4329 pending_rounds.cc:85] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 8
I20260709 12:21:50.220782  4329 pending_rounds.cc:107] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.9
W20260709 12:21:50.185797  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.221069  4329 raft_consensus.cc:2889] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:50.142684  8168 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:50.152963  8356 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.059963  8284 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:50.219529  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68031.1us
I20260709 12:21:50.172324  7774 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.051602  8303 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.146340  8329 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.231952  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.183872  8327 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.257691  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:50.187434  8363 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:50.233062  8346 log.cc:927] Time spent T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:50.254966  4250 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:50.255563  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.148753  7967 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:21:50.259701  4247 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:50.041338  8092 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.228238  8359 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:50.233239  8168 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:50.272933  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.260689  8260 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:50.334236  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 61431us
I20260709 12:21:50.334518  4256 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:50.231483  8002 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:21:50.221028  8315 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:50.356324  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 215265us
I20260709 12:21:50.357569  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:50.228056  8330 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.332347  8385 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.345700  8146 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.373807  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:50.375528  4987 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:50.374459  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:50.378814  4250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:50.362227  8092 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:50.358626  8329 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.379490  4250 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:50.370354  8272 consensus_meta.cc:287] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.001s
I20260709 12:21:50.379942  4250 raft_consensus.cc:614] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:50.381903  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:50.381179  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:50.382788  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:50.383489  4990 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:50.384387  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:50.385985  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:50.386576  4992 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:50.388818  4989 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:21:50.390450  8029 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.830s	user 0.004s	sys 0.006s
I20260709 12:21:50.390648  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:50.392700  8304 consensus_meta.cc:287] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.003s
I20260709 12:21:50.393339  7967 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.393108  8304 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.270522  8360 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.397370  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:50.398105  4247 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:50.372080  8320 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:50.399153  8320 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:50.390892  8029 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.399948  8320 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.400580  4988 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:50.369244  8390 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.401199  8029 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:50.401768  8390 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:50.401885  8029 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:50.388888  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 835) took 1137 ms. Trace:
I20260709 12:21:50.403537  4249 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:21:50.403755  4407 rpcz_store.cc:276] 0709 12:21:49.251078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.251240 (+   162us) service_pool.cc:224] Handling call
0709 12:21:49.251580 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:49.278842 (+ 27262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:21:49.305652 (+ 26810us) log.cc:844] Serialized 14 byte log entry
0709 12:21:49.496513 (+190861us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:49.497092 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 12:21:49.497244 (+   152us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:49.497441 (+   197us) log.cc:844] Serialized 14 byte log entry
0709 12:21:49.497617 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:49.497682 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:50.051885 (+554203us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:50.388690 (+336805us) raft_consensus.cc:1685] finished
0709 12:21:50.388711 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:50.388833 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17705,"prepare.queue_time_us":27490,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":10185,"raft.queue_time_us":26473,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":34175,"spinlock_wait_cycles":90690176,"thread_start_us":179504,"threads_started":1,"wal-append.queue_time_us":247490}
I20260709 12:21:50.407013  8329 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:50.409114  8329 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:50.409809  8272 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.411893  8272 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.412503  4330 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
W20260709 12:21:50.416615  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 72577.5us
I20260709 12:21:50.417336  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.377280  8358 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:50.375689  8363 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.416179  8002 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.419677  8392 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.420667  8303 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.421031  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.420986  8168 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.422562  8284 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:50.423516  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.423899  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.424871  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.425834  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.426810  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.378027  8385 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.427857  8146 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:21:50.472635  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.473812  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.474309  4401 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.475823  8330 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:50.479355  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 489361us
I20260709 12:21:50.479787  8395 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:50.449189  8002 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.480398  8395 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:50.481289  8395 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.482105  8002 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.482231  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.439989  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.443199  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.401211  8320 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.455672  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.448683  8363 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:50.465018  4408 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:50.466704  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.471184  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:50.472159  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.479537  8303 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:50.428926  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.500114  4405 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:50.395107  8304 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.488389  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.488664  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.464546  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:50.501299  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.449211  8029 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:50.495824  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55917.8us
I20260709 12:21:50.506489  4405 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:21:50.460645  8358 raft_consensus.cc:697] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:50.486676  8002 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.509553  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:50.509847  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.512903  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.502610  8354 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:21:50.515247  4401 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:50.502027  8029 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:50.484206  7774 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.523940  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.483193  8381 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:21:50.531060  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:50.517593  7967 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.454180  8392 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.513339  8272 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.536026  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.517611  8329 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.518349  8327 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.535849  8303 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:50.520610  8002 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.550320  8002 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.557456  8303 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.532015  8260 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.547752  8331 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:50.580438  4403 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:50.534000  8394 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:50.582100  4407 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:50.591694  8372 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:50.545447  8354 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.560031  8400 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.582479  8330 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.583199  8381 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:50.592366  8315 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:50.614565  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 236925us
I20260709 12:21:50.605074  8304 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:50.620348  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:50.633983  8396 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:21:50.634291  8372 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.634857  8392 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:50.593009  8260 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.636754  8329 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:50.637135  8260 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:50.637252  8329 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.637923  8329 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:50.641943  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:50.652896  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:50.654757  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:50.656433  4333 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:50.704082  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.644089  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:50.606277  8327 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:21:50.613986  8381 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:50.753895  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 265329us
I20260709 12:21:50.756022  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:50.757886  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:50.758564  4327 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:50.760039  4988 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:21:50.760999  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.620132  8411 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.778173  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:50.784747  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 158232us
I20260709 12:21:50.789641  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.786677  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:50.787608  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 203852us
I20260709 12:21:50.756781  8407 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:50.794041  4218 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:50.795233  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:50.797006  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.798408  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.608933  8358 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.618810  8330 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.757503  8208 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:50.607095  8029 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.611698  8354 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.807159  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.817764  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:50.771334  8396 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.824147  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.824573  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:50.829468  4403 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:50.825161  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.790544  8356 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.800484  8344 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:50.800593  8315 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:50.801894  8406 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:50.801384  8407 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:50.815208  8353 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:50.803668  8394 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:50.833859  8287 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:50.851902  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 56746.8us
I20260709 12:21:50.812834  8359 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:50.817039  8385 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:50.840772  8272 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:50.802013  8411 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:50.834064  8408 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:50.887650  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:50.851537  8331 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:50.848977  8029 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:50.856714  8171 consensus_meta.cc:287] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 12:21:50.864946  8353 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:50.854007  8407 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.879328  8395 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:50.846063  8356 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:50.897572  8378 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.838016  8396 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.905077  8353 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:50.901566  8272 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:50.954468  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:50.918780  8359 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.918334  8327 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:50.955426  4250 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:50.938203  8395 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.938489  8414 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.882340  8287 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:50.964993  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:50.968376  4250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
W20260709 12:21:50.965679  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:50.955721  8092 consensus_meta.cc:287] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 12:21:50.961130  8395 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:50.869428  8381 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:50.969202  4250 raft_consensus.cc:606] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:50.995365  4250 raft_consensus.cc:614] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:50.996727  4250 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:50.969982  8414 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.998570  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.000499  8414 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.002036  8406 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.005046  8406 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.006186  8408 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.008069  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:50.958806  8394 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.006794  8408 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.968873  8410 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:50.951175  8378 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:50.964510  8359 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.047061  4333 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
W20260709 12:21:51.037986  8404 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:21:51.038400  8315 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:50.964394  8331 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.036859  8303 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.047904  8330 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.040488  8354 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.040230  8410 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:51.054596  8406 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.056794  8381 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.067593  8408 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.025081  8272 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.080705  8428 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:51.113538  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.116326  4328 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:51.100454  8406 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:51.120350  8406 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:51.110859  8412 log.cc:927] Time spent T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:21:51.112133  8428 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.119052  8434 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.129210  8434 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.104432  8408 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:51.131383  8408 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.084003  8315 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.140481  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.141698  4402 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:51.142902  8419 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:21:51.143043  8418 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:21:51.143100  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.145488  4334 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
W20260709 12:21:51.148593  8417 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:21:51.149187  8396 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.139318  8274 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.137674  8356 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.086676  8303 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.176561  8015 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.177719  8424 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.178535  8424 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.179646  8431 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.179951  8359 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.138669  8430 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:51.180332  8431 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.139204  8411 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.186064  8287 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:51.210078  4988 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:51.210651  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.184347  8274 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } }
I20260709 12:21:51.212266  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.213217  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.213832  4325 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
W20260709 12:21:51.215600  8409 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.389s	user 0.005s	sys 0.005s
I20260709 12:21:51.217628  8315 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.218250  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.192046  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:51.219535  8348 log.cc:927] Time spent T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 1.722s	user 0.006s	sys 0.000s
I20260709 12:21:51.219684  4402 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:51.195827  8042 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.221004  8395 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:51.225562  8329 consensus_meta.cc:287] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 12:21:51.226125  8329 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.226701  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 819) took 1460 ms. Trace:
I20260709 12:21:51.227196  4257 rpcz_store.cc:276] 0709 12:21:49.766248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.769278 (+  3030us) service_pool.cc:224] Handling call
0709 12:21:49.770679 (+  1401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:50.131027 (+360348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.226397 (+1095370us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000df554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:51.226614 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781511552}
I20260709 12:21:51.228078  4334 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:51.235752  8378 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.236770  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.237564  4329 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:51.187773  8171 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:51.238384  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 831) took 1383 ms. Trace:
I20260709 12:21:51.238722  4256 rpcz_store.cc:276] 0709 12:21:49.855208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:50.043407 (+188199us) service_pool.cc:224] Handling call
0709 12:21:51.238206 (+1194799us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540019a854. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:51.238331 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470609280}
I20260709 12:21:51.238792  8430 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.240072  4247 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:51.241053  8430 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:51.188642  8320 consensus_meta.cc:287] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.688s	user 0.001s	sys 0.010s
I20260709 12:21:51.242471  8303 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.196772  8407 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.245242  8407 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:51.200580  8363 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.003s
I20260709 12:21:51.245949  8303 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.201186  8408 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.204643  8353 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.246522  8303 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.247210  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:51.208885  8431 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.213235  8274 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:51.248927  4326 raft_consensus.cc:2410] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:51.252225  8406 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.238740  8171 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.257378  8303 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.258342  8171 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.258495  8360 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.217532  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.259387  4328 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:51.197045  7774 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.211277  4991 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:51.262694  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.263290  4329 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:51.263585  8352 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.263823  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.264276  4329 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.264534  4331 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:21:51.265061  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.265673  4329 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:51.223141  8395 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:51.266559  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.248327  8353 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.268739  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.269315  4327 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:51.271723  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:51.255242  8383 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.909s	user 0.008s	sys 0.007s
W20260709 12:21:51.199846  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.273633  4328 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:51.274000  4328 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:51.100099  8410 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.274760  4328 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.275694  4328 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.276921  8410 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.277477  4329 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.278003  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.278695  4334 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:51.281845  8330 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.282145  8434 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.287204  7973 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.292919  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.292613  7973 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:51.293509  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.293879  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:51.294121  8388 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 1.024s	user 0.003s	sys 0.002s
W20260709 12:21:51.291208  4248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 830) took 1436 ms (client timeout 1872 ms). Trace:
I20260709 12:21:51.291792  4249 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 12:21:51.282339  8330 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.288779  8355 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:51.295428  4248 rpcz_store.cc:269] 0709 12:21:49.854942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.952825 (+ 97883us) service_pool.cc:224] Handling call
0709 12:21:51.291021 (+1338196us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b5400120a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:51.291135 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19837696}
I20260709 12:21:51.296231  8355 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:51.294891  7973 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.288131  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:51.296820  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.297674  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:51.297344  8355 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.298346  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.246393  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1968) took 1539 ms. Trace:
I20260709 12:21:51.299222  8202 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:51.299139  4254 rpcz_store.cc:276] 0709 12:21:49.706967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.707227 (+   260us) service_pool.cc:224] Handling call
0709 12:21:49.722431 (+ 15204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:49.796952 (+ 74521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.246179 (+1449227us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b540044ded4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:51.246340 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169356160}
I20260709 12:21:51.299712  8202 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:51.300180  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.300705  8330 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.300482  8202 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.301344  7967 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.301534  8202 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.301697  8421 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.302176  8421 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.302496  8421 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.304179  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.305095  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.306360  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:21:51.307121  8405 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.685s	user 0.001s	sys 0.001s
I20260709 12:21:51.301117  8341 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.307734  8341 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.308096  8341 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.310385  8421 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.298434  8355 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:51.284586  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.312979  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.313799  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.314131  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.314836  4985 raft_consensus.cc:2393] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:51.314788  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.315650  4992 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:51.315919  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.316608  4988 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 6: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:51.316816  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.307134  4252 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.248302  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:51.318531  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.319438  4331 raft_consensus.cc:2410] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:51.319559  8396 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.319736  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.320320  4992 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.320093  8396 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.322340  8396 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:51.322930  8396 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.323845  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2666) took 1617 ms. Trace:
I20260709 12:21:51.285615  8394 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.324390  4330 rpcz_store.cc:276] 0709 12:21:49.706605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.706730 (+   125us) service_pool.cc:224] Handling call
0709 12:21:49.709582 (+  2852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:50.412855 (+703273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:51.323559 (+910704us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400166f54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:51.323777 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616166272}
I20260709 12:21:51.324764  8394 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.286674  8428 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.327621  8394 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:51.327518  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:51.328760  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.329066  4252 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.329398  4219 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.330264  8304 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.330384  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.330684  8304 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:51.331094  8304 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.331385  4247 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.332366  4330 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:21:51.332485  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.332876  4330 pending_rounds.cc:85] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 4
I20260709 12:21:51.332953  4219 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.333206  4330 pending_rounds.cc:107] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:21:51.333549  4330 raft_consensus.cc:2889] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.333726  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.332566  8353 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:51.335410  8353 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:51.336560  7973 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:51.336957  7973 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:51.337711  7973 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.338672  7973 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.339598  8428 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:51.341034  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.333756  7967 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.341792  4326 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:51.315663  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.256368  8329 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.344518  4248 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.345279  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.377111  4985 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:51.378609  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.379843  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.383774  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.354199  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.354389  8421 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.354931  8359 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:51.355902  4990 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:51.356070  8304 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.342110  7967 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.388505  4990 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:21:51.388742  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.389559  4257 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:51.389835  4990 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:21:51.357046  4986 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:51.391427  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.357913  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.358292  4252 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:21:51.358165  8379 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:51.181704  8424 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.208959  8381 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.396106  4249 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:21:51.396523  8381 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.358953  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:51.282492  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 73438us
I20260709 12:21:51.397738  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.398546  8381 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.399333  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.400700  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.403564  8284 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:51.404243  8284 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:51.405381  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.405607  8284 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.407368  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.408263  4334 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:51.363541  4247 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:51.364149  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.409706  4247 pending_rounds.cc:85] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 7
I20260709 12:21:51.409080  4331 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:21:51.410229  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46174.6us
I20260709 12:21:51.410982  8390 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.411414  8390 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.411594  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.411863  8390 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.412672  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.413178  8421 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.414376  8352 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:51.369184  8328 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:51.369992  8357 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:51.410718  8394 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:51.372298  8324 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:51.374166  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:51.368893  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 354579us
I20260709 12:21:51.375448  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.333292  4256 raft_consensus.cc:2393] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.409967  4247 pending_rounds.cc:107] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:51.365206  8396 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.450249  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.450683  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.451210  4987 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.457585  4254 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:51.458567  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.460096  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.461776  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.462162  4248 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:51.464978  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.402413  4328 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:21:51.464006  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.430968  4991 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:21:51.532629  4990 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:51.533442  4328 pending_rounds.cc:85] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 4
I20260709 12:21:51.534237  4328 pending_rounds.cc:107] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:21:51.445277  4989 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:51.444371  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:51.535115  4328 raft_consensus.cc:2889] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.427613  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.526279  4984 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:21:51.536995  4984 pending_rounds.cc:85] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 11
I20260709 12:21:51.537266  4409 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:21:51.447218  4992 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:51.537817  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.539492  4988 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.448608  4983 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:51.421667  4247 raft_consensus.cc:2889] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.421999  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.525877  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.422896  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.423599  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:51.418198  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 44120.4us
I20260709 12:21:51.416157  8394 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.544958  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.553473  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.547724  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.554103  4257 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:51.529932  4329 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:51.423830  4372 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.428261  4252 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.546572  4992 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.537293  4984 pending_rounds.cc:107] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:21:51.416281  8357 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:21:51.556330  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 132573us
I20260709 12:21:51.463116  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.554715  4407 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:51.555678  4984 raft_consensus.cc:2889] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.420802  8304 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.480065  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.437073  8421 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:51.552865  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.556286  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.576638  4332 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:51.576808  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.557916  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.416281  8352 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:51.418031  8424 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.565205  4987 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:51.574815  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 43914.6us
W20260709 12:21:51.572445  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 92533us
I20260709 12:21:51.576082  4247 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:51.433342  8396 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.433455  7973 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.578192  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.588196  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.588651  4405 raft_consensus.cc:2410] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:21:51.587608  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:51.583649  4218 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.593521  4408 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.593654  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:51.591118  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.414845  7967 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.544863  8415 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.613685  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.615715  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:51.570698  8387 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:51.556625  8394 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:51.617000  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.617656  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.557101  8357 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:51.433887  8390 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.597113  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.570195  8379 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.635250  4325 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:21:51.615999  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:51.661777  4254 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.661976  4325 pending_rounds.cc:85] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:51.553539  8324 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:21:51.632484  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.640156  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:51.669792  4247 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:51.557071  8428 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.650098  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.570400  8359 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:21:51.589970  8424 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.662227  4333 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:51.583727  8398 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.662243  4325 pending_rounds.cc:107] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 12:21:51.661725  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 64698.3us
I20260709 12:21:51.578074  8436 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:51.663419  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 82454.5us
I20260709 12:21:51.666601  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.696698  4325 raft_consensus.cc:2889] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.655234  4248 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:51.681501  4989 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:51.632764  8421 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:51.663333  8420 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:51.694620  4983 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:51.697876  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.661698  8352 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.666299  7951 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.698519  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.632301  8165 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:21:51.632579  8415 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.666096  8379 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.648607  8179 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:21:51.719040  4984 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:51.696365  8424 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.608142  7973 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.676390  8092 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:51.735657  8092 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.736213  8092 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.692700  8002 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:51.739055  8002 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:51.739475  8002 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.712684  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:51.741365  8365 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:51.673228  8381 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:51.742234  8381 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:51.618258  8391 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 12:21:51.743249  8391 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:51.743605  8391 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:51.744398  8391 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.745575  8391 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:51.717170  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.718465  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.721697  4989 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:51.661603  8274 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 12:21:51.725960  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.727172  8179 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:51.709717  8341 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.715818  8352 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:51.768543  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 51466.8us
I20260709 12:21:51.732944  4253 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:51.735095  8415 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.707122  8355 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:21:51.783684  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.691325  8363 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:21:51.695156  8287 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:21:51.792253  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.792933  4247 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:51.793231  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.793960  4249 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:51.709642  8392 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:51.719058  8436 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:51.802582  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.711975  8421 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:51.764571  8179 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:51.719462  7951 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.775030  8381 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.721320  8379 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:51.785818  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:51.786794  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:51.695389  8428 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.784219  4256 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:51.783448  8406 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:51.704396  8398 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.808315  4252 raft_consensus.cc:2368] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:51.769656  8142 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.814399  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.724288  8439 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:21:51.821671  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.903946  4254 raft_consensus.cc:2376] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13. Re-sending same reply.
I20260709 12:21:51.828083  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.830595  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:51.905287  4402 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:21:51.905706  4402 pending_rounds.cc:85] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 9
I20260709 12:21:51.905987  4402 pending_rounds.cc:107] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:21:51.906271  4402 raft_consensus.cc:2889] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:51.882714  4405 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:21:51.880450  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.913167  4250 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.915138  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.820922  8436 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:51.808365  7774 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
W20260709 12:21:51.925832  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 95319.9us
I20260709 12:21:51.930850  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.927510  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:51.879313  8396 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.814393  8324 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:21:51.723955  8357 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.935765  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:51.879051  8406 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:51.940523  8434 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:51.941215  8434 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:51.942288  8434 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:51.942750  4990 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
W20260709 12:21:51.951928  8446 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:21:51.956525  4253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1974) took 2228 ms (client timeout 2647 ms). Trace:
I20260709 12:21:51.957216  8391 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.956936  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.957729  8391 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.958810  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.959638  8320 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.959396  4256 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:51.960162  8320 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.960515  8436 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:51.956919  4253 rpcz_store.cc:269] 0709 12:21:49.728028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.728146 (+   118us) service_pool.cc:224] Handling call
0709 12:21:51.956335 (+2228189us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54001c7d54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:51.956433 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4495765888}
I20260709 12:21:51.962455  8320 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.964323  4256 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:51.944253  8396 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.973517  8396 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:51.932375  8410 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:51.974541  8410 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:51.975495  4151 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:51.976167  8410 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.978227  8272 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.980448  7951 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.980762  8352 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.982273  8428 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:51.985857  4248 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:21:51.986343  8002 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:51.988288  8390 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:51.938154  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:51.987205  4248 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:21:51.991842  4254 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:51.946556  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.992859  4250 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:51.997076  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:51.977442  4151 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 7 to 8, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 8 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.932647  7967 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:52.006542  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:52.007158  4334 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:21:51.945672  8406 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:51.945850  8304 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:21:52.011158  4153 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 390) took 26409 ms (client timeout 15000 ms). Trace:
I20260709 12:21:51.996305  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.013104  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:51.908385  8142 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.017753  4151 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 8, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 8 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.978917  8272 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:51.929498  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 258465us
I20260709 12:21:52.028191  4334 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:52.026324  4257 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:52.029886  4248 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:52.033653  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.036260  4257 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:21:52.045318  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.048092  4254 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:52.029435  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.051604  4255 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:51.946065  8092 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.054543  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.057533  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.058295  4403 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.056125  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.057475  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.077252  4151 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 9, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 9 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:52.080138  4400 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:21:52.021442  8357 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.020750  8339 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:52.061841  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.115357  4408 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.085229  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:51.932909  8179 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:52.119669  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 367615us
I20260709 12:21:51.991979  8421 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.116191  4325 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.118050  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:52.055734  8354 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:52.112948  4151 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 4 to 6, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:52.134414  4334 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:52.135106  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.139818  4333 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:52.143736  4151 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.051653  8365 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:21:52.190824  4151 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 10, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 10 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.193495  8272 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.194487  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:52.194913  8456 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:52.195252  4252 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
W20260709 12:21:52.204190  8452 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 12:21:52.205979  8432 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:52.206180  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.207748  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.119489  8339 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:52.229079  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.229729  4334 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:52.227000  4151 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 10 to 12, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.174760  8354 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:21:52.216102  8394 consensus_meta.cc:287] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.004s
I20260709 12:21:52.119432  8428 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:52.227797  8339 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.253182  8092 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:52.268066  4403 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:52.248831  8394 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.270453  8394 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:52.274317  8424 consensus_meta.cc:287] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.003s
I20260709 12:21:52.274736  8424 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.268183  8462 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.276731  8142 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.131372  8391 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.315490  4151 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.136809  8341 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:52.333127  4330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.015s
W20260709 12:21:52.333529  4330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.013s	sys 0.016s
W20260709 12:21:52.320134  4249 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.007s
I20260709 12:21:52.339871  4249 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:52.340698  4256 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:52.341818  4408 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:21:52.342972  4402 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
W20260709 12:21:52.347342  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.351447  4151 catalog_manager.cc:5697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 5 to 7, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:52.392565  4151 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 5 to 6, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:52.323501  8142 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.359246  8168 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.054s	sys 0.084s
I20260709 12:21:52.249666  8365 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:52.392167  8274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.016s	sys 0.030s
I20260709 12:21:52.321848  8428 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:52.322578  8462 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:52.404906  8168 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.055s	sys 0.084s
W20260709 12:21:52.415882  4401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.017s	sys 0.013s
W20260709 12:21:52.430084  4401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.018s	sys 0.013s
I20260709 12:21:52.420593  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:21:52.407639  8274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.017s	sys 0.030s
W20260709 12:21:52.011710  4153 rpcz_store.cc:269] 0709 12:21:25.562695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:25.571987 (+  9292us) service_pool.cc:224] Handling call
0709 12:21:25.909178 (+337191us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:51.971247 (+26062069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:46.956313 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:46.957220 (+   907us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:46.957286 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:21:46.957328 (+    42us) tablet.cc:662] Decoding operations
0709 12:21:46.958716 (+  1388us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:46.958826 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:46.958866 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:21:47.073503 (+114637us) tablet.cc:701] Row locks acquired
0709 12:21:47.073595 (+    92us) write_op.cc:260] PREPARE: finished
0709 12:21:47.073829 (+   234us) write_op.cc:270] Start()
0709 12:21:47.073995 (+   166us) write_op.cc:276] Timestamp: P: 1783599707073754 usec, L: 0
0709 12:21:47.074046 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 12:21:47.074847 (+   801us) log.cc:844] Serialized 4307 byte log entry
0709 12:21:48.169020 (+1094173us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbadc740ac 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b
0709 12:21:48.866546 (+697526us) op_driver.cc:464] REPLICATION: finished
0709 12:21:49.066959 (+200413us) write_op.cc:301] APPLY: starting
0709 12:21:49.067074 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:49.188482 (+121408us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7b32a 00007fdbb0d00f14 00007fdbb0d00ec3 00007fdbb0d00e38 00007fdbb0d00df3 00007fdbb0d000dc 00007fdbb0d29e16 00007fdbb0d11cbb 00007fdbb0cfc39d 00007fdbb0cffd75
0709 12:21:49.418711 (+230229us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:49.449833 (+ 31122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:49.849983 (+400150us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:49.850469 (+   486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:21:49.850533 (+    64us) write_op.cc:312] APPLY: finished
0709 12:21:49.850956 (+   423us) log.cc:844] Serialized 105 byte log entry
0709 12:21:49.851198 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.851352 (+   154us) write_op.cc:454] Released schema lock
0709 12:21:49.851409 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:49.851912 (+   503us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:49.851943 (+    31us) write_op.cc:454] Released schema lock
0709 12:21:50.008264 (+156321us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b1800392200. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91522 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
Metrics: {"mutex_wait_us":32005,"reported_tablets":42,"spinlock_wait_cycles":367503104,"child_traces":[["op",{"apply.queue_time_us":192365,"apply.run_cpu_time_us":24009,"apply.run_wall_time_us":784948,"cfile_cache_hit":42,"cfile_cache_hit_bytes":43890,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":79252,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":11,"prepare.queue_time_us":552893,"prepare.run_cpu_time_us":76867,"prepare.run_wall_time_us":1543501,"raft.queue_time_us":37825,"raft.run_cpu_time_us":13926,"raft.run_wall_time_us":504697,"replication_time_us":1710606,"spinlock_wait_cycles":102327936,"thread_start_us":1797266,"threads_started":4,"wal-append.queue_time_us":1610243,"wal-append.run_cpu_time_us":5815,"wal-append.run_wall_time_us":2132149}]]}
I20260709 12:21:52.402894  8466 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.446663  4325 raft_consensus.cc:2468] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:21:52.410698  8341 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:52.451031  4151 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:52.434199  8473 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:52.448140  8461 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:21:52.457971  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 340054us
I20260709 12:21:52.406800  8142 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.400555  8354 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:52.445312  8202 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:52.464468  4151 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.454972  8387 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.482870  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.410460  8365 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:52.487080  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.444936  8339 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:52.487166  4151 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 4 to 5, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 5 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.490551  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:52.495357  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:52.497746  8462 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:52.457937  8341 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.487692  8387 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.510200  4151 catalog_manager.cc:5697] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.489895  8202 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:52.509805  8469 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.524119  8359 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.485363  8391 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:21:52.529898  4151 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 7, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 7 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.534049  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.534651  4330 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:52.534699  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 619581us
I20260709 12:21:52.535655  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.536892  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.484405  8466 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:21:52.482415  8473 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:52.543573  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1168) took 1183 ms. Trace:
I20260709 12:21:52.547273  4250 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:52.542631  4219 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.545392  4985 rpcz_store.cc:276] 0709 12:21:51.360051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.380686 (+ 20635us) service_pool.cc:224] Handling call
0709 12:21:51.380975 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:51.381200 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:21:51.667151 (+285951us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.543236 (+876085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:52.543285 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:52.543345 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.543403 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.543517 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567808,"prepare.queue_time_us":340232,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":615926,"threads_started":2,"wal-append.queue_time_us":536688}
I20260709 12:21:52.553342  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.527012  8424 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.527635  8398 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:52.570492  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.581341  4254 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:52.530503  8481 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:52.538225  8281 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.544771  8391 consensus_queue.cc:1243] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 11.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:21:52.583190  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 86498.2us
I20260709 12:21:52.530817  8480 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:52.526494  8304 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:52.552426  8462 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:52.598359  4407 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:52.590047  4151 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 1 to 7, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 7 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:52.528501  8365 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:52.555107  7967 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:52.543800  8284 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:21:52.587896  8352 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.538579  8482 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:21:52.629333  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.625391  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.544083  8359 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.620679  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.621196  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.621981  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.616267  4151 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 2 to 6, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:52.522157  8428 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.625897  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.634274  4403 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:52.588157  8146 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:52.593444  8354 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:52.630156  4404 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:52.632440  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.630645  4409 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:52.633621  4990 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
W20260709 12:21:52.635862  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:52.601794  8396 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:52.546734  8469 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:21:52.608183  8415 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:52.601069  8029 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:52.639544  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.609674  7967 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.646051  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:52.649642  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 117811us
I20260709 12:21:52.646106  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:52.646304  4255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1977) took 1346 ms (client timeout 1623 ms). Trace:
I20260709 12:21:52.650602  4984 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
W20260709 12:21:52.650565  4255 rpcz_store.cc:269] 0709 12:21:51.299942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.303959 (+  4017us) service_pool.cc:224] Handling call
0709 12:21:52.646144 (+1342185us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000dfa54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:52.646252 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609224448}
I20260709 12:21:52.622785  8480 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:52.648707  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.633060  8352 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.647969  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.652676  8480 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.654894  8352 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.643280  8396 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:52.656272  8396 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:52.645352  8354 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:52.657984  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.658409  8354 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:52.659337  8474 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:21:52.659874  8472 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:21:52.607913  8391 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:21:52.675226  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.677400  4296 leader_election.cc:400] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:52.677752  4296 leader_election.cc:403] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:52.678077  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2688) took 1222 ms. Trace:
I20260709 12:21:52.664721  4400 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:52.679329  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.656287  8339 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:52.684098  4404 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:52.685276  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.686978  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.688838  4404 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:52.638275  4151 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 3 to 8, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 8 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.691537  4151 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 7, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 7 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.678501  4327 rpcz_store.cc:276] 0709 12:21:51.455950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.456093 (+   143us) service_pool.cc:224] Handling call
0709 12:21:51.456473 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.540959 (+ 84486us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:21:51.813910 (+272951us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.543331 (+729421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.551440 (+  8109us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.551646 (+   206us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:21:52.551696 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.551788 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.663919 (+112131us) raft_consensus.cc:1685] finished
0709 12:21:52.663958 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.678007 (+ 14049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84079,"prepare.queue_time_us":202699,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":147097,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":18613,"spinlock_wait_cycles":5500160,"thread_start_us":883838,"threads_started":3,"wal-append.queue_time_us":660831}
I20260709 12:21:52.684247  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.694065  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:52.712852  4249 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:52.695613  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:52.715267  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.715735  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:52.696594  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:52.716806  4247 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:52.610445  8202 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.698747  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.665360  7967 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.676220  8486 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:52.693790  8464 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:21:52.700810  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.702520  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.704732  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.706251  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.732286  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.732422  4409 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:52.698380  8478 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:52.707811  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.708835  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:52.812649  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.684753  8381 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:21:52.703286  8475 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:21:52.707625  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:52.719141  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 82069.7us
I20260709 12:21:52.722743  4404 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:52.704876  8491 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:21:52.725939  4991 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:21:52.701556  8142 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.726948  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.718209  4407 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:52.793673  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.725988  8339 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:52.781852  4989 raft_consensus.cc:2393] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:52.781606  8284 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.784159  4328 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:52.837030  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:52.815148  8479 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.004s
I20260709 12:21:52.803375  4247 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:52.781899  4992 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:52.795644  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.804450  4986 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:52.782028  4985 raft_consensus.cc:2368] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:52.790700  4990 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:52.790424  4249 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:52.714825  8341 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:52.696681  8304 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.765579  8486 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.679234  8029 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:52.826675  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 256294us
I20260709 12:21:52.849318  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.850240  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:52.829521  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 114307us
I20260709 12:21:52.830333  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.831983  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.834426  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:52.851751  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.854163  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.854995  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.855902  4330 raft_consensus.cc:2410] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:21:52.856019  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:52.858171  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.859720  4249 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:52.868328  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 841) took 1401 ms. Trace:
I20260709 12:21:52.868696  8341 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.869485  8341 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:52.868759  4253 rpcz_store.cc:276] 0709 12:21:51.466704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.961577 (+494873us) service_pool.cc:224] Handling call
0709 12:21:51.961898 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:51.962240 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.962269 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:51.962896 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 12:21:52.327746 (+364850us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:21:52.562051 (+234305us) log.cc:844] Serialized 14 byte log entry
0709 12:21:52.862338 (+300287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.868068 (+  5730us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.868111 (+    43us) raft_consensus.cc:1685] finished
0709 12:21:52.868126 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.868259 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23321,"prepare.queue_time_us":268792,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3889,"raft.queue_time_us":32246,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"thread_start_us":788938,"threads_started":3,"wal-append.queue_time_us":489900}
I20260709 12:21:52.892588  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.894529  4404 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:52.895725  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.898906  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.845867  8354 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:52.899556  4989 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:52.903833  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.904626  4989 raft_consensus.cc:2393] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:21:52.905092  8476 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:21:52.905356  8489 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.905874  8489 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:52.906663  8484 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:21:52.853852  8473 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:52.909583  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.855026  8042 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.911027  4989 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:21:52.904577  8501 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:52.860563  8478 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.860671  8142 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:52.899025  8490 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:21:52.912706  4332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2375) took 1371 ms. Trace:
W20260709 12:21:52.917069  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 190214us
I20260709 12:21:52.918195  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:52.919314  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 65250.9us
I20260709 12:21:52.919485  8372 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:52.956132  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:52.845721  8284 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.860672  8496 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:21:52.960856  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:52.961114  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.967144  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.967523  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.961225  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.958847  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:52.967926  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.901479  8359 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:52.916373  8487 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 12:21:52.899022  8363 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:52.965137  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:52.958827  4332 rpcz_store.cc:276] 0709 12:21:51.541405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.610692 (+ 69287us) service_pool.cc:224] Handling call
0709 12:21:51.623902 (+ 13210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:51.634307 (+ 10405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:51.634340 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:51.649363 (+ 15023us) log.cc:844] Serialized 26 byte log entry
0709 12:21:52.031044 (+381681us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:52.031081 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:52.031147 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:52.912449 (+881302us) raft_consensus.cc:1685] finished
0709 12:21:52.912479 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:52.912638 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10032,"raft.queue_time_us":15034,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":18457,"thread_start_us":324600,"threads_started":1,"wal-append.queue_time_us":739693}
I20260709 12:21:52.966130  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:52.970793  4249 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:52.884482  8415 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:21:52.972843  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.973771  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.914249  8501 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:52.968122  4331 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:52.981750  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.975540  4404 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:52.976497  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:52.985726  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:52.974747  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 106669us
I20260709 12:21:52.978211  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:52.978711  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:52.956797  8381 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:52.916210  8281 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:52.968550  8372 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:52.977727  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:52.966969  8394 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.995620  4372 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:52.996214  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:52.915702  8354 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.013480  8423 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:53.014050  8423 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:52.978554  8390 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:53.015252  8354 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.016112  8042 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.016535  8042 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.016885  8042 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.018647  8504 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:52.988296  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.020871  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:53.022202  8494 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:21:52.984061  8501 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:53.023784  8341 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:53.024391  8341 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:53.025359  8341 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:53.008145  8281 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:52.978318  8360 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:21:52.969166  8478 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.029229  4372 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.022204  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:53.037791  4372 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.014928  8423 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.054323  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 858) took 1282 ms. Trace:
I20260709 12:21:53.057083  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:53.056071  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48752.5us
I20260709 12:21:53.058230  4989 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:53.054100  4409 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:53.063040  8497 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:53.066563  8497 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:21:53.069094  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:53.070102  8339 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:53.024397  8502 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:53.057178  4405 rpcz_store.cc:276] 0709 12:21:51.758589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.758723 (+   134us) service_pool.cc:224] Handling call
0709 12:21:53.034303 (+1275580us) spinlock_profiling.cc:243] Waited 98.1 ms on lock 0x7b54003773d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.034409 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225613056}
I20260709 12:21:53.009574  8363 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:21:53.074352  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 52218.1us
I20260709 12:21:53.047631  8142 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.092375  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.003809  8507 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:53.027617  8360 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:53.071548  8287 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.011351  8489 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.035621  8381 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.101754  8360 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:53.102346  8500 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:21:53.027634  8281 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.105247  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1993) took 1318 ms. Trace:
I20260709 12:21:53.105717  4248 rpcz_store.cc:276] 0709 12:21:51.786439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.998507 (+212068us) service_pool.cc:224] Handling call
0709 12:21:52.029730 (+ 31223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.030262 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.105065 (+1074803us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54002e1150. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.105190 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71120256}
I20260709 12:21:53.107019  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 843) took 1639 ms. Trace:
I20260709 12:21:53.107522  4256 rpcz_store.cc:276] 0709 12:21:51.467254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.965049 (+497795us) service_pool.cc:224] Handling call
0709 12:21:52.340509 (+375460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:52.359208 (+ 18699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.106792 (+747584us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000852d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.106952 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862810880}
I20260709 12:21:53.111424  8363 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:53.089227  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:53.114727  4955 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.116227  8029 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.116806  8029 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:53.116595  8363 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.117343  8029 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:53.098366  8507 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.118044  8507 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.118196  8029 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.035813  8469 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.078329  8505 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:53.095129  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 83329.3us
I20260709 12:21:53.123010  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:53.079603  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 103177us
I20260709 12:21:53.093659  8260 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:53.078955  8466 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:53.119516  8469 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.074891  8394 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:21:53.126560  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.132185  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.096385  8142 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.135672  8284 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.137288  8486 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:53.137707  8406 consensus_meta.cc:287] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.116s	user 0.010s	sys 0.001s
I20260709 12:21:53.138092  8406 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:53.139627  8387 consensus_meta.cc:287] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 12:21:53.140038  8387 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.142318  8042 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.116220  8398 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:21:53.145010  8379 consensus_meta.cc:287] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.233s	user 0.011s	sys 0.000s
I20260709 12:21:53.056368  8478 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.145390  8379 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.146472  4406 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:53.146970  8478 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.147562  8506 consensus_queue.cc:1059] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:21:53.148447  8506 raft_consensus.cc:3055] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:53.148767  8506 raft_consensus.cc:740] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:53.149505  8506 consensus_queue.cc:260] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.150758  8506 raft_consensus.cc:3060] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:21:53.150843  8357 consensus_meta.cc:287] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.035s	user 0.000s	sys 0.011s
I20260709 12:21:53.151662  8142 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.151569  8339 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.154619  4986 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:53.155097  4255 raft_consensus.cc:1240] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:21:53.157142  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.159886  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:53.161006  8165 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:21:53.164006  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 113984us
I20260709 12:21:53.177912  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.180030  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.181361  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.121786  8508 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.131188  8260 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.133248  8469 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.194363  4372 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.161688  8284 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.195608  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:53.198643  4256 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 6.
I20260709 12:21:53.199854  4252 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:53.200212  4256 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:21:53.195791  4986 raft_consensus.cc:1240] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:53.201005  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:53.132393  8355 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:53.196152  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 73222.9us
I20260709 12:21:53.206214  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.208109  4256 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 12:21:53.197355  4248 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:53.201651  4252 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:53.187901  8478 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:53.212345  4402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2632) took 1182 ms. Trace:
I20260709 12:21:53.191236  8260 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:53.217058  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:53.221378  4250 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:21:53.222956  4248 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:53.212769  4402 rpcz_store.cc:276] 0709 12:21:52.030024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.030134 (+   110us) service_pool.cc:224] Handling call
0709 12:21:53.212157 (+1182023us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.212290 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649302400}
I20260709 12:21:53.224594  8486 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:21:53.227140  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.226385  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:53.230952  4254 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:53.164144  8398 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:21:53.197301  8515 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.241492  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.215065  8365 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.247568  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.320958  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.323175  4405 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:21:53.196295  7967 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:53.361595  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.361780  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.363034  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.363783  4984 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
W20260709 12:21:53.367556  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 163653us
I20260709 12:21:53.368386  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.321497  7973 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.378736  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.379927  4986 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.401575  8512 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.403158  8168 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.330740  8365 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.412155  4986 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:53.119809  8501 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.408231  4254 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:21:53.350958  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.418380  4402 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:53.320587  7951 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.252425  8406 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.413096  4247 raft_consensus.cc:2368] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:53.234086  8511 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.414187  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:53.198179  8508 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.337153  8521 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.317471  8398 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:53.406104  8042 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:53.433761  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 71445.7us
I20260709 12:21:53.411676  7973 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.417150  8365 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:53.468176  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 54047.5us
I20260709 12:21:53.474200  8092 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.485731  8421 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.485867  8092 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.486415  8421 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.488157  8092 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:53.489400  8421 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:53.489566  8520 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:21:53.491056  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2008) took 1452 ms. Trace:
I20260709 12:21:53.492558  8501 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.491467  4257 rpcz_store.cc:276] 0709 12:21:52.038212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.038372 (+   160us) service_pool.cc:224] Handling call
0709 12:21:52.038720 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:52.039172 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:52.039212 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:52.039791 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:21:53.111386 (+1071595us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18004284a0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:21:53.155184 (+ 43798us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:21:53.155224 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.155289 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:53.490743 (+335454us) raft_consensus.cc:1685] finished
0709 12:21:53.490766 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:53.490987 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":15633,"spinlock_wait_cycles":8530816,"thread_start_us":23006,"threads_started":1,"wal-append.queue_time_us":1149642}
I20260709 12:21:53.493794  8421 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.494341  8421 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.496943  8421 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.477994  8521 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.505532  8521 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.246750  8515 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.511909  8515 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.426586  8372 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.512367  7967 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.512924  8372 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:53.477695  8396 consensus_meta.cc:287] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.821s	user 0.008s	sys 0.004s
I20260709 12:21:53.474356  8398 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:53.478623  8355 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.498705  8507 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.431994  7951 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.415714  8168 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:53.519830  8428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.011s	sys 0.009s
I20260709 12:21:53.534413  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:53.415463  8512 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:53.533839  8428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.011s	sys 0.009s
I20260709 12:21:53.519131  8396 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.536041  8515 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.557945  4326 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:53.561776  4296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.132:43853 timed out after 1.578s (SENT) [suppressed 9 similar messages]
I20260709 12:21:53.562822  4408 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:53.567093  4988 raft_consensus.cc:2368] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12.
I20260709 12:21:53.567127  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.573169  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.556468  8508 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.574585  4409 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:53.557713  8304 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:53.560388  8406 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:21:53.558513  8491 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:53.551278  8339 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:21:53.564697  8363 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:53.609169  8387 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:53.611085  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.611465  8363 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:53.612190  8165 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.612725  8165 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:53.614274  8363 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:53.615324  8523 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:21:53.615983  4331 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:53.616340  4331 pending_rounds.cc:85] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:21:53.616559  4331 pending_rounds.cc:107] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:53.616768  4331 raft_consensus.cc:2889] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:53.617651  8168 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.625353  4406 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:53.561012  8515 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.550432  8398 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.633924  4326 raft_consensus.cc:2410] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:21:53.591012  8508 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.640759  8505 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:53.640857  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.641407  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.642688  8142 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:53.655438  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.656055  4327 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:53.644505  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:53.645712  8532 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:53.637332  8372 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:21:53.649658  8515 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.651077  8512 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:53.651778  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 89913.7us
I20260709 12:21:53.653771  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.655336  4404 raft_consensus.cc:2410] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:53.643718  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.658625  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.661888  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.606837  8491 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:53.662611  4407 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:53.666548  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.662042  8365 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.669462  8365 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.671512  4249 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:21:53.673135  4402 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:53.673765  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.660490  8398 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:53.673486  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.679915  4405 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:53.660172  8372 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:53.664250  8423 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.686519  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.652349  8469 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.653841  8508 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:53.689667  7951 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.674603  8406 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:53.672808  8528 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:21:53.674787  8507 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.697404  4407 raft_consensus.cc:2368] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:53.704342  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.705549  4986 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.694537  8406 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.696799  8528 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.708473  8406 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:53.708602  8528 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:53.709213  8142 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.681694  8260 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.711585  4983 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:53.712136  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.712910  4991 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.713696  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.713773  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.714466  4991 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.690896  8423 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.711601  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.718349  4405 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.715056  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.717070  4991 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:53.719650  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.706916  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.723345  4986 raft_consensus.cc:2368] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:53.720319  4400 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:21:53.724056  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2644) took 1038 ms. Trace:
I20260709 12:21:53.725310  4404 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:21:53.727083  4986 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:53.724400  4400 rpcz_store.cc:276] 0709 12:21:52.685296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.704828 (+1019532us) service_pool.cc:224] Handling call
0709 12:21:53.723999 (+ 19171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:53.728470  4986 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:21:53.734349  4405 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:53.704295  8396 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.737556  8002 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.738147  8508 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.739326  8423 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.740224  8469 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.704685  8515 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.741287  8515 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:53.750334  8434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.287s	user 0.000s	sys 0.018s
I20260709 12:21:53.698868  8372 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.750515  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.751718  4991 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:53.753012  4991 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:53.750528  4983 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 12. Current term is 13. Ops: [12.13-12.13]
W20260709 12:21:53.751137  8434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.000s	sys 0.019s
I20260709 12:21:53.743579  8515 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.753950  4991 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.758704  4991 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:53.759148  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.752388  8396 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.761622  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.766204  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.756290  8372 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:21:53.781610  4985 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.782534  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.783675  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.784437  8379 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.784313  8528 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.785041  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.785730  4983 raft_consensus.cc:2368] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:53.758790  8260 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.774875  4400 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:53.775950  8392 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:21:53.778144  8505 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:53.778473  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.779839  4991 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:21:53.784305  4985 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.792590  8392 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:53.781525  8396 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.793989  8392 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.795224  8381 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:53.795501  8396 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:53.795831  8381 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.798815  4986 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:53.799238  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.799423  8392 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:53.798081  8381 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.803546  8491 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:53.805434  8505 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.807403  8505 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.808853  8483 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:53.809269  8483 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:53.809484  8528 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.811367  4983 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:21:53.810040  8483 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.815282  8483 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:53.815609  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.816238  4406 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:53.816359  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2010) took 1138 ms. Trace:
I20260709 12:21:53.816742  4255 rpcz_store.cc:276] 0709 12:21:52.677973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.678123 (+   150us) service_pool.cc:224] Handling call
0709 12:21:52.678426 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.155533 (+477107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.816122 (+660589us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54002670d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:53.816303 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095738752}
W20260709 12:21:53.821556  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.824534  7774 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.824612  8406 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.825209  7774 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.826144  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.826747  4409 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:53.826830  4404 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:21:53.827700  7774 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:53.829450  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.831923  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 898) took 1124 ms. Trace:
I20260709 12:21:53.832110  4984 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:53.832319  4988 rpcz_store.cc:276] 0709 12:21:52.707176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.707288 (+   112us) service_pool.cc:224] Handling call
0709 12:21:53.831703 (+1124415us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54007422d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.831842 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704580480}
I20260709 12:21:53.833539  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1191) took 1035 ms. Trace:
I20260709 12:21:53.833871  4984 rpcz_store.cc:276] 0709 12:21:52.797741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.381461 (+583720us) service_pool.cc:224] Handling call
0709 12:21:53.831859 (+450398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.832555 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.833360 (+   805us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54007422d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.833481 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034777344}
I20260709 12:21:53.837604  4400 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:53.840909  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.812691  8165 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.844619  4406 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:21:53.847664  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.848254  4331 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:53.849120  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.849908  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.850615  4333 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.851758  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:53.852066  8527 log.cc:927] Time spent T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.299s	user 0.000s	sys 0.005s
I20260709 12:21:53.852366  8499 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:53.852746  8499 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:53.852048  8165 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.853601  8499 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:53.854470  8499 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:53.855593  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.860268  8353 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:53.860371  8406 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:53.860684  8513 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.523s	user 0.004s	sys 0.002s
I20260709 12:21:53.860903  8353 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.871644  8179 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:53.872411  8353 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:53.874496  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:53.879370  4992 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:21:53.880179  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:53.881773  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.882381  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.884217  4326 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.884151  8525 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:53.884776  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.886179  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.889021  8353 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.889817  8353 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:53.890228  8353 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.892661  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:53.893263  4252 raft_consensus.cc:2376] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6. Re-sending same reply.
I20260709 12:21:53.894202  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.895167  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.895401  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.895483  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.895975  4992 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:53.894162  4326 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:53.896627  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.897368  4986 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:53.897667  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:53.898528  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.900179  4331 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:21:53.904707  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 865) took 1013 ms. Trace:
I20260709 12:21:53.905113  4408 rpcz_store.cc:276] 0709 12:21:52.891780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.896868 (+  5088us) service_pool.cc:224] Handling call
0709 12:21:53.215577 (+318709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:53.563866 (+348289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.903550 (+339684us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:53.904519 (+   969us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54002b66d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:53.904647 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530044032}
I20260709 12:21:53.908509  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.910730  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:53.911518  8354 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:53.911881  8354 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:53.912251  8354 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:53.898535  4333 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:53.916311  4252 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:21:53.919061  4255 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:53.887153  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:53.952757  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:53.955684  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.932935  8353 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:53.968725  4988 raft_consensus.cc:2410] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:53.955372  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.920475  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:53.969623  4992 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:53.969923  4252 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:21:53.939925  4257 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:21:53.958410  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:53.921622  4250 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:21:53.933445  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:53.950146  4408 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:21:53.919822  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:53.977550  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:53.965579  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.976162  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:53.981561  4331 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:53.981861  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:53.982779  4250 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:53.983153  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.984131  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.977644  4219 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:53.994192  4956 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:53.987890  8501 raft_consensus.cc:2764] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:21:54.000418  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:53.988165  8436 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:21:53.997112  8406 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:21:53.993086  8528 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:54.010452  8528 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.010953  8528 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:53.993103  8496 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:54.011870  4327 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:21:54.015553  4327 pending_rounds.cc:85] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 5
I20260709 12:21:54.015987  4327 pending_rounds.cc:107] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:21:54.016270  4327 raft_consensus.cc:2889] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:53.995752  8165 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:53.987236  8353 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.018570  4405 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:53.999387  8396 raft_consensus.cc:2804] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:54.017637  8354 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.039060  8498 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:54.039531  8498 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:54.040323  8354 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.015532  8496 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.058025  8496 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:54.044215  8410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.629s	user 0.031s	sys 0.031s
W20260709 12:21:54.058961  8410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.646s	user 0.031s	sys 0.031s
I20260709 12:21:54.003569  8372 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:21:54.064174  4255 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:54.049841  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:54.040462  8498 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:54.070667  8498 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.026675  8436 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:54.035647  8260 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:21:54.036975  8165 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:54.080900  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:54.085459  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:54.083201  4403 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.042812  8396 raft_consensus.cc:697] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:54.099123  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.100302  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.085157  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:54.262934  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.275876  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 275499us
W20260709 12:21:54.283002  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.292022  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:54.294515  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 209122us
I20260709 12:21:54.261662  8354 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:54.262169  8381 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:54.295269  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:21:54.300877  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 215784us
I20260709 12:21:54.273792  8260 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.305714  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.275678  8495 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:54.308138  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:54.329993  4401 raft_consensus.cc:2410] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:54.275151  8372 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:21:54.313088  8359 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:54.297598  7967 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:54.302722  8428 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:54.301077  8473 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.336741  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:54.385926  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49260us
I20260709 12:21:54.386720  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:54.387702  4296 leader_election.cc:400] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:54.387981  4296 leader_election.cc:403] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:21:54.298349  8354 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.301760  8381 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:54.346259  8499 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:54.348881  8546 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:54.309717  8406 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:54.418615  8406 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:54.402117  8354 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.423807  8381 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.425221  8381 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:54.275346  8434 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 12:21:54.435829  8544 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:21:54.351009  7967 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:54.437099  7967 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:54.437976  8528 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.351158  8146 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:54.439644  8146 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:54.440611  8146 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.397176  8410 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:54.443734  8528 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:54.332808  8547 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:21:54.397004  8202 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:54.390458  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.399971  4249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 857) took 1200 ms. Trace:
I20260709 12:21:54.318307  8260 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.377874  8436 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.447095  8260 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:54.413784  8533 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.791s	user 0.010s	sys 0.023s
I20260709 12:21:54.350571  8396 consensus_queue.cc:237] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.448804  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2022) took 1228 ms. Trace:
I20260709 12:21:54.449150  4253 rpcz_store.cc:276] 0709 12:21:53.220310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.220515 (+   205us) service_pool.cc:224] Handling call
0709 12:21:53.247882 (+ 27367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.248227 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:53.248257 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:53.308180 (+ 59923us) log.cc:844] Serialized 26 byte log entry
0709 12:21:53.526615 (+218435us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:21:53.526671 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:53.526764 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:54.413283 (+886519us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:21:54.448513 (+ 35230us) raft_consensus.cc:1685] finished
0709 12:21:54.448534 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:54.448749 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14963,"raft.queue_time_us":5041,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":33078,"spinlock_wait_cycles":23762304,"thread_start_us":97898,"threads_started":1,"wal-append.queue_time_us":177796}
I20260709 12:21:54.443813  8410 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:54.398733  8428 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.451664  8410 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.453118  8428 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.323014  8495 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.455366  8495 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.342849  8501 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:54.455924  4249 rpcz_store.cc:276] 0709 12:21:53.199891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:53.200683 (+   792us) service_pool.cc:224] Handling call
0709 12:21:53.201074 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:53.671907 (+470833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:54.399650 (+727743us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b540039e9d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:54.399901 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081445632}
I20260709 12:21:54.376446  4403 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:54.396524  8372 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:21:54.396775  8430 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.481992  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:54.485395  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:54.488647  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:54.489472  4405 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:54.385788  8029 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 12:21:54.498014  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.499646  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:54.501408  8406 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.343236  8165 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:54.515844  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 339060us
I20260709 12:21:54.508033  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:54.401432  8473 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:54.517069  4334 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:54.517464  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.527748  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.518265  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 199685us
I20260709 12:21:54.529582  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:54.529614  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.529738  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 233686us
I20260709 12:21:54.532483  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:54.533226  4253 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.534710  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:54.535097  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:54.536569  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.536444  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:54.537307  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.538609  4989 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.538306  4249 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:54.543053  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:54.543807  4333 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:54.491967  8372 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:54.571708  4253 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:54.503759  8260 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.577693  4257 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:21:54.580410  4250 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:21:54.581876  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:54.583948  8556 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:54.585357  8557 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:54.589753  4989 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:54.515916  8353 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:54.598531  4334 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:54.526693  8202 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.543617  8508 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:54.599687  8092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.009s	sys 0.009s
I20260709 12:21:54.617151  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:54.562805  8511 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:21:54.625501  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:54.615008  8092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.009s
I20260709 12:21:54.614230  8202 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.624511  8168 consensus_queue.cc:1059] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:21:54.635540  8528 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:54.644027  8528 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.646739  8528 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:54.629382  8496 consensus_meta.cc:287] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 12:21:54.609370  8260 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.613787  8353 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:54.657389  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.618996  8508 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:54.664533  4247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 2000) took 1868 ms (client timeout 1517 ms). Trace:
W20260709 12:21:54.665112  4247 rpcz_store.cc:269] 0709 12:21:52.796576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.841303 (+ 44727us) service_pool.cc:224] Handling call
0709 12:21:54.664264 (+1822961us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54000618d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:54.664422 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279331584}
I20260709 12:21:54.673415  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2646) took 1707 ms. Trace:
I20260709 12:21:54.673848  4401 rpcz_store.cc:276] 0709 12:21:52.966145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:52.966471 (+   326us) service_pool.cc:224] Handling call
0709 12:21:54.673208 (+1706737us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400285354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:54.673352 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3086071040}
I20260709 12:21:54.656894  8496 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.740188  8202 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.748452  8353 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:54.749917  8260 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:54.751547  8508 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:54.672194  8495 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:21:54.761641  8179 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:54.762255  8179 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.765198  8179 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.656427  8372 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.780355  8473 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:54.781157  8473 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.781653  8473 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:54.787418  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.706360  8511 raft_consensus.cc:3055] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:54.790782  8511 raft_consensus.cc:740] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:54.791772  8511 consensus_queue.cc:260] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.794456  8496 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:54.801738  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 255136us
I20260709 12:21:54.803998  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:54.800217  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 410567us
W20260709 12:21:54.816708  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.817118  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.831717  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.840082  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.842342  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.843155  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 924) took 1044 ms. Trace:
I20260709 12:21:54.842984  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:54.844030  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 306100us
I20260709 12:21:54.843703  4990 rpcz_store.cc:276] 0709 12:21:53.798666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:54.834457 (+1035791us) service_pool.cc:224] Handling call
0709 12:21:54.843092 (+  8635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:21:54.847317  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.850081  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:54.855877  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:54.856712  4328 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:54.856742  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.857646  4986 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:54.858165  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:54.858619  4989 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:54.828105  8359 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:54.864356  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.865027  4989 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:54.865533  4989 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:54.866467  4989 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.867237  8548 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.849149  8525 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:54.867417  8398 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:21:54.848204  8436 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:54.867792  8548 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.835952  8354 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.864852  8260 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:54.848065  8410 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:54.843009  7967 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.849586  8430 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:54.858431  8424 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.863715  8557 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:54.865460  8381 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:21:54.868742  8473 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:54.868885  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.870028  8499 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:54.871737  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.871384  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.872380  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.930882  4990 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:54.931006  4986 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.873015  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.931850  4992 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:54.933736  8354 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.933939  7967 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:54.921754  8424 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.873617  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.874351  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:54.936906  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 65610.8us
I20260709 12:21:54.938452  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:54.861338  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.874971  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.876219  4983 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:21:54.939851  4983 pending_rounds.cc:85] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 8
I20260709 12:21:54.940120  4983 pending_rounds.cc:107] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 7.9
W20260709 12:21:54.940007  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 78740.2us
I20260709 12:21:54.940549  4983 raft_consensus.cc:2889] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:54.877183  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.870155  4989 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:54.870741  8353 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:54.870525  8359 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.851388  8556 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.844923  8560 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:54.851002  8528 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:54.893498  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.865465  4333 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:21:54.899495  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:54.955268  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:54.935611  8548 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:54.919200  8498 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.005s
I20260709 12:21:54.943518  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:54.947111  8381 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:54.935688  4985 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:21:54.954644  4329 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:21:54.922395  8260 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.958009  4332 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:54.958263  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.958488  4989 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:21:54.922334  8410 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.942462  8499 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:54.935578  8424 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:54.962617  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.947535  7967 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:54.948577  8354 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:54.951691  8556 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:54.941641  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:54.935932  8473 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:21:54.917387  8436 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.969213  4989 pending_rounds.cc:85] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 8
I20260709 12:21:54.986802  4989 pending_rounds.cc:107] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:21:54.964438  8560 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:54.972851  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:54.979269  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:54.979885  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.980365  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:54.983618  4984 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.994655  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.015125  4328 raft_consensus.cc:2410] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:21:54.969521  8396 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:21:55.017325  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.029208  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:54.980571  8353 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:54.963768  8029 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:54.959558  8528 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:54.987100  4989 raft_consensus.cc:2889] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:54.977368  8511 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:54.988430  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:55.029454  8496 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:54.969756  8548 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:21:55.031634  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 59154.5us
I20260709 12:21:55.032176  8558 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:54.984441  8556 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.067900  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:54.991909  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.068641  4250 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:55.034368  4988 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:55.036856  4986 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:55.041400  8353 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:54.986415  8430 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:54.983278  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.038825  8557 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.064319  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:55.076437  4249 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.065830  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:55.038532  8498 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.033563  8398 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.067500  4984 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:55.075078  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.089913  4332 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:55.093369  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:55.098704  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.061565  8558 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:55.106999  4325 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:55.043429  8560 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:21:55.047853  8354 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:21:55.115034  4249 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:55.047735  8029 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.070896  8202 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:21:55.105089  8566 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.119971  8552 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:55.108979  8558 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.153044  8092 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:55.165063  8092 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:55.154659  8406 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:55.155498  8508 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.156316  8571 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:55.158339  8562 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:21:55.159765  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:55.117806  8372 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.097469  8498 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.101787  8398 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:55.153034  8563 log.cc:927] Time spent T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:21:55.092835  8557 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:55.170892  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.159766  8410 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.164121  8552 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.168447  8568 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.190584  8168 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:55.195263  8260 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.103705  8146 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:21:55.160985  8566 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:55.251811  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 389249us
I20260709 12:21:55.212873  8552 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.191656  8406 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.193771  8508 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.188484  8353 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.198876  8372 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:55.194963  8571 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.273056  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.274792  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:55.275553  4986 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEARNER]: Advancing to term 8
W20260709 12:21:55.277709  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.258040  8381 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.287669  4986 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:55.283409  8528 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.294009  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:55.294535  4250 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:55.288790  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:55.289038  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 216034us
I20260709 12:21:55.258186  8168 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:55.290153  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 260997us
W20260709 12:21:55.289747  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 306546us
I20260709 12:21:55.305948  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:55.309475  4248 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:55.261940  8567 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:21:55.281370  8410 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:55.320266  4328 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:55.349502  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:55.359422  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44559.7us
I20260709 12:21:55.373497  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:55.386796  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.399012  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 457405us
W20260709 12:21:55.495893  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 186007us
W20260709 12:21:55.519681  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 196971us
I20260709 12:21:55.376668  8029 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:55.521050  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.521188  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.566905  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.376006  8179 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.612394  4331 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:55.612905  4296 leader_election.cc:400] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:21:55.383757  4329 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:55.440977  8570 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.614166  8570 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.614863  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:55.616027  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:55.616741  8570 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.574982  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.575840  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.578146  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.617762  8430 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:55.618287  4984 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:21:55.618353  8430 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:55.551190  8436 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.605408  4248 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:55.353868  8410 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.602144  8565 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:21:55.626248  8576 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 12:21:55.626678  8587 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:21:55.626987  8573 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 12:21:55.631585  8557 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:55.648583  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:55.685078  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.517479  8146 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:21:55.687769  8586 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:55.687922  8146 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:55.688359  8146 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:55.688321  8586 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:55.689431  8146 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.690637  8146 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.693179  8406 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:55.673039  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 94960.2us
I20260709 12:21:55.601720  8569 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.674961  8528 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.675621  8436 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:55.679150  8372 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.679461  8566 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.679621  8565 consensus_queue.cc:1243] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:21:55.680608  8556 consensus_meta.cc:287] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.003s
I20260709 12:21:55.681094  8582 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:55.682165  8430 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.620680  8498 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.695161  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:55.701067  4253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.004s	sys 0.004s
W20260709 12:21:55.701771  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 133333us
W20260709 12:21:55.631588  8575 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
W20260709 12:21:55.711032  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 350298us
W20260709 12:21:55.736105  8564 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.640s	user 0.003s	sys 0.000s
I20260709 12:21:55.736761  8499 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.687320  8583 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:21:55.694568  8588 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:55.766855  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.677353  8548 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:55.728777  8574 log.cc:927] Time spent T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.464s	user 0.001s	sys 0.000s
I20260709 12:21:55.694296  8168 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:55.690770  8586 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.771545  8092 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.694082  8587 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:55.772871  8092 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.774139  8587 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:55.632766  8179 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:55.765694  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 70610.6us
W20260709 12:21:55.758430  4253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.004s	sys 0.006s
I20260709 12:21:55.775650  4219 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:55.779057  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.782819  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.775019  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:55.759898  8508 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.757795  8556 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.787989  8565 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:55.789584  8556 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.767545  8589 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:21:55.790258  8410 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.791509  8557 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:55.791915  8557 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:55.792304  8557 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.759344  8582 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.795595  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.795954  4372 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:55.786434  8560 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:55.797071  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.797398  8582 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:55.798458  4372 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:55.799511  8585 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:55.799966  8585 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:55.800333  8585 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:55.721719  8569 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.802753  8578 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:55.803453  8359 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:55.786844  8548 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.807415  8566 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:55.807839  8566 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:55.808182  8566 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:55.808749  8548 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:55.812683  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.816587  8585 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.818958  8585 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:55.819054  8508 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.819623  8508 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.822831  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.825783  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.840513  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:55.846364  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63622.5us
I20260709 12:21:55.847285  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.845757  8466 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:55.859153  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:55.860298  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.874752  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:55.850324  8598 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:21:55.881848  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.882499  4989 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:55.882601  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.883373  4988 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:55.883536  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:55.837175  8560 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:55.884073  4992 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:55.892405  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:55.825278  8578 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:55.850835  8604 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:55.915572  4330 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:21:55.851038  8597 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:55.860689  8558 consensus_meta.cc:287] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.670s	user 0.005s	sys 0.005s
I20260709 12:21:55.893572  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:55.935454  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 70329.7us
I20260709 12:21:55.935899  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.937434  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.884688  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:55.938609  4984 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:55.874752  8473 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.879209  8029 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:55.944918  4992 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:55.945923  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.960546  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.965886  4330 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:21:55.966177  4327 raft_consensus.cc:2410] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:21:55.966310  4330 pending_rounds.cc:85] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 6
I20260709 12:21:55.966771  4330 pending_rounds.cc:107] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 12:21:55.966967  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 350987us
I20260709 12:21:55.967038  4330 raft_consensus.cc:2889] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:55.968901  4296 leader_election.cc:400] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:55.969236  4296 leader_election.cc:403] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:55.970350  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.973711  8596 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:21:55.974625  8596 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:55.923570  8496 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:55.912417  8495 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:55.980538  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:55.980787  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:55.981072  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:55.982420  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:55.989387  4404 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:21:55.989714  4402 raft_consensus.cc:1275] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:21:55.990075  4402 pending_rounds.cc:85] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 7
I20260709 12:21:55.990288  4402 pending_rounds.cc:107] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:21:55.990518  4402 raft_consensus.cc:2889] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:55.992069  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:55.945063  8565 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:21:55.992825  4400 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:21:55.953544  8354 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:55.955549  8583 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:55.922243  8548 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:21:56.011350  4407 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:55.969363  8525 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.004772  4409 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:21:56.004801  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:56.008939  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:56.015257  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:55.924407  8560 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.058183  8528 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:56.059866  8528 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:56.062467  8528 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.063485  8578 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.007931  8424 consensus_meta.cc:287] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.018s	user 0.012s	sys 0.000s
I20260709 12:21:56.068264  8424 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:55.991240  8587 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:21:56.070313  8424 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.005939  8592 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:21:56.071579  8179 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:56.012313  8597 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:21:55.995208  8604 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:55.991508  8430 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:55.967779  8473 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.041836  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 60856.1us
I20260709 12:21:56.040088  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.991703  8567 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.984756  8410 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8.
I20260709 12:21:55.984982  8466 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:55.985173  8586 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.079478  4331 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
W20260709 12:21:56.032626  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 332148us
I20260709 12:21:55.987952  8398 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:55.984200  8496 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:55.994711  8029 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:56.094311  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 54335.8us
I20260709 12:21:56.124243  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:56.095271  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:56.035032  8511 consensus_meta.cc:287] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.987s	user 0.009s	sys 0.003s
I20260709 12:21:55.956559  8558 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.112927  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:56.118511  8577 consensus_queue.cc:1059] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:56.121337  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:55.993350  8499 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:21:56.013583  8557 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:21:56.087440  8552 consensus_meta.cc:287] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.000s
I20260709 12:21:55.986654  8581 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:21:56.133049  4984 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:56.135565  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:56.136528  4408 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:55.995621  8495 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:56.034153  8508 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.136372  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:56.045656  8569 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.102933  8587 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:56.144073  4986 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:56.145529  4400 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:56.160362  4257 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:56.122463  8179 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:56.136926  8430 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.011170  8354 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.100219  8525 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:56.142937  8398 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:21:56.145124  8168 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.135565  8466 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.185492  4371 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:56.167279  8571 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.167732  8092 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.197273  8590 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.177464  8585 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:21:56.176403  8029 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.204030  8615 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:56.204905  8436 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.211370  8587 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:56.215189  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:56.301111  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 86010.3us
I20260709 12:21:56.215757  8496 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.216681  8179 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:56.217525  8604 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.101948  8592 consensus_queue.cc:1048] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:21:56.232949  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 47540.7us
I20260709 12:21:56.163179  8554 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.164047  8605 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:21:56.242012  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:56.242287  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:56.242955  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:56.243320  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:56.245025  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:56.247169  4984 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:21:56.343272  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 98347.1us
I20260709 12:21:56.343214  4989 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:21:56.247334  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:56.344914  4325 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:56.165763  8608 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:56.219194  8569 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:56.122553  8589 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 12:21:56.260097  4408 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:56.122491  8567 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.270339  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:56.305174  8580 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.273320  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2036) took 1005 ms. Trace:
I20260709 12:21:56.274627  4252 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:21:56.277287  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.360322  4257 rpcz_store.cc:276] 0709 12:21:55.268364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.271823 (+  3459us) service_pool.cc:224] Handling call
0709 12:21:55.272200 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:56.163808 (+891608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.273117 (+109309us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b54000d5f54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:56.273265 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2042116864}
I20260709 12:21:56.228470  8565 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:56.135736  8586 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.162884  8511 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:21:56.347199  8608 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:56.302062  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:56.161664  8552 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.308225  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 182951us
I20260709 12:21:56.310261  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.446641  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:56.314235  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.447638  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:56.341377  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.343273  4986 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: [6.6-7.7]
I20260709 12:21:56.272868  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.351163  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:56.406769  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 70158.7us
I20260709 12:21:56.449091  4249 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:56.408735  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51324.3us
I20260709 12:21:56.301330  8436 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.413300  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:56.332034  8092 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.457392  8092 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.260911  8590 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.458691  4988 raft_consensus.cc:2393] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:56.459770  8092 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.460196  8590 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.351622  8589 consensus_queue.cc:1243] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 12.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:21:56.414718  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:56.462226  8179 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:56.445286  8608 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.462984  4330 raft_consensus.cc:2410] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:21:56.467921  8557 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.468855  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:56.470739  8359 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:56.471513  8359 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:56.341624  8605 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:56.303694  8566 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.472594  8618 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:21:56.473330  8605 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.474653  8605 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:56.351926  8569 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.475579  8569 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:56.235984  8582 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:21:56.451104  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:56.476933  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:56.350772  8396 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:21:56.455765  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 153816us
W20260709 12:21:56.460973  8600 log.cc:927] Time spent T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:21:56.471705  8628 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:21:56.455965  8495 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.481060  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.482749  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:56.483285  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.485085  4253 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:56.474892  8566 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.486225  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:56.507375  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 56365.6us
I20260709 12:21:56.507850  4256 raft_consensus.cc:2410] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:21:56.507972  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:56.506433  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 134704us
I20260709 12:21:56.488020  4250 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:21:56.488070  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:56.483747  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.510365  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:56.512768  4257 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:56.506682  4990 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:56.499770  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:56.452191  8424 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:56.524783  4252 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:21:56.527426  4247 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:21:56.522969  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:56.528034  4254 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:56.545221  8585 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:56.545849  8585 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:56.476385  8584 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:56.552325  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:56.485289  8396 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:56.555416  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:56.505740  8528 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:56.503597  8525 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.556113  4400 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:56.515589  8582 consensus_queue.cc:1243] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:21:56.559278  8584 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.566264  8584 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:56.531747  8511 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:56.572813  4407 pending_rounds.cc:85] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 12
I20260709 12:21:56.573155  4407 pending_rounds.cc:107] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 12:21:56.573402  4407 raft_consensus.cc:2889] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:56.494215  8571 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:21:56.530651  8473 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.407513  8565 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.538592  8560 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.538241  8466 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.548266  8607 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.559042  8396 raft_consensus.cc:3060] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:21:56.578903  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51315.1us
I20260709 12:21:56.551883  8558 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.583158  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:56.596571  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:56.598464  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:56.531574  8179 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:21:56.548792  8489 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:21:56.675047  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 78589.6us
I20260709 12:21:56.573678  8511 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:56.684677  4254 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:56.528724  8359 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.673840  8631 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:56.696394  8631 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.691654  8558 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.692157  8511 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:56.692607  8029 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:21:56.707924  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 219927us
I20260709 12:21:56.586413  8354 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.600723  8580 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:21:56.776629  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 90632.7us
I20260709 12:21:56.586282  8632 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:56.784161  8619 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:56.699910  8398 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:56.684638  8583 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:56.802613  8620 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 12:21:56.803853  8629 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:21:56.698609  8631 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.594323  8585 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.821640  8587 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:56.854928  8624 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.394s	user 0.000s	sys 0.002s
I20260709 12:21:56.844693  8586 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:56.856705  8599 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
I20260709 12:21:56.780743  8558 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.940635  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 167492us
W20260709 12:21:56.989954  8656 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:21:56.991389  8528 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:56.993940  8528 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.944185  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2737) took 1089 ms. Trace:
I20260709 12:21:56.949180  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 1007) took 1674 ms. Trace:
I20260709 12:21:56.995968  8552 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.949740  4408 raft_consensus.cc:2410] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:21:56.951790  8029 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:56.793992  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:56.956806  8359 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:21:56.959904  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 449446us
I20260709 12:21:56.951014  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 1003) took 1677 ms. Trace:
I20260709 12:21:56.698411  8596 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.885679  8608 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:56.848903  8619 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:56.885928  8634 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.431s	user 0.002s	sys 0.007s
I20260709 12:21:57.016896  8596 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:21:57.018409  8619 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.018726  8552 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:57.019344  8552 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.019786  8552 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.021414  8608 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.982992  8567 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.988516  8631 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.023193  8631 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:56.989650  8565 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:56.995517  4334 rpcz_store.cc:276] 0709 12:21:55.854174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.855355 (+  1181us) service_pool.cc:224] Handling call
0709 12:21:55.855782 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.856869 (+  1087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.856913 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.862630 (+  5717us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.160441 (+297811us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:21:56.160564 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.160630 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.943404 (+782774us) raft_consensus.cc:1685] finished
0709 12:21:56.943483 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.943931 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":700,"raft.queue_time_us":5501,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16944,"thread_start_us":233570,"threads_started":1,"wal-append.queue_time_us":642801}
I20260709 12:21:57.007440  8359 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.009105  8436 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:56.996207  4983 rpcz_store.cc:276] 0709 12:21:55.274083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.274194 (+   111us) service_pool.cc:224] Handling call
0709 12:21:55.292353 (+ 18159us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:55.292801 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.292834 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:55.293620 (+   786us) log.cc:844] Serialized 52 byte log entry
0709 12:21:55.693781 (+400161us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b1800451840. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1
0709 12:21:55.693937 (+   156us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:55.719450 (+ 25513us) log.cc:844] Serialized 14 byte log entry
0709 12:21:55.726764 (+  7314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:55.726877 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.948156 (+1221279us) raft_consensus.cc:1685] finished
0709 12:21:56.948394 (+   238us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.948787 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241986,"prepare.queue_time_us":78355,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":172704,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":28312,"spinlock_wait_cycles":13689600,"thread_start_us":123257,"threads_started":2,"wal-append.queue_time_us":1013603}
I20260709 12:21:57.009346  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.000305  4985 rpcz_store.cc:276] 0709 12:21:55.272986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.273684 (+   698us) service_pool.cc:224] Handling call
0709 12:21:55.273982 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:55.890109 (+616127us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b180045eec0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb0d76060 00007fdbb0d76bfb 00007fdbb0d8164b
0709 12:21:55.890287 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:55.890327 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:55.925295 (+ 34968us) log.cc:844] Serialized 26 byte log entry
0709 12:21:56.160299 (+235004us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:21:56.160361 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:56.160453 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:56.950239 (+789786us) raft_consensus.cc:1685] finished
0709 12:21:56.950295 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:56.950780 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152776,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":78671,"spinlock_wait_cycles":99445120,"thread_start_us":410903,"threads_started":2,"wal-append.queue_time_us":340172}
W20260709 12:21:57.025763  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 386527us
I20260709 12:21:57.037461  4991 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:21:57.025842  8654 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:21:57.047223  8631 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:57.042495  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 241557us
I20260709 12:21:57.053218  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 1004) took 1779 ms. Trace:
I20260709 12:21:57.044912  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.053800  4990 rpcz_store.cc:276] 0709 12:21:55.273272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.274434 (+  1162us) service_pool.cc:224] Handling call
0709 12:21:57.052631 (+1778197us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54006aefd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:57.052961 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786456320}
I20260709 12:21:57.055025  4334 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:21:57.057271  8359 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:57.072154  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 63108.4us
I20260709 12:21:57.078893  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.078737  8638 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.090029  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.090358  8568 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:57.090910  8568 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:57.077812  8582 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.068948  8567 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.081264  8638 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.077962  8548 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.093393  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.104007  8568 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.106083  8568 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.105594  8548 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.113049  8548 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.118201  8548 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.120177  8548 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.118333  8165 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.122407  8165 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.106886  8582 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.125228  8165 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.125550  8582 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.126735  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 882) took 1146 ms. Trace:
I20260709 12:21:57.127328  4406 rpcz_store.cc:276] 0709 12:21:55.979884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:55.980013 (+   129us) service_pool.cc:224] Handling call
0709 12:21:57.126333 (+1146320us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b54002346d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:57.126527 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298923264}
I20260709 12:21:57.132709  8638 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.135885  8260 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:57.136422  8260 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:57.136621  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.138293  8567 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.137946  8260 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.139137  8567 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.136971  8548 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.141376  8567 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:57.142727  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.143188  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.133179  8597 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:57.144795  8597 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:57.146427  8597 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.148131  8597 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.100577  8558 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:57.156661  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 67763.2us
W20260709 12:21:57.133203  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.157961  8650 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:57.158531  8650 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.158937  8650 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.159780  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:57.162691  8569 consensus_meta.cc:287] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.014s
I20260709 12:21:57.162837  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.163940  4989 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:57.163347  8569 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.165242  4248 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:57.165040  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.170017  8569 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.099426  8565 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.172678  4406 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:21:57.178174  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.156774  8260 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.190384  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.190958  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.192049  8424 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:57.192665  8424 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.194034  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.194862  4406 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.196048  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.197875  8496 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.200402  4409 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:57.214061  4372 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.215488  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.203361  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.218873  4406 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:57.220062  4334 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:57.226637  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.228957  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:57.230572  8430 consensus_meta.cc:287] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.049s	user 0.010s	sys 0.010s
I20260709 12:21:57.231415  8650 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.233103  8571 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:21:57.233716  8571 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.234194  8571 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.234823  8650 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:57.235852  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.235918  8029 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.239630  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.215485  8565 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.244082  4988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 938) took 1001 ms. Trace:
I20260709 12:21:57.244720  4985 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:21:57.244570  4988 rpcz_store.cc:276] 0709 12:21:56.242576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:56.242690 (+   114us) service_pool.cc:224] Handling call
0709 12:21:57.243593 (+1000903us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540060fc54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:21:57.243871 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266445184}
I20260709 12:21:57.246146  8410 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.246217  8565 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.247108  8410 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.249987  8410 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.250547  8410 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.255892  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.256624  4329 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:57.257668  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.258860  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.259198  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.259390  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:57.259706  4326 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:57.260156  4985 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:21:57.264325  8584 consensus_meta.cc:287] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.697s	user 0.015s	sys 0.007s
I20260709 12:21:57.267678  8584 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.269541  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.264197  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.269726  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.273500  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.274276  4329 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:21:57.231155  8430 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.190903  8585 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.290496  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.182289  8396 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.299237  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.251188  8410 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.311894  8604 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:21:57.314447  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.316963  4985 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:57.316512  4327 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:57.281293  8571 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.324476  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.326023  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.331795  8165 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.332587  8165 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.334630  8165 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.338725  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.339804  4405 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:57.341164  8571 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.341884  8571 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.342435  8381 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:21:57.342476  8571 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.346132  8571 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.355165  4992 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:21:57.356060  8597 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.356658  8597 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.358903  8396 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.339828  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.363492  4326 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:21:57.363883  4326 pending_rounds.cc:85] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:21:57.364125  4326 pending_rounds.cc:107] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:21:57.364411  4326 raft_consensus.cc:2889] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.367573  8430 consensus_queue.cc:1059] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:21:57.368301  8584 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.368762  8430 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:21:57.369243  8430 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:57.371264  4409 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:57.374387  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.369313  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.412585  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.370477  8430 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.392303  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:21:57.413749  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 98690.8us
I20260709 12:21:57.414171  8430 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:21:57.392750  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:57.392978  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.416141  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.416308  4988 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:57.393370  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.394030  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.417475  4987 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:57.394640  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.395548  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:57.418458  4334 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:57.418596  4991 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:57.397107  8647 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:57.419507  4330 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.400610  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.423676  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.403154  8584 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.429586  8584 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.429828  8410 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:57.335129  8511 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.003s
I20260709 12:21:57.404603  8569 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.433034  8511 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.407214  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.407584  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.407860  4989 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:21:57.409053  8146 consensus_meta.cc:287] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.718s	user 0.013s	sys 0.012s
I20260709 12:21:57.407903  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.437371  8146 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.411738  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:57.415664  8596 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:57.402715  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:21:57.438875  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 64629.2us
I20260709 12:21:57.440426  8647 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.440824  8647 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.441270  8647 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.441833  8499 consensus_queue.cc:1059] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:21:57.444264  8430 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:21:57.444674  8430 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:57.432281  8569 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.447054  4330 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:57.447402  8569 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.426833  8554 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.433799  4325 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:57.448264  8554 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.448752  4332 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:57.407081  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.437517  4400 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:57.438225  4984 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.450435  8554 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:57.448264  4372 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.452313  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.452643  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.453814  8568 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:21:57.454360  8568 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:57.454522  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.455430  8568 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.456061  4400 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:57.456130  8597 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.374277  4408 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:57.456969  4402 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:21:57.458109  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.465085  4984 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
W20260709 12:21:57.470613  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55295us
I20260709 12:21:57.471108  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:57.470597  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 47121.1us
I20260709 12:21:57.478758  4991 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:57.428679  4149 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:57.485189  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.476166  8569 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:57.488629  4403 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 12: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:57.486889  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.489938  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.492159  4407 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.495518  8168 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:21:57.498201  4956 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.476500  8496 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:57.512728  8511 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:57.507359  8597 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:21:57.507900  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.486748  8424 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.511682  8584 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.514149  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.469882  8146 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.499758  8569 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.515673  4406 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:21:57.532056  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.533979  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.534708  8372 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:57.534902  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.535516  8396 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:57.538090  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:57.537276  8596 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:21:57.539866  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:57.540028  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.540804  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:57.543082  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.523514  4985 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:21:57.560945  4984 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:57.560714  4407 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:21:57.562115  4407 pending_rounds.cc:85] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 6
I20260709 12:21:57.562336  4407 pending_rounds.cc:107] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:21:57.562582  4407 raft_consensus.cc:2889] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:57.546157  8552 consensus_meta.cc:287] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.001s
I20260709 12:21:57.581482  4987 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
W20260709 12:21:57.581636  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 104728us
W20260709 12:21:57.580966  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 72151.9us
I20260709 12:21:57.586488  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:21:57.588024  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 53181.4us
I20260709 12:21:57.558502  8569 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.502166  8499 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:21:57.594715  4331 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.601527  4990 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:21:57.605417  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.602264  4255 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:57.603457  4990 pending_rounds.cc:85] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 9
I20260709 12:21:57.608814  4990 pending_rounds.cc:107] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:21:57.609082  4990 raft_consensus.cc:2889] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.610380  8168 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:57.624154  4257 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:21:57.632381  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.632982  8637 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:57.633599  8637 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.634083  8637 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.634243  4256 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:21:57.548362  8430 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.639555  8430 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:57.643220  8146 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.643802  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.645387  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:57.592283  8552 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:57.649992  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.615535  8584 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.686898  8584 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.689296  8584 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.690030  8496 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:21:57.690742  8496 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:57.691965  8496 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.695396  8359 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:57.625097  8565 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:21:57.696265  8359 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.697007  8410 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:57.697418  8410 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:57.698308  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.665856  8424 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.667620  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.667703  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.669420  4149 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:57.671474  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.706738  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:57.674499  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.681262  8398 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.698947  4401 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:57.701478  4405 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:21:57.703630  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.718390  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.719244  4404 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:57.721402  4331 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:57.724150  8359 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.727234  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.733961  4404 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:21:57.734407  4404 pending_rounds.cc:85] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 8
I20260709 12:21:57.734305  4955 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.734872  4404 pending_rounds.cc:107] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:21:57.735199  4404 raft_consensus.cc:2889] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:57.737329  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.738477  8597 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:57.647532  8168 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.745683  8168 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:57.746582  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:57.746533  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.698345  8410 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.749167  8583 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:21:57.749719  8410 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.752617  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:57.753470  8548 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.753859  8548 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.754241  8548 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.756898  4253 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:21:57.765344  8647 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.764986  4149 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 3 to 7, term changed from 8 to 9, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to <none>, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New cstate: current_term: 9 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:57.771090  4149 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 10, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:21:57.768666  8569 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.774353  8569 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.775367  4250 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:57.769829  8168 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.776875  8168 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.779481  8092 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:57.780169  8168 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.768066  8548 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:57.769007  4151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 370) took 19060 ms (client timeout 15000 ms). Trace:
I20260709 12:21:57.782286  8548 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.781982  8637 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.782888  4149 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:57.784929  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:57.780856  4151 rpcz_store.cc:269] 0709 12:21:38.708963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:38.709289 (+   326us) service_pool.cc:224] Handling call
0709 12:21:39.053473 (+344184us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:21:57.768716 (+18715243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:53.197753 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:53.424010 (+226257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:53.424062 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:21:53.424082 (+    20us) tablet.cc:662] Decoding operations
0709 12:21:53.425807 (+  1725us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:53.425875 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:53.425908 (+    33us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:21:53.495950 (+ 70042us) tablet.cc:701] Row locks acquired
0709 12:21:53.495987 (+    37us) write_op.cc:260] PREPARE: finished
0709 12:21:53.496605 (+   618us) write_op.cc:270] Start()
0709 12:21:53.496728 (+   123us) write_op.cc:276] Timestamp: P: 1783599713496097 usec, L: 0
0709 12:21:53.496749 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:21:53.497481 (+   732us) log.cc:844] Serialized 7724 byte log entry
0709 12:21:53.757803 (+260322us) op_driver.cc:464] REPLICATION: finished
0709 12:21:54.791995 (+1034192us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b180033ae40. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:21:54.792178 (+   183us) write_op.cc:301] APPLY: starting
0709 12:21:54.792279 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:55.104979 (+312700us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:55.107746 (+  2767us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:55.793172 (+685426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:55.793477 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:21:55.793526 (+    49us) write_op.cc:312] APPLY: finished
0709 12:21:55.793929 (+   403us) log.cc:844] Serialized 180 byte log entry
0709 12:21:55.880664 (+ 86735us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:55.958065 (+ 77401us) write_op.cc:454] Released schema lock
0709 12:21:55.970425 (+ 12360us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:56.042298 (+ 71873us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:56.053822 (+ 11524us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":554214,"reported_tablets":46,"spinlock_wait_cycles":29738496,"child_traces":[["op",{"apply.queue_time_us":57343,"apply.run_cpu_time_us":54513,"apply.run_wall_time_us":1205286,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87727,"num_ops":20,"prepare.queue_time_us":146826,"prepare.run_cpu_time_us":16984,"prepare.run_wall_time_us":373132,"raft.queue_time_us":66782,"raft.run_cpu_time_us":20058,"raft.run_wall_time_us":55690,"replication_time_us":260445,"spinlock_wait_cycles":9998208,"thread_start_us":268430,"threads_started":5,"wal-append.queue_time_us":387190,"wal-append.run_cpu_time_us":17649,"wal-append.run_wall_time_us":2345197}]]}
I20260709 12:21:57.775867  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.787694  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:57.790397  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 57673.2us
I20260709 12:21:57.791728  4256 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:21:57.793111  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:57.791769  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:57.794379  4257 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:21:57.780030  8092 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.799842  8359 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:57.800701  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.806391  4405 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:57.801661  8677 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:21:57.802139  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.732024  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.804366  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:57.805020  8146 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:57.810571  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.808744  8359 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.788038  4149 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129), VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130), VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131), VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:21:57.828043  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 99460.5us
I20260709 12:21:57.828991  4990 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:57.829357  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.819253  8359 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:57.805841  8597 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:57.834810  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.841127  4326 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:57.815004  8146 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.848703  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:57.852859  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 270490us
I20260709 12:21:57.823333  8410 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:57.837268  8604 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:57.854575  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:21:57.862648  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.853591  8146 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:57.870400  4149 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 9, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:57.882141  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:57.860211  8372 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:21:57.885892  4257 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:57.871673  8604 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:57.866598  8410 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:57.914921  8637 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.884363  8647 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:57.918335  8666 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:21:57.915509  8092 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.916332  8029 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:57.928481  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.919898  4330 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:57.918792  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:57.930074  4404 raft_consensus.cc:2410] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:21:57.894008  4149 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:57.917975  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.930968  4407 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.931577  4405 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:21:57.932819  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:57.936010  4257 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:57.941264  8092 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:21:57.946664  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.946241  4149 catalog_manager.cc:5697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 9, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 9 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
W20260709 12:21:57.953387  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.938625  8647 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:21:57.953878  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:57.905952  8372 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.939535  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:57.962456  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:57.947048  8552 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.966449  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:57.967463  4328 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:57.951131  8092 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:57.970772  4329 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:57.956470  8647 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:57.976951  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:57.982903  4149 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 7, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 7 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:57.985296  4149 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 9, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:57.987417  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47986.6us
I20260709 12:21:57.989684  8381 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:57.990597  8381 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:57.991246  8655 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:57.991698  8655 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:57.992376  8410 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:57.993040  8092 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:57.993686  8372 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:57.994570  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.995405  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:57.996335  4407 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:58.001199  4328 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:57.952569  8029 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.005216  8029 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:58.006250  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:58.012854  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:57.986796  4149 catalog_manager.cc:5697] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.968560  8430 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.018260  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:58.022109  4403 raft_consensus.cc:2468] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:57.976226  8647 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.026927  4325 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:58.029431  4955 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:58.029614  4326 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:58.031446  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.030606  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:58.017427  8410 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:58.017956  8029 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:58.011020  8644 raft_consensus.cc:2764] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:21:58.032318  4219 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:58.037231  8583 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:21:58.022468  8637 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:21:58.037966  8673 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:58.038632  8584 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:58.042522  8672 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:58.039901  8410 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:58.062980  4149 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 3 to 9, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 9 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:58.056895  8381 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:58.048774  8548 raft_consensus.cc:2804] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:57.974057  8604 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:58.071841  8584 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.052292  8029 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:58.084725  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.084751  8687 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:58.070400  8410 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.073854  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.102149  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.104955  4989 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.105551  4983 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:21:58.105944  4983 pending_rounds.cc:85] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 10
I20260709 12:21:58.106217  4983 pending_rounds.cc:107] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:21:58.106458  4983 raft_consensus.cc:2889] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.109807  8655 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.117430  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.059696  8359 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.125176  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:58.103966  4149 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 6, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 6 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.129278  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.131946  4149 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 9, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:58.138396  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.144467  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:58.146790  4257 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:21:58.100307  8548 raft_consensus.cc:697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:58.147938  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.148656  4983 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:21:58.155452  8685 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:21:58.160014  4256 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.159583  4149 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:21:58.162143  4985 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:21:58.163321  8569 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.163709  8029 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.167821  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.168638  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.170279  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:58.170979  4249 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.175383  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.175431  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.175637  8548 consensus_queue.cc:237] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.177575  4248 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:58.180402  8638 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:58.181025  8638 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.182199  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:58.183353  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.187052  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:58.079475  8381 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:58.189157  8381 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:58.189882  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 44556us
I20260709 12:21:58.192139  8410 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.194188  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.138981  8655 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:58.145634  8584 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:58.202093  4989 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:58.203800  8146 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.204790  8410 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:58.204977  4984 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:21:58.206552  8146 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:58.209185  8689 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:21:58.209649  4249 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:58.212353  4989 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:58.216920  4990 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:21:58.218389  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.231947  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.234335  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:58.211889  8638 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:58.240056  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.245940  4989 raft_consensus.cc:2368] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11.
I20260709 12:21:58.247824  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.248806  4989 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:58.260159  4989 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:58.263025  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.271071  4989 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:21:58.271766  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 197990us
W20260709 12:21:58.285306  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 135939us
I20260709 12:21:58.285852  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.286794  4984 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:21:58.287179  8511 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:58.319691  8568 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:58.287710  8585 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:58.320416  8568 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.310079  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:58.327508  8168 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:21:58.328715  8168 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:58.329084  8168 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:58.329532  8568 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:58.329958  8168 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.331349  8568 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:58.333532  8168 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.338028  8585 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.340376  8585 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:58.341287  8359 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:58.346097  8688 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.196s	user 0.007s	sys 0.002s
I20260709 12:21:58.348029  4990 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:21:58.348690  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.349148  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.350584  4989 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:58.351838  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.352670  4991 raft_consensus.cc:2393] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:58.353498  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.354357  4987 raft_consensus.cc:2393] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 16: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:58.357075  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.349435  4988 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:58.360374  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:58.361054  4407 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:58.370844  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 84778.9us
I20260709 12:21:58.376713  4407 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
I20260709 12:21:58.388418  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.390161  4955 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.389156  4988 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:21:58.394541  4983 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:58.399755  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:58.403632  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:58.404316  4326 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:21:58.408573  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 82760.8us
W20260709 12:21:58.407811  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 76873.6us
I20260709 12:21:58.378752  8631 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:58.415388  4326 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:21:58.418320  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:58.421304  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:58.422425  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.359344  8647 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.424623  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:58.427450  4325 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:21:58.429551  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:58.398829  8638 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:58.442561  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.443333  4983 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.431589  4328 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.443861  4326 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:58.452837  4331 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:21:58.421205  8637 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:58.441664  8165 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.462958  4326 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:58.448364  8638 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:21:58.468327  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68696.6us
I20260709 12:21:58.441920  8655 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:21:58.457223  8568 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:21:58.479979  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 58748.2us
I20260709 12:21:58.469280  8165 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:58.473006  8692 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:58.471789  8701 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.467128  8637 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.504894  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.472370  8168 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:21:58.508438  8584 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.522279  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:58.503654  8585 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:21:58.512822  8571 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:21:58.513171  8709 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:21:58.531383  8714 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:21:58.533258  8637 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:58.512223  8638 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:58.536655  8695 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:21:58.530323  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.510497  8702 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:21:58.530334  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:58.548316  4250 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.529079  8703 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:58.548945  8703 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:58.545077  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.509203  8631 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:21:58.546391  4983 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:58.553457  8202 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:58.553660  8703 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:58.554296  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:58.554509  8202 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:58.555081  8703 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.555393  8165 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.556067  8202 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.564229  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:58.528738  8701 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:58.558744  8410 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:58.572345  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:58.579751  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.588384  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:58.552441  8709 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:21:58.549474  8714 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:21:58.551968  8647 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:58.554291  8584 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.603232  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:58.525092  8568 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.613363  8577 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:58.613741  8558 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:58.614255  8558 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.573647  8687 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:58.595773  8709 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:58.607805  8372 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:21:58.610065  8569 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:21:58.619391  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90581.6us
I20260709 12:21:58.603945  8714 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:58.614663  8558 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.593773  8410 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.627288  8372 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:21:58.620829  8711 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:21:58.643198  8691 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:58.638598  8687 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:58.676424  8691 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:58.676849  8691 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.677788  8699 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:58.678264  8699 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:58.679211  8699 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.680584  8699 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:58.681329  4331 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:21:58.681741  4331 pending_rounds.cc:85] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:21:58.682680  4331 pending_rounds.cc:107] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:21:58.682952  4331 raft_consensus.cc:2889] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:58.649480  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:58.664245  8714 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.666642  8410 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:58.634464  8701 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.668550  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.694113  4983 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:58.669212  8372 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.670068  4250 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
W20260709 12:21:58.684250  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 57422.3us
I20260709 12:21:58.692902  8712 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:21:58.702144  8724 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:21:58.703670  4984 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 12:21:58.705345  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 102200us
I20260709 12:21:58.707719  8687 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:58.708139  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:58.709390  8692 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:58.710072  8692 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:58.712013  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:58.713124  8146 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:21:58.699980  8712 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:21:58.719237  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.710924  8692 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.692098  8582 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:21:58.732131  4404 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:58.726718  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.738576  4331 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:58.734638  8585 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:21:58.740036  8716 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:58.740363  8585 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:58.740835  8585 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:58.732261  8714 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:58.741710  8585 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:58.743546  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.744215  4406 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:21:58.725080  8712 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:58.752316  8582 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:58.752777  8582 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:58.754189  8548 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:58.756385  8644 consensus_queue.cc:1059] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:58.757167  8644 consensus_queue.cc:1243] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:21:58.762828  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.766603  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:21:58.759609  8568 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:21:58.772722  8596 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:58.767227  8165 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:21:58.774339  8709 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.775377  8029 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:21:58.776650  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:21:58.786278  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:58.787613  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.788429  4250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:58.788676  8568 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:58.789220  4403 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:58.781708  8596 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:58.790077  8596 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:58.743114  8585 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.723665  8687 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:21:58.795073  8709 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:58.801072  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.784597  8716 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:58.794914  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:58.813252  4247 raft_consensus.cc:2393] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:58.793349  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.807195  4257 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.807329  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:58.784739  8723 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:21:58.806512  8582 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.814107  8687 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:58.818014  8582 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:58.789245  4250 raft_consensus.cc:606] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:58.822126  4256 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 12. Ops: []
I20260709 12:21:58.800752  8558 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.844532  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.789225  8568 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:58.825224  8716 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:58.850157  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:58.851750  4257 raft_consensus.cc:2393] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:58.851750  4403 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:21:58.856472  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.829766  8424 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:21:58.846508  8687 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.811743  8712 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.867347  4407 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 13. Current term is 14. Ops: []
I20260709 12:21:58.863873  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.872535  4250 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:21:58.798308  8638 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:21:58.873684  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:58.886350  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.887725  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:21:58.888736  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48485.4us
I20260709 12:21:58.896337  8092 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:58.896999  8092 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.899958  4325 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:58.901647  8712 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:21:58.902980  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 126459us
I20260709 12:21:58.879618  8029 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:21:58.905239  8381 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:58.905730  8381 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:58.907507  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.908852  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.909941  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.910491  4401 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:21:58.807982  8691 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.911271  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.916603  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.911922  4402 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:21:58.912287  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.967667  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:58.968231  4409 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:58.968700  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.969125  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.969861  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:58.912418  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:58.970836  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 46607.7us
I20260709 12:21:58.913691  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.912254  4408 raft_consensus.cc:1240] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: []
I20260709 12:21:58.913328  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.974515  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.923374  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:58.974792  4406 raft_consensus.cc:2410] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:58.980320  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.989647  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.917037  4401 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:21:58.970182  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.906631  8381 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:58.991621  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.992517  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:58.994411  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.995223  4407 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
W20260709 12:21:58.996577  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:58.996315  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.997135  4407 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:21:58.997166  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.993491  4400 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:58.987645  4402 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:59.003324  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:58.906649  8558 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:59.003930  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:58.956970  4955 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.679s (SENT) [suppressed 21 similar messages]
I20260709 12:21:59.004768  4253 raft_consensus.cc:1275] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:59.005832  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:59.009169  4407 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:59.009405  4989 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.007371  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.012058  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:59.012923  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.013535  4409 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:21:59.014241  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:58.917364  8092 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:58.914256  8691 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:59.023262  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.024248  4403 raft_consensus.cc:2410] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:21:59.025066  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.007992  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.017083  4248 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:59.026939  4406 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:59.026420  4248 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:21:59.029927  4400 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:21:59.043643  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.038198  4248 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.001272  8712 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:21:59.052791  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.063501  4248 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.070242  8717 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:21:59.070715  8717 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:59.071543  8717 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.072767  8717 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.029834  8596 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.089846  4989 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:21:59.093982  4401 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:59.114776  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.114979  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.115779  4403 raft_consensus.cc:2410] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:21:59.115697  4400 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:21:59.132570  4985 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: []
I20260709 12:21:59.133675  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:59.041600  8568 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:59.138989  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 129448us
I20260709 12:21:59.130054  8638 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:59.148929  4248 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:21:59.149463  4248 pending_rounds.cc:85] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 9
I20260709 12:21:59.149767  4248 pending_rounds.cc:107] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:21:59.150066  4248 raft_consensus.cc:2889] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:59.151477  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 194564us
I20260709 12:21:59.156046  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:59.159029  4250 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:21:59.159243  4403 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:59.160126  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.160727  4403 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:21:59.161525  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.164608  4250 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:21:59.166879  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.167009  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:21:59.167496  4403 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:21:59.167559  4989 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:21:59.168448  4254 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:21:59.165414  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:21:59.168409  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.167670  4984 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:21:59.175544  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:21:59.175807  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.176090  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:59.176425  4403 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:21:59.176780  4248 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:59.160055  8568 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.181360  4990 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:21:59.186827  4989 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:21:59.160264  8638 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:59.191119  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:59.202905  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.201260  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:21:59.204154  8733 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:21:59.219832  8638 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:21:59.222539  8740 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
W20260709 12:21:59.228097  8744 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:21:59.253110  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51977.9us
I20260709 12:21:59.254859  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.233103  8712 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:21:59.263217  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.264110  8712 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:21:59.265559  4218 connection.cc:256] RPC call timeout handler was delayed by -1.0409356659997684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:21:59.265748  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.266511  8712 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:59.267041  8712 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:59.268057  8712 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.268774  8165 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:59.269959  8202 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:21:59.271555  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.272025  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:59.257225  8746 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:59.274323  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.274941  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.275686  8699 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:59.276111  4371 leader_election.cc:400] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11.
W20260709 12:21:59.276352  8745 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:21:59.279604  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.267118  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.277601  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.290000  4407 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:59.293665  8714 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:59.297453  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.293819  8637 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.295377  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:21:59.300882  4332 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:59.303735  4405 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:21:59.305470  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.292802  8359 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.298609  8637 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.311695  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:59.315649  8092 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:59.316092  8092 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:59.316432  8092 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.316632  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:59.318074  8748 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:21:59.324524  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.312827  8585 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:21:59.329962  8202 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.331712  8165 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:21:59.334587  4218 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:21:59.339437  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.301846  8596 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.343381  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:59.345352  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 363794us
I20260709 12:21:59.349332  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.355199  4327 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:21:59.342618  8691 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:59.363160  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.365410  4991 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:21:59.375265  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.376698  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.376710  4989 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:59.356683  8585 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.379238  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.382839  4983 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:59.335157  8092 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.356735  8168 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:21:59.372363  8716 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:59.395227  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:59.396939  8714 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:59.385244  8359 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:21:59.380167  8568 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:21:59.393030  8528 consensus_queue.cc:1059] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:21:59.408485  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.407660  4983 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.406805  8699 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:21:59.386080  8638 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.419513  4990 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:59.421618  4983 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:21:59.424947  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:59.425702  4991 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.399715  8691 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:21:59.406841  8372 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:21:59.380638  8558 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:21:59.430879  4989 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:21:59.407338  8359 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:21:59.413589  8568 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:59.423002  8596 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.433059  8715 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:21:59.448012  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 73669.5us
I20260709 12:21:59.437917  8359 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:21:59.435662  8568 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.463776  4407 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:21:59.467598  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.427832  8638 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.472517  4991 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:21:59.476203  4990 raft_consensus.cc:1240] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:21:59.476655  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.495584  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.510083  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:21:59.516784  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 148432us
I20260709 12:21:59.497320  8372 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:21:59.443156  8596 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.523566  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.496127  8647 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.523114  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:59.519346  8738 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.468s	user 0.003s	sys 0.000s
I20260709 12:21:59.514947  8644 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.516487  8637 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.535002  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.504599  8585 consensus_queue.cc:1059] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:21:59.537781  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.538290  4983 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:21:59.509786  8712 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:21:59.541764  4255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:21:59.542544  4255 raft_consensus.cc:606] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.528417  8372 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:59.529645  8647 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:59.535161  8430 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.555013  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:59.557626  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.549687  8410 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:21:59.560046  8758 log.cc:927] Time spent T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:21:59.548741  8372 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:21:59.564991  8739 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.373s	user 0.002s	sys 0.000s
I20260709 12:21:59.549326  8631 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:21:59.570837  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.550505  8647 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.579715  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.579922  8430 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:21:59.580595  8715 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:59.580590  8430 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:59.581344  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:59.581359  8430 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:21:59.582114  8715 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:21:59.582458  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.582520  8715 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:59.583151  8715 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.583945  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:21:59.584928  8381 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:21:59.585839  8381 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:21:59.586194  8381 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:21:59.586585  8381 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.588006  8638 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.590233  8430 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:59.592198  8596 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.592645  8430 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.569341  8709 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:21:59.594563  8381 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:59.596711  8381 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.601528  8715 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.604446  8715 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:59.561985  8585 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:21:59.610401  8585 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:21:59.611709  8585 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.613864  8585 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:21:59.572695  8410 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:21:59.621366  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:59.622008  4409 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.633042  4328 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:21:59.636448  4409 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:59.637293  8760 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:21:59.640347  8759 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:21:59.641510  4327 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:21:59.648479  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:21:59.650954  8596 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:21:59.652125  8596 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:21:59.653293  8596 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.655419  8647 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:59.656463  4332 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:21:59.660334  4328 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:21:59.665062  8372 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:59.672614  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:21:59.681461  8741 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.571s	user 0.003s	sys 0.000s
I20260709 12:21:59.681958  8568 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:59.637339  8717 consensus_meta.cc:287] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.002s
I20260709 12:21:59.686074  4402 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:21:59.667194  8372 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:21:59.690266  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 112489us
W20260709 12:21:59.691069  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45482.2us
I20260709 12:21:59.699999  8558 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:21:59.700940  8644 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.702196  4327 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:21:59.703567  8647 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.707386  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.708421  4401 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:21:59.713304  8701 raft_consensus.cc:3055] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:21:59.713850  8701 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:21:59.722664  8092 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:21:59.724315  4407 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:21:59.724798  4407 pending_rounds.cc:85] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 8
I20260709 12:21:59.725061  4407 pending_rounds.cc:107] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:21:59.725337  4407 raft_consensus.cc:2889] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.730438  4331 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:21:59.731572  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.714923  8701 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:21:59.744429  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 45614us
I20260709 12:21:59.732254  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:21:59.733110  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.745970  4402 raft_consensus.cc:2410] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:21:59.735496  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:59.746493  4406 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:21:59.729976  8766 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:21:59.740172  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:21:59.741689  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:21:59.742522  4407 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:21:59.743338  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 159418us
I20260709 12:21:59.748838  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.747833  4400 raft_consensus.cc:2376] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11. Re-sending same reply.
W20260709 12:21:59.753958  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.727788  8692 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:21:59.760056  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:21:59.760684  4331 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:21:59.733633  8359 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:21:59.744825  8092 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:21:59.769068  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:21:59.764624  8769 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:21:59.777639  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:59.791815  8774 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:21:59.768188  8558 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:21:59.783408  8701 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:21:59.787350  8372 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:21:59.765085  8687 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:21:59.809731  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:21:59.788035  8568 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:59.793113  8763 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.810738  4406 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:21:59.815310  4988 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:21:59.824275  4988 pending_rounds.cc:85] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 7
I20260709 12:21:59.824581  4988 pending_rounds.cc:107] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:21:59.824843  4988 raft_consensus.cc:2889] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.816431  4990 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:21:59.784382  8092 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.789709  8770 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:21:59.843853  4325 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:21:59.844395  4325 pending_rounds.cc:85] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 12
I20260709 12:21:59.844666  4325 pending_rounds.cc:107] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:21:59.844965  4325 raft_consensus.cc:2889] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:59.814218  8372 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:21:59.849536  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 91820us
I20260709 12:21:59.855063  4331 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:21:59.887094  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:21:59.810307  8644 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:21:59.896086  4218 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:21:59.897603  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:21:59.908066  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 121572us
I20260709 12:21:59.882225  8372 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:21:59.833091  8763 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:21:59.894805  8715 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.841388  8381 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:21:59.910318  8709 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:22:00.079118  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:00.021904  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 256157us
W20260709 12:21:59.961678  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 121653us
I20260709 12:22:00.074728  4983 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:22:00.082156  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:00.176851  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 279325us
I20260709 12:22:00.181026  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:00.181677  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 99642.4us
W20260709 12:21:59.972631  8775 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:00.178532  4372 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:00.202129  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:00.205137  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:00.165717  8687 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.190399  8568 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:00.182778  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.008483  8770 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:00.016348  8092 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:00.062652  8410 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.954182  8430 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.044123  8582 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:59.964766  8359 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:21:59.953931  8778 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.920553  8029 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.274s
I20260709 12:22:00.000905  8763 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:21:59.999228  8769 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:21:59.972921  8785 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:00.015148  8725 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:00.190934  8780 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:00.192672  8528 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.211476  8165 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:00.232563  4334 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:00.075217  8638 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.138s
I20260709 12:21:59.953446  8715 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:00.238672  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 319779us
I20260709 12:22:00.207435  8558 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:00.211956  8168 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:22:00.242836  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 60123.6us
I20260709 12:22:00.225800  8779 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.229166  8772 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:22:00.229575  8568 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.231616  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:00.203483  8692 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:22:00.239883  8716 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:00.224208  8712 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:00.237834  8687 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:00.329102  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50827.4us
I20260709 12:22:00.330284  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:00.332738  4256 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:00.272871  8725 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:00.232091  8787 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:22:00.352439  8765 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:00.239872  8410 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.353277  8767 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.353859  8767 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.354257  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.354738  8410 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.355536  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.356256  8767 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:00.357442  8793 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:22:00.357973  8029 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:00.358115  8792 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:00.361716  8548 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:00.337662  4255 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:00.363071  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.338973  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:00.364144  8800 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:00.366056  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.366865  8800 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:00.368208  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.368978  8800 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:00.370791  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.371937  8800 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:00.373974  8800 consensus_queue.cc:1048] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:00.376227  8800 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:00.377118  8558 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.379745  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.388342  8768 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:00.388926  8768 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:00.389813  8768 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:00.392361  8789 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:22:00.340507  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 58628.9us
I20260709 12:22:00.243230  8582 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:00.328251  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 123226us
I20260709 12:22:00.345382  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:00.346705  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:00.240129  8430 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.350353  8694 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:00.351142  8092 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:00.351567  8716 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.409237  4407 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:00.326584  8568 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:00.341410  8775 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:00.418841  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:00.391124  8768 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:00.430604  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:00.446283  4407 raft_consensus.cc:2410] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:00.432713  4402 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:00.447645  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:00.346354  8714 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:00.451687  8714 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.452492  8430 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.453792  8714 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:00.404452  8760 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:22:00.457098  4327 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:00.457944  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:00.459264  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52508.2us
I20260709 12:22:00.394755  8712 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:00.281502  8528 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.425181  8699 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.470762  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.480868  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.473377  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.468017  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:00.406050  8691 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:00.478313  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.473242  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:00.426802  8092 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:00.492147  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.491322  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:00.498178  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:00.499972  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.501710  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.506989  4256 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:00.452531  8715 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.428570  8763 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:22:00.468009  8780 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:00.518414  4987 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:00.327152  8779 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.522410  4256 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:00.523762  8712 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.524435  8799 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:00.483569  8637 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:00.456547  8410 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:22:00.507103  8691 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.431722  8709 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:22:00.529254  8790 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:00.522177  8528 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.520243  8585 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:00.431977  8786 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:22:00.545028  4247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:00.560887  4247 raft_consensus.cc:606] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:00.561276  4247 raft_consensus.cc:614] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:00.553624  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.562793  8410 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:00.563325  8410 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:22:00.563567  8796 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:22:00.564088  8795 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:00.564389  8410 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:00.556054  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 56192.2us
I20260709 12:22:00.558696  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.490512  8699 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.476825  8778 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:22:00.559728  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.563102  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.567229  4256 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:00.576138  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.586755  4405 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:00.599638  8694 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.600087  8716 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.600266  8694 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.600868  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.564477  8638 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:22:00.603912  8694 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.606736  8699 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.567090  8585 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:00.607676  8565 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:00.609722  8585 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:00.564112  8766 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:22:00.611275  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.614378  8779 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.615826  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.620587  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.622416  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:00.626595  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 209892us
I20260709 12:22:00.633596  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.634285  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:00.590878  8372 consensus_meta.cc:287] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:22:00.556049  8637 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.639107  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.644428  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.642295  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.641710  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.642437  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.643430  4255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:00.646183  4255 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.566710  8596 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:22:00.588776  8410 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:00.649811  4250 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:00.644701  4247 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:00.656078  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:00.652621  4254 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:00.556025  8799 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.627540  8528 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:00.670411  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.670747  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.672549  4991 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:00.671432  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.572232  8092 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.655591  8638 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:00.649178  8372 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:00.679152  8701 consensus_meta.cc:287] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.004s
I20260709 12:22:00.680259  8528 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.654291  8165 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:00.557453  8780 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.652026  8804 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:00.703729  4257 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
W20260709 12:22:00.687888  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 72149.2us
I20260709 12:22:00.698463  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:00.685058  8638 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.700913  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:00.707643  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:00.716909  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:00.718163  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.719023  4991 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:00.744382  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:00.745224  4991 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:00.699252  8810 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:00.750430  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52031.9us
I20260709 12:22:00.750919  8802 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:00.751271  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:00.753521  8359 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:00.753582  8165 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:00.717504  8638 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:00.758872  4991 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:00.757179  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:00.723896  8709 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:00.741534  8644 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:00.771806  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.908291  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:00.827350  8631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.008s	sys 0.015s
W20260709 12:22:00.909636  8631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.009s	sys 0.015s
I20260709 12:22:00.909679  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.911659  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:00.914402  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 158893us
I20260709 12:22:00.920095  4991 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:00.920008  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:00.921550  8799 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:00.922263  8691 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:00.923283  8637 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:00.823449  8795 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:00.929811  8568 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:00.767536  8709 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:00.717581  8804 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.048830  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.049633  4331 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:00.748447  8716 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:01.014168  4988 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
W20260709 12:22:01.016373  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 308832us
I20260709 12:22:01.019587  4333 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:01.052556  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:01.020390  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 330079us
W20260709 12:22:01.013082  8809 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:22:01.048198  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.017450  8813 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:01.073827  8813 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.076257  8813 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.077729  8582 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:01.078466  8804 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:01.055003  8716 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.081938  8716 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:01.081698  8725 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.058199  8029 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:01.090342  8638 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:01.091960  8806 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.337s	user 0.000s	sys 0.010s
I20260709 12:22:01.092195  4325 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:01.095695  8637 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:01.096390  8637 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.098973  4984 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:22:01.095685  8725 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:01.100286  8638 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:01.104933  8568 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.105887  8637 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:01.137336  8770 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:01.137842  8770 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:01.054385  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:01.015074  8359 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:01.048229  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.055336  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.069761  8780 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.048952  8709 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.138669  8770 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.071111  8785 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:01.052281  8687 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:01.148979  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 94651.2us
W20260709 12:22:01.163740  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 108494us
W20260709 12:22:01.152033  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 114340us
I20260709 12:22:01.159128  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.156750  8773 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:01.170672  8773 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:01.171283  4408 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:22:01.161026  8778 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:01.171777  4408 pending_rounds.cc:85] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 8
I20260709 12:22:01.172089  4408 pending_rounds.cc:107] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:22:01.172320  4408 raft_consensus.cc:2889] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:01.172430  4405 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:01.172773  8780 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:01.173558  4407 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:01.173290  8780 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.174640  8770 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:01.174010  8792 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:01.176506  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.177222  4407 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:01.183122  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:01.157338  8585 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:01.195824  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.199520  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.163350  8785 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:01.200776  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:01.201579  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.208928  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.186486  8165 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:01.223980  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.224395  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:01.188580  8585 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.225867  4327 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:01.234297  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.235199  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:01.236469  4405 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:01.236730  4991 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:22:01.238387  4329 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:01.199772  8763 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.240203  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.247680  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.251927  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.216190  8804 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:01.258409  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.261804  4401 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:01.171546  8773 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.258409  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.268116  4407 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:01.287750  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.275681  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.288938  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.236009  8585 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:01.240984  8029 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:01.295784  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 268879us
I20260709 12:22:01.299480  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.304859  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.295158  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.260856  8804 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:01.268627  8717 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:01.260161  8568 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:01.259928  8596 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:01.337587  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.344787  4401 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:01.303346  8768 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:01.383551  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.385604  4401 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:01.254633  8763 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.305760  8780 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.388273  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.314276  8814 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:01.310797  8029 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:01.356082  8825 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:22:01.343506  8804 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:01.465886  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.304697  8779 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:22:01.461644  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:01.290027  8359 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.461374  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.470317  4329 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:01.501422  4409 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:01.458927  4326 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:22:01.469513  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 170146us
I20260709 12:22:01.503899  4219 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.507493  8766 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:01.472628  4334 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:01.359648  8596 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.293975  8785 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.467941  8029 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:01.339406  8829 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.386667  8568 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.471973  8691 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:01.461329  8811 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.527547  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:01.525822  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61387.1us
I20260709 12:22:01.464871  8716 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:22:01.516737  8596 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:01.389143  8717 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.458640  8768 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.528894  8785 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.556190  4407 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:01.474347  8814 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.572907  8699 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:01.591255  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 71203.4us
I20260709 12:22:01.592090  4407 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:01.500751  8165 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.585866  8712 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.557807  8829 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.599826  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.603222  4327 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:01.604000  8826 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:22:01.604609  8768 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.609246  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 1057) took 1122 ms. Trace:
I20260709 12:22:01.609673  4990 rpcz_store.cc:276] 0709 12:22:00.486436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.487608 (+  1172us) service_pool.cc:224] Handling call
0709 12:22:00.487991 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.647759 (+159768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.647790 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.660607 (+ 12817us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.194264 (+533657us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:01.194296 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.194358 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.609021 (+414663us) raft_consensus.cc:1685] finished
0709 12:22:01.609043 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.609183 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35923,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"thread_start_us":647061,"threads_started":2,"wal-append.queue_time_us":650564}
I20260709 12:22:01.596398  8699 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:01.617063  8833 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:22:01.618214  8834 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:22:01.619930  8836 log.cc:927] Time spent T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:22:01.621472  8837 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:01.622750  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 977) took 1027 ms. Trace:
I20260709 12:22:01.623134  4983 rpcz_store.cc:276] 0709 12:22:00.595135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.595337 (+   202us) service_pool.cc:224] Handling call
0709 12:22:00.595728 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.825176 (+229448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.825232 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.021687 (+196455us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.314083 (+292396us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:01.314137 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.314433 (+   296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.622513 (+308080us) raft_consensus.cc:1685] finished
0709 12:22:01.622534 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.622684 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42158,"raft.queue_time_us":63102,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3761,"thread_start_us":348891,"threads_started":2,"wal-append.queue_time_us":427016}
I20260709 12:22:01.628252  8717 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:01.632668  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:01.636133  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:01.636981  8844 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:01.641440  8528 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:01.648305  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:01.649061  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.649312  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.653044  4329 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
W20260709 12:22:01.659116  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.553169  8811 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.668275  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.671926  8795 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:01.676764  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:01.683588  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.686625  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:01.687240  4985 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:01.686878  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.689467  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:22:01.696205  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 142844us
I20260709 12:22:01.697132  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:01.699680  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:01.700563  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.701115  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.702836  4404 raft_consensus.cc:2393] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 14: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:01.704391  4988 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:01.650516  8712 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:01.716532  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 2053) took 1374 ms. Trace:
I20260709 12:22:01.718582  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.717046  4257 rpcz_store.cc:276] 0709 12:22:00.335403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.335549 (+   146us) service_pool.cc:224] Handling call
0709 12:22:01.709931 (+1374382us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400085cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:01.710023 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411148672}
I20260709 12:22:01.705158  8717 raft_consensus.cc:2764] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:22:01.708642  8765 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:01.727578  8829 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:01.730706  8725 consensus_meta.cc:287] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.000s
I20260709 12:22:01.695336  8831 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:22:01.674880  8709 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.733916  8811 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:01.737434  8816 log.cc:927] Time spent T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.684s	user 0.003s	sys 0.000s
I20260709 12:22:01.707284  8763 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:01.763655  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.764536  4325 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:01.726851  8638 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:01.740595  4985 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:01.741592  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:01.752606  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.722090  8822 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:01.737818  8029 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.786046  4334 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:01.737735  8585 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:01.790802  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 49311.1us
I20260709 12:22:01.791631  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.792538  8717 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:01.792930  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:01.793479  8717 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:01.753748  8765 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:22:01.791671  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 123526us
I20260709 12:22:01.760697  8568 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:01.797143  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:01.789178  8638 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.810072  8092 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:01.788753  8372 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.789961  8814 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:01.798841  8763 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:01.823576  8029 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:01.824769  8821 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.809s	user 0.004s	sys 0.000s
I20260709 12:22:01.852815  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 1164) took 1236 ms. Trace:
I20260709 12:22:01.853284  4328 rpcz_store.cc:276] 0709 12:22:00.616609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.616816 (+   207us) service_pool.cc:224] Handling call
0709 12:22:00.617204 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.636581 (+ 19377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.636628 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.637136 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:22:00.748868 (+111732us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:00.748927 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.749021 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.824199 (+1075178us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:01.852536 (+ 28337us) raft_consensus.cc:1685] finished
0709 12:22:01.852558 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.852752 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4088,"raft.queue_time_us":4154,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9494,"spinlock_wait_cycles":4560256,"thread_start_us":109242,"threads_started":1,"wal-append.queue_time_us":278220}
I20260709 12:22:01.828402  8585 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.834941  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.836544  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 981) took 1213 ms. Trace:
I20260709 12:22:01.837184  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.855944  8811 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:01.849068  4991 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:01.857033  4248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 905) took 1373 ms. Trace:
I20260709 12:22:01.851173  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.857385  4248 rpcz_store.cc:276] 0709 12:22:00.484079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.484287 (+   208us) service_pool.cc:224] Handling call
0709 12:22:00.484677 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:00.485079 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:00.534512 (+ 49433us) log.cc:844] Serialized 14 byte log entry
0709 12:22:00.689945 (+155433us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:00.716503 (+ 26558us) log.cc:844] Serialized 52 byte log entry
0709 12:22:00.716689 (+   186us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:00.723414 (+  6725us) log.cc:844] Serialized 14 byte log entry
0709 12:22:00.913936 (+190522us) log.cc:844] Serialized 14 byte log entry
0709 12:22:00.936247 (+ 22311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:00.936324 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.737133 (+800809us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b2400181e98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadb179c4 00007fdbadb15acb 00007fdbadcd0dc9 00007fdbadcd0a55 00007fdbadcd009d 00007fdbb090210e 00007fdbb091988c 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221
0709 12:22:01.856795 (+119662us) raft_consensus.cc:1685] finished
0709 12:22:01.856816 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:01.856948 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141446,"prepare.queue_time_us":136300,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":4581,"raft.queue_time_us":268678,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":14596,"spinlock_wait_cycles":199371136,"thread_start_us":127311,"threads_started":1,"wal-append.queue_time_us":363729}
I20260709 12:22:01.855975  4985 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:01.856138  4984 rpcz_store.cc:276] 0709 12:22:00.623225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.921485 (+298260us) service_pool.cc:224] Handling call
0709 12:22:00.921788 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:01.099427 (+177639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.836281 (+736854us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400648554. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:01.836478 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406871808}
I20260709 12:22:01.866102  8709 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.841876  8568 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:01.867626  8850 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:22:01.871410  8831 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.872244  8831 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.873816  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:01.802807  8765 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.879832  8860 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.880575  8860 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.885900  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.886889  4328 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:01.842276  8763 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.888046  8763 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:01.889390  8854 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
W20260709 12:22:01.890380  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:01.891791  8638 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:01.892869  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:01.893538  4983 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:01.894152  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.896633  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:01.897147  4984 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:01.897087  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:01.896390  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:01.898694  4991 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEARNER]: Advancing to term 9
I20260709 12:22:01.897415  4990 raft_consensus.cc:2368] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15.
I20260709 12:22:01.903615  8767 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:01.904099  8767 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:01.904497  8767 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:01.906805  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.906776  4991 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:01.874933  8831 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.912621  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.913324  4403 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:01.909909  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:01.911255  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:01.916245  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.920760  8168 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:01.921367  8168 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.913367  8813 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:01.933681  8813 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.936038  8813 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.922637  8860 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.938148  8763 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:01.940603  4983 raft_consensus.cc:2468] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:01.942541  4249 raft_consensus.cc:606] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:01.944162  4249 raft_consensus.cc:614] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:01.951818  4403 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:01.958772  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:01.959792  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.963567  4988 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:01.965819  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:01.913313  8787 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:22:01.962949  8709 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:01.972636  8168 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.969663  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.981098  4371 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:01.962848  8763 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:01.987978  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:01.984135  8792 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:02.003039  8804 consensus_meta.cc:287] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 12:22:01.989358  8716 raft_consensus.cc:2804] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:02.025321  8817 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.026324  4990 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:02.026559  8165 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:02.027395  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.027657  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:02.028198  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.028743  8694 raft_consensus.cc:993] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:02.028908  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.114692  4248 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:02.029551  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.116248  4257 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:02.034958  8772 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:02.035357  8790 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:01.987233  8168 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:02.035861  8692 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:02.037774  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:02.134946  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 97271.9us
I20260709 12:22:02.136476  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.121690  8716 raft_consensus.cc:697] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:02.131587  8805 raft_consensus.cc:1081] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:02.167876  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.171023  4255 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:02.139782  8829 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:02.083101  8804 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:02.111711  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 205754us
I20260709 12:22:02.155507  8558 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:02.073433  8792 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.182451  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.133195  8165 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.137763  8168 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.188318  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.118150  8817 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.196933  4984 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:02.180265  8858 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:02.185148  8558 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:02.217185  4255 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:02.222569  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.199839  8787 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:02.231916  8168 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:02.234140  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:02.235610  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:02.236891  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.237149  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:02.237514  4249 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:02.238247  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.238921  4256 raft_consensus.cc:2393] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:02.240002  8558 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:02.240911  8359 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:02.241802  8824 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.242393  8824 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:02.244268  8867 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:22:02.252418  8838 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.524s	user 0.010s	sys 0.000s
I20260709 12:22:02.254405  8817 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:02.225077  8716 consensus_queue.cc:237] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.265760  8768 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:02.271183  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2715) took 1103 ms. Trace:
I20260709 12:22:02.271801  4400 rpcz_store.cc:276] 0709 12:22:01.164575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.167398 (+  2823us) service_pool.cc:224] Handling call
0709 12:22:01.167691 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:01.168092 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:01.168134 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:01.175666 (+  7532us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.470188 (+294522us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:01.470267 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.470384 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.251752 (+781368us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:02.256130 (+  4378us) raft_consensus.cc:1685] finished
0709 12:22:02.256160 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.267982 (+ 11822us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1976,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":34980096,"thread_start_us":265460,"threads_started":1,"wal-append.queue_time_us":529735}
I20260709 12:22:02.220396  8858 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:02.275156  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51312.3us
I20260709 12:22:02.275548  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:02.276161  4327 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:02.276444  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:02.277614  8875 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.277647  8772 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.278126  8875 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:02.207718  8785 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:22:02.281056  8766 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:02.281415  8766 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:02.282235  8766 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.286393  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:02.298380  4404 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:22:02.299926  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:02.300874  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 906) took 1793 ms. Trace:
W20260709 12:22:02.301441  8832 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.701s	user 0.003s	sys 0.008s
I20260709 12:22:02.301316  4253 rpcz_store.cc:276] 0709 12:22:00.507690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:00.507906 (+   216us) service_pool.cc:224] Handling call
0709 12:22:00.531739 (+ 23833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:00.558788 (+ 27049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:00.558818 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:00.561041 (+  2223us) log.cc:844] Serialized 26 byte log entry
0709 12:22:01.117218 (+556177us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b180038c5c0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:22:01.279640 (+162422us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:01.621237 (+341597us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b180038c5c0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc8e455 00007fdbb47763c7 00007fdbb0d889a7 00007fdbb0d980bf
0709 12:22:01.621388 (+   151us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.942409 (+321021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.300584 (+358175us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b540039e9d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:02.300631 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:02.300679 (+    48us) raft_consensus.cc:1685] finished
0709 12:22:02.300690 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.300811 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":416411,"prepare.queue_time_us":231042,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":361024,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":8276,"spinlock_wait_cycles":78379904,"thread_start_us":288347,"threads_started":2,"wal-append.queue_time_us":897330}
I20260709 12:22:02.304698  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:02.305388  4402 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
W20260709 12:22:02.306435  8596 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.005s
I20260709 12:22:02.306870  8596 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.308465  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:02.283706  8767 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.309899  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.311547  4987 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:02.312263  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.313474  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.313659  4401 raft_consensus.cc:2368] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:02.288645  4400 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:02.316090  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 983) took 1680 ms. Trace:
I20260709 12:22:02.315259  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:02.257318  8787 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:02.324395  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:02.321357  4986 rpcz_store.cc:276] 0709 12:22:00.635545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.011989 (+376444us) service_pool.cc:224] Handling call
0709 12:22:01.021851 (+  9862us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:01.025398 (+  3547us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:01.055750 (+ 30352us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.067217 (+ 11467us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180045ee00. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:22:01.305830 (+238613us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:01.338382 (+ 32552us) log.cc:844] Serialized 78 byte log entry
0709 12:22:01.338693 (+   311us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:01.348639 (+  9946us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.357328 (+  8689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.357415 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:01.973166 (+615751us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b180045ee00. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc91522 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:22:02.300769 (+327603us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:02.315805 (+ 15036us) raft_consensus.cc:1685] finished
0709 12:22:02.315835 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:02.316019 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15276,"prepare.queue_time_us":36909,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":9575,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":72826,"spinlock_wait_cycles":21000448,"thread_start_us":246290,"threads_started":1,"wal-append.queue_time_us":521358}
W20260709 12:22:02.331429  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 151898us
I20260709 12:22:02.326035  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:02.325570  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:02.341601  4296 leader_election.cc:400] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15.
I20260709 12:22:02.341940  4296 leader_election.cc:403] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:22:02.343274  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:02.321979  8831 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:02.347275  4402 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:02.345948  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:02.331578  8860 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:02.332573  8165 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:02.356972  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:02.361320  4327 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:02.362636  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:02.344617  8780 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:02.344306  8714 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:22:02.360095  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.334074  8763 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:02.367703  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:02.332023  8631 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:22:02.369366  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:02.371076  4247 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.344321  8372 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15.
I20260709 12:22:02.360417  8847 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:02.358544  8712 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:02.376965  4404 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:02.361047  8860 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.377082  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:02.357271  8829 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:02.368269  8877 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:02.368307  8787 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.445604  8787 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.371471  8714 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.366624  8780 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.399590  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:02.450266  4253 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:02.406769  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:02.450989  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:02.451817  4983 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.410936  4327 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.396145  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.406831  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:02.439900  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 77334.3us
I20260709 12:22:02.443545  8372 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:02.444806  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:02.453824  4402 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:02.364161  8792 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:02.412984  8860 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:02.455761  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:02.455847  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:02.407871  8767 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:02.404659  8772 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:02.400974  8858 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:02.454316  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 58262.6us
I20260709 12:22:02.412703  8829 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:02.489898  8829 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.508667  8883 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:02.449487  8714 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:02.450028  8877 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:22:02.448122  8647 consensus_queue.cc:1175] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aa405b398df42edbf74ee643aeb18dc" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 8 } }
I20260709 12:22:02.407485  8528 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:22:02.455569  8780 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:02.516265  4327 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:02.469008  4983 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:02.456374  8712 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:02.470054  8716 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:02.542246  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 86574.7us
I20260709 12:22:02.543040  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:02.534531  8786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.006s	sys 0.014s
I20260709 12:22:02.545674  4332 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:02.547597  8875 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:02.550031  8372 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:02.538127  8716 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:02.550696  8716 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:02.552088  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:02.556208  8882 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:22:02.556821  8865 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:22:02.557850  8881 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:22:02.570703  8824 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:02.578090  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:02.578487  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:02.578930  4405 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:02.582772  8877 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:02.548592  8786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.006s	sys 0.014s
I20260709 12:22:02.594142  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:02.600898  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:02.602599  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.603495  4247 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:02.611063  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:02.603818  8888 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:02.623338  8827 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:02.638193  8766 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:02.642620  8694 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:02.643057  8694 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:02.643850  8694 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.645036  8694 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:02.645912  8890 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:02.657233  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:02.663910  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52942.2us
W20260709 12:22:02.719060  8851 log.cc:927] Time spent T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.987s	user 0.007s	sys 0.010s
I20260709 12:22:02.686753  8780 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.671537  8824 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:02.674176  8890 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:02.859501  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 189358us
W20260709 12:22:02.862118  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:02.862666  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 197402us
I20260709 12:22:02.888715  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:02.863812  8885 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.335s	user 0.007s	sys 0.006s
I20260709 12:22:02.862759  8878 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.868026  8596 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:02.871071  8853 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:02.902839  8853 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.905406  8853 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:02.905777  8780 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:02.898223  8372 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:02.907212  8372 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:02.908085  8820 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:02.908180  8372 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.908828  8820 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.909482  8829 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:02.910207  8767 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:02.910768  8767 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:02.911725  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 1264) took 1005 ms. Trace:
I20260709 12:22:02.916085  4990 rpcz_store.cc:276] 0709 12:22:01.906388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.906547 (+   159us) service_pool.cc:224] Handling call
0709 12:22:02.911541 (+1004994us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540064d2d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:02.911665 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273115904}
I20260709 12:22:02.917623  4987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1256) took 1231 ms. Trace:
I20260709 12:22:02.919613  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:02.873364  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.891712  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:02.921283  4983 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:02.892746  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:02.896267  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:02.899463  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:02.901922  8804 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:02.902048  8778 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:02.927757  4247 raft_consensus.cc:3055] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:02.918253  4987 rpcz_store.cc:276] 0709 12:22:01.685933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.687432 (+  1499us) service_pool.cc:224] Handling call
0709 12:22:01.702496 (+ 15064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.312038 (+609542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.917259 (+605221us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400603bd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:02.917474 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400135552}
W20260709 12:22:02.977573  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 78194.5us
I20260709 12:22:02.900475  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:02.996838  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:02.981397  4990 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEARNER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:02.999903  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 99515.3us
W20260709 12:22:03.000437  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.000641  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:03.000861  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:02.930244  4247 raft_consensus.cc:740] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:03.006237  4983 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:22:02.877945  8824 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:03.008026  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:03.012305  4988 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.009114  4984 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:03.012629  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:02.873924  8712 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:02.911249  8820 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:02.931674  8168 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:02.979594  8823 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.034857  8712 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.000022  8858 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:03.035805  4991 raft_consensus.cc:1240] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:03.036684  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.054514  8823 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.023262  8824 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.055488  8568 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:22:03.057031  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.057624  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.065690  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:03.112699  4256 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:22:03.072486  8866 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.919s	user 0.002s	sys 0.000s
I20260709 12:22:03.073248  8709 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:03.074460  4988 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
I20260709 12:22:02.916311  8878 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:03.082737  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.089717  8810 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:02.893908  8714 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.010955  4247 consensus_queue.cc:260] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:02.900405  8860 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.099116  4325 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:03.023676  8804 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:03.102067  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 53541.4us
W20260709 12:22:03.113817  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.011539  8890 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:02.980934  8778 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.121683  4247 raft_consensus.cc:3060] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.146672  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:03.120445  8888 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.153900  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:03.115162  8699 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.161671  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:03.162557  4253 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:03.164467  4404 raft_consensus.cc:2393] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 15: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:03.159551  4247 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:22:03.119129  8709 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:03.165848  4247 pending_rounds.cc:85] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 8
I20260709 12:22:03.169258  4247 pending_rounds.cc:107] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:22:03.169618  4408 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:03.169622  4247 raft_consensus.cc:2889] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:03.165200  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 132184us
W20260709 12:22:03.184811  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 188076us
I20260709 12:22:03.160440  8767 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:03.161870  8165 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.188755  8558 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:03.144351  8810 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.189054  8691 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.203981  8165 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.204118  8558 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.204520  8691 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.206255  8165 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.206521  8558 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.206653  8691 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.208117  8823 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:03.216253  8716 consensus_meta.cc:287] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.008s
I20260709 12:22:03.218523  8878 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.216722  8716 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.148757  8780 consensus_queue.cc:1059] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:22:03.223220  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 300494us
I20260709 12:22:03.225984  4371 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:03.229547  4255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 2091) took 1148 ms. Trace:
I20260709 12:22:03.230079  4255 rpcz_store.cc:276] 0709 12:22:02.080831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.174801 (+ 93970us) service_pool.cc:224] Handling call
0709 12:22:03.229340 (+1054539us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b54003c05d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:03.229473 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78314880}
W20260709 12:22:03.230903  8766 consensus_meta.cc:287] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.007s
I20260709 12:22:03.160089  8888 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:03.231088  8787 consensus_meta.cc:287] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.785s	user 0.001s	sys 0.014s
I20260709 12:22:03.285989  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:03.286473  8831 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:03.290066  8778 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:03.233446  8894 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:22:03.225903  8829 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:03.309096  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 416980us
I20260709 12:22:03.235489  8767 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:03.330384  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 44465.3us
I20260709 12:22:03.341804  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:03.341288  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 303353us
I20260709 12:22:03.353222  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1263) took 1491 ms. Trace:
I20260709 12:22:03.353782  4985 rpcz_store.cc:276] 0709 12:22:01.862202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.862369 (+   167us) service_pool.cc:224] Handling call
0709 12:22:01.862731 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:01.863176 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:01.863204 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:01.863815 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:22:01.939773 (+ 75958us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:01.965212 (+ 25439us) log.cc:844] Serialized 14 byte log entry
0709 12:22:01.970409 (+  5197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:01.970478 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.071689 (+1101211us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:03.343385 (+271696us) raft_consensus.cc:1685] finished
0709 12:22:03.352939 (+  9554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.353136 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9936,"prepare.queue_time_us":26270,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":5354,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":181,"spinlock_wait_cycles":14162304,"thread_start_us":75542,"threads_started":1,"wal-append.queue_time_us":150833}
I20260709 12:22:03.372329  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.372208  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.282888  8849 consensus_queue.cc:1059] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:22:03.333513  8585 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:03.390379  4249 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:03.349448  8765 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.370457  8714 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:03.397336  8712 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:03.431993  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.435802  4332 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:03.446226  8910 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.446841  8910 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.448940  8910 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.451992  4257 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:03.452415  4257 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:03.452703  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:03.456333  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 98725.8us
I20260709 12:22:03.405369  8585 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:22:03.468726  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.408521  8765 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:03.477468  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.480135  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:03.484071  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:03.445237  8860 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.484680  4402 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:03.453125  4257 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.487951  4257 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:03.490636  4219 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:03.490621  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 123963us
I20260709 12:22:03.492937  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:03.493575  4406 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:03.497572  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:03.422042  8767 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:03.485189  8813 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:03.504159  4401 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1894) took 1593 ms (client timeout 2122 ms). Trace:
I20260709 12:22:03.509838  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:03.513875  4406 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
W20260709 12:22:03.515892  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.512880  4401 rpcz_store.cc:269] 0709 12:22:01.910801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.910951 (+   150us) service_pool.cc:224] Handling call
0709 12:22:03.503908 (+1592957us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000113d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:03.504084 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916225920}
I20260709 12:22:03.521132  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:03.490621  8585 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:03.528532  4401 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:03.529124  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:03.529551  4409 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:03.527773  8691 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.505539  8778 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:03.533687  4332 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.503531  8869 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:03.540100  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.541357  4296 leader_election.cc:400] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:03.544289  8877 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:03.548207  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 362127us
I20260709 12:22:03.549577  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:03.548274  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 361523us
I20260709 12:22:03.529919  8585 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:03.554427  4402 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
W20260709 12:22:03.560909  8911 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:03.551781  8823 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:22:03.564345  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.565224  4327 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:03.566092  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.537808  8691 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.566861  8765 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.524344  8813 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.568303  8691 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.568714  4249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 916) took 1276 ms. Trace:
I20260709 12:22:03.569092  4249 rpcz_store.cc:276] 0709 12:22:02.291867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.308203 (+ 16336us) service_pool.cc:224] Handling call
0709 12:22:03.568558 (+1260355us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000f3a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:03.568657 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302492032}
I20260709 12:22:03.569679  8813 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:03.569191  8585 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.570508  8914 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:03.570631  8585 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.572863  8804 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:03.573413  8804 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.575913  8804 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:03.576370  8824 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.577190  8773 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:03.577454  4992 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:03.582937  8897 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:22:03.583683  8824 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.584000  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:03.586841  8858 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:22:03.588048  8912 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:03.591603  8888 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.593186  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.594471  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.596172  8709 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.598239  8709 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.595053  4328 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:03.620081  4326 raft_consensus.cc:1240] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:03.620566  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 68186.1us
W20260709 12:22:03.620855  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67639.7us
I20260709 12:22:03.628091  4985 raft_consensus.cc:1275] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:03.628652  8565 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:03.551934  8869 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.630050  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:03.632205  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:03.633221  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 83816.7us
I20260709 12:22:03.555580  8907 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.629376  8918 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.636653  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:03.637494  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.646183  4328 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:03.638926  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:03.648501  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.649024  4992 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:03.647768  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.643774  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:03.652490  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:03.653669  4990 raft_consensus.cc:2393] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:03.652040  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:03.658164  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:03.655447  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:03.662019  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.637729  4219 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:03.663080  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.637846  8582 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.665645  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:03.679813  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:03.640630  8799 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:03.682070  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:03.682898  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.652904  8766 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:03.690615  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:03.683640  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:03.685583  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.686545  8790 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:03.687034  8810 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.682754  8699 consensus_queue.cc:1048] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:22:03.682962  8910 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:22:03.688898  8869 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.657721  8827 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.695243  4992 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:03.647975  8565 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.690326  8766 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.669034  8779 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:03.658600  8829 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:03.698544  8787 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:03.664842  8691 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:22:03.695783  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.684109  8582 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.696067  8647 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:03.692165  8790 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:03.772507  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.713047  8827 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.714776  8877 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:03.693655  8831 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:03.718392  4332 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:03.677994  8786 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.648195  8907 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:03.760109  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 94879.2us
I20260709 12:22:03.785744  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:03.787241  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:03.653292  8918 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.795972  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:03.775903  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.777563  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 139906us
I20260709 12:22:03.797925  8858 raft_consensus.cc:2764] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:22:03.798334  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.799594  4219 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:03.800756  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:03.690480  8799 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.774207  8765 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.804870  8799 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.788513  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:03.805106  8582 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.783577  4332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:22:03.805697  4327 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:03.805895  4332 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.806381  4332 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.746374  8829 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.808373  8168 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.808706  8829 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:03.808934  8168 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.774374  8790 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.812305  8787 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:03.812793  8918 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.804673  8765 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.738883  8766 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:03.641167  8767 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.811079  8168 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.817767  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:03.778636  8779 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:03.779970  8888 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:03.778378  8877 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:22:03.876538  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 58847.5us
I20260709 12:22:03.903081  4409 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:03.904141  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:03.817243  4332 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.907774  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:03.908493  4332 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:03.816875  8824 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:03.908526  4401 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:03.929293  4327 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:03.930704  8565 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:03.898452  8920 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:03.879580  8778 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.936101  8848 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.936422  8778 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.936944  8848 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.938616  8778 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:03.870400  8922 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:03.906289  8918 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:03.791280  8786 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:03.812820  8787 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:03.899500  8923 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:03.906066  8853 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:04.032356  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.030001  8918 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:03.963378  8565 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:22:04.045027  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.033042  8848 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.029464  8877 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.038012  8779 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.056335  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:04.057123  8765 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.058033  8786 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.060895  8787 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.031747  8923 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.061821  8918 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.063724  8923 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.065189  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.065554  8827 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.065980  8774 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:04.067670  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:04.068598  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.069283  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.069891  4328 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:04.070809  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.071430  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:04.033628  8853 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.049412  8709 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.072940  4219 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:04.079310  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.081382  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.082093  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.082221  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:04.085162  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 191550us
I20260709 12:22:04.086401  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.089975  4328 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:04.098285  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.077764  8914 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:04.084350  8774 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:04.119764  8774 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:04.120291  8774 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:04.123679  8907 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.136330  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.137508  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:04.151710  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:04.154479  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.138216  4401 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:22:04.097682  8780 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:04.166620  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:04.168396  4331 raft_consensus.cc:2376] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10. Re-sending same reply.
W20260709 12:22:04.146047  8866 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:22:04.172219  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.178429  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.085842  8709 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.178498  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.180568  4257 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:04.181634  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.182265  4255 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
W20260709 12:22:04.189152  4404 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 962) took 1611 ms (client timeout 2009 ms). Trace:
I20260709 12:22:04.182493  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:04.196977  8853 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.197837  8709 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.173990  8165 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.198768  8165 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.173086  8558 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.199661  8558 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.200729  8165 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.201704  8558 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.201882  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:04.202272  8773 consensus_meta.cc:287] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.625s	user 0.000s	sys 0.014s
I20260709 12:22:04.204053  4254 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
W20260709 12:22:04.189778  4404 rpcz_store.cc:269] 0709 12:22:02.577610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.589299 (+ 11689us) service_pool.cc:224] Handling call
0709 12:22:04.188961 (+1599662us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54003c55d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:04.189081 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294039808}
I20260709 12:22:04.206522  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.209781  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.161419  8914 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:04.220534  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.221380  4247 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:22:04.222702  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 115044us
I20260709 12:22:04.223971  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.225375  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:04.226202  8933 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.226678  8933 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.227070  8933 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.230491  8829 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.231765  8920 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:04.231879  8922 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:04.232296  8920 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:04.232802  8202 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:04.232888  8829 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.233285  8202 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:04.234229  8202 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.235427  8202 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.236835  8774 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:04.213732  8585 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.643s	user 0.014s	sys 0.002s
I20260709 12:22:04.240725  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.242280  4256 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:04.218358  8827 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:04.207522  8785 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.241623  4328 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:04.246057  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:04.255126  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.266952  4219 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:04.270918  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.276854  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:04.279323  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:04.280457  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.281626  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.286248  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:04.287824  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.290604  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:04.290609  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.270602  8585 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.270696  8827 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:04.277665  8165 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:04.233175  8920 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.259871  8790 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.284844  8922 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.266561  8785 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.297585  8800 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:04.295439  8923 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:04.293283  8824 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:04.266337  8933 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.298339  8799 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.305931  8585 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.306478  8165 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.317946  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:04.329557  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.329474  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:04.344074  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.309499  8829 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:04.345700  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 55145.4us
I20260709 12:22:04.318161  8800 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:04.328186  8920 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.350827  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:04.324769  8799 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:04.351769  4247 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:04.338480  8165 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.353941  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:04.355187  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.355903  4257 raft_consensus.cc:2368] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10.
I20260709 12:22:04.356912  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.357677  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.358711  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.349677  8810 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:04.361292  4247 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:04.365321  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.351012  8800 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.366976  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:04.359817  8810 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:04.321794  8922 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.352664  8799 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.370904  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:04.372352  4253 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:04.372699  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:04.369735  8810 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.368273  4247 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:04.376245  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:04.377206  8907 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:04.377832  8716 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.378180  8907 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:04.365808  8774 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.382284  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:04.383725  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:04.384584  4988 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:04.373730  8787 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:22:04.401305  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:04.402963  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.404265  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:04.405728  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:04.406874  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:04.408183  8694 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:22:04.413075  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:04.414577  4404 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:04.415655  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.422060  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.313110  8914 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.428682  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:04.429895  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.431713  4253 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:04.432222  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:04.432967  4402 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:04.435547  4249 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:04.442018  4247 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:04.443430  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:04.449487  8765 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.450078  8765 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.450901  8907 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:04.446238  8774 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.452463  8774 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.452415  8765 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.466980  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:04.467200  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:04.468641  4332 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:04.471426  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:04.474466  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 71583.9us
I20260709 12:22:04.481614  4371 leader_election.cc:400] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10.
I20260709 12:22:04.482019  4371 leader_election.cc:403] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:04.484846  4402 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:04.487819  8765 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:04.488509  8765 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.395061  8800 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.483196  8923 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:04.491935  8800 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:04.492684  4991 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:04.494036  8919 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.920s	user 0.005s	sys 0.008s
I20260709 12:22:04.496769  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:04.353700  8827 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.478997  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.484566  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:04.487453  8585 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:04.838043  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 359116us
I20260709 12:22:04.861346  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:04.862984  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:04.863884  8920 consensus_meta.cc:287] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.510s	user 0.014s	sys 0.000s
I20260709 12:22:04.864410  8800 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:04.865404  8800 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:04.838188  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 330859us
I20260709 12:22:04.843254  8909 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:04.866467  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.867328  8528 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:04.868067  8528 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.870759  8528 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:04.875859  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.847054  8765 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.886001  8528 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.886724  8528 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.889426  8528 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.891654  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:04.845476  8810 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.839290  8918 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:04.848630  8910 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.895810  8910 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:04.897531  8810 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:04.897970  8910 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.898204  8810 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:04.947857  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.848378  8165 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.956744  4253 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:04.957887  8165 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.443971  8694 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:04.958837  8694 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:04.966778  8694 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.505266  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:04.997370  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 492159us
I20260709 12:22:04.998534  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:04.850304  8790 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.852226  8922 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:04.853292  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:04.506807  8766 consensus_meta.cc:287] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.608s	user 0.007s	sys 0.007s
I20260709 12:22:05.000909  8766 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.003737  4252 raft_consensus.cc:2368] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11.
I20260709 12:22:05.005599  8766 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:04.854398  4332 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:04.858712  8558 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:05.010363  8558 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.013757  8558 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:05.014807  4403 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:04.486712  8848 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:22:05.058606  8694 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:05.061347  8790 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:05.069178  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 70778.8us
I20260709 12:22:05.108275  8810 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.109025  8910 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.109037  8810 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.109640  8910 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.111999  8910 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.109735  8694 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.112790  8810 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:04.849514  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.121697  4250 raft_consensus.cc:2410] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:05.113915  8714 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:05.126272  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55960.7us
I20260709 12:22:04.866514  8799 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.113054  8694 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.138860  8714 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:05.143168  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:05.130981  4250 pending_rounds.cc:85] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 7
I20260709 12:22:05.131959  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:05.134826  4148 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 7 to 8, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 8 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:05.117903  8909 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:05.172686  4250 pending_rounds.cc:107] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:22:05.173133  4250 raft_consensus.cc:2889] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:05.174721  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 308298us
I20260709 12:22:05.175627  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:05.178730  4257 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:05.179941  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:05.181835  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:05.145249  8694 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:05.183270  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:05.187114  4330 raft_consensus.cc:2410] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:05.189225  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.157977  8824 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.193579  8951 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:05.165400  8820 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:05.195184  4992 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:05.195514  4257 raft_consensus.cc:2410] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:05.200240  4401 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:05.204499  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:05.184067  8920 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:05.209548  8920 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.211787  8920 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.215575  4332 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:22:05.236390  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59776us
I20260709 12:22:05.245379  8909 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.249975  8799 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.199929  8951 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.258723  8951 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:05.263710  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.264987  4257 raft_consensus.cc:2410] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:05.207227  8915 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.280875  4257 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:22:05.282987  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 82742.9us
I20260709 12:22:05.283324  4401 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:05.284698  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:05.286028  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 96379.2us
I20260709 12:22:05.199441  8824 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.255054  8853 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:05.289853  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.290474  4257 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:22:05.203583  8820 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.291839  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:05.298370  8820 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.300424  8647 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:05.300812  8647 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:05.301294  8824 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.301612  8647 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.302938  8848 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10.
I20260709 12:22:05.287638  8915 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.306209  8915 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:05.308338  4149 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 387) took 16615 ms (client timeout 15000 ms). Trace:
I20260709 12:22:05.225255  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.316110  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 1100) took 1039 ms. Trace:
I20260709 12:22:05.316504  4985 rpcz_store.cc:276] 0709 12:22:04.276396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.276540 (+   144us) service_pool.cc:224] Handling call
0709 12:22:04.293094 (+ 16554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.327521 (+ 34427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.327553 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:04.327596 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:04.327628 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.315865 (+988237us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b54006af9d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.315908 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.316047 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78698752}
I20260709 12:22:05.296021  8951 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.327842  8951 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:05.328944  8934 log.cc:927] Time spent T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.981s	user 0.008s	sys 0.003s
I20260709 12:22:05.330404  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1286) took 1257 ms. Trace:
I20260709 12:22:05.330580  8647 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:05.330933  4989 rpcz_store.cc:276] 0709 12:22:04.073360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.075931 (+  2571us) service_pool.cc:224] Handling call
0709 12:22:04.084867 (+  8936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:04.085197 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.085231 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.085694 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.219887 (+134193us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:04.219925 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.219988 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.322643 (+1102655us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:05.330076 (+  7433us) raft_consensus.cc:1685] finished
0709 12:22:05.330105 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.330325 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":682,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9799,"spinlock_wait_cycles":2294528,"thread_start_us":95263,"threads_started":1,"wal-append.queue_time_us":183637}
I20260709 12:22:05.336299  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2847) took 1954 ms. Trace:
I20260709 12:22:05.336867  4327 rpcz_store.cc:276] 0709 12:22:03.381683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.807840 (+426157us) service_pool.cc:224] Handling call
0709 12:22:03.808166 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.929748 (+121582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.322131 (+1392383us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400164754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.336217 (+ 14086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278139776}
I20260709 12:22:05.337700  8922 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.338326  8922 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.339341  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 964) took 1437 ms. Trace:
I20260709 12:22:05.339823  4408 rpcz_store.cc:276] 0709 12:22:03.901981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.903823 (+  1842us) service_pool.cc:224] Handling call
0709 12:22:03.904066 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.906153 (+  2087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.906181 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:03.906229 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:03.906284 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.339045 (+1432761us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b54002a85d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.339103 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.339244 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4344704}
I20260709 12:22:05.341126  8875 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.341643  8875 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.343317  8922 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:05.308797  4149 rpcz_store.cc:269] 0709 12:21:48.692820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:48.693114 (+   294us) service_pool.cc:224] Handling call
0709 12:22:05.308223 (+16615109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:58.319947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:58.320693 (+   746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:58.320747 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:21:58.320771 (+    24us) tablet.cc:662] Decoding operations
0709 12:21:58.322419 (+  1648us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:58.322559 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:58.322594 (+    35us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:21:58.333508 (+ 10914us) tablet.cc:701] Row locks acquired
0709 12:21:58.333559 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:21:58.333719 (+   160us) write_op.cc:270] Start()
0709 12:21:58.333862 (+   143us) write_op.cc:276] Timestamp: P: 1783599718333652 usec, L: 0
0709 12:21:58.333903 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:21:58.334686 (+   783us) log.cc:844] Serialized 6548 byte log entry
0709 12:21:58.663856 (+329170us) op_driver.cc:464] REPLICATION: finished
0709 12:21:58.706970 (+ 43114us) write_op.cc:301] APPLY: starting
0709 12:21:58.707090 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:58.991393 (+284303us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:59.022230 (+ 30837us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:59.324984 (+302754us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:59.325450 (+   466us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:21:59.325518 (+    68us) write_op.cc:312] APPLY: finished
0709 12:21:59.326081 (+   563us) log.cc:844] Serialized 148 byte log entry
0709 12:21:59.326303 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:59.326536 (+   233us) write_op.cc:454] Released schema lock
0709 12:21:59.326628 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:59.327105 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:59.327145 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":226821,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":42801,"apply.run_cpu_time_us":27078,"apply.run_wall_time_us":620106,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71007,"num_ops":16,"prepare.queue_time_us":153227,"prepare.run_cpu_time_us":30567,"prepare.run_wall_time_us":179227,"raft.queue_time_us":99702,"raft.run_cpu_time_us":11851,"raft.run_wall_time_us":70807,"replication_time_us":304796,"thread_start_us":308408,"threads_started":4,"wal-append.queue_time_us":178662,"wal-append.run_cpu_time_us":13000,"wal-append.run_wall_time_us":1811819}]]}
I20260709 12:22:05.344331  8875 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:05.330029  8951 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:05.346645  4372 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.130:42725 timed out after 1.509s (SENT) [suppressed 11 similar messages]
I20260709 12:22:05.348680  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:05.349435  4400 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:05.350369  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:05.350716  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:05.351555  4402 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:05.353116  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:05.354658  4408 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:05.356791  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:05.371990  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:05.372745  4408 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:05.374174  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.376765  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:05.378019  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:05.379505  4253 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:05.373445  8947 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:05.377439  4408 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:22:05.381309  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.384775  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.385587  4253 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:05.390038  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.394773  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.399144  4253 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:05.382205  8953 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:22:05.469033  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:05.498993  8956 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.499617  8875 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:05.498309  8714 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:22:05.498214  8717 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:22:05.522593  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 53690.8us
I20260709 12:22:05.529022  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:05.529629  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 179873us
I20260709 12:22:05.530144  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:22:05.526108  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 64107.3us
I20260709 12:22:05.533105  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.536339  4990 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:05.530550  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:05.384488  8947 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:05.564031  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:05.543785  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:05.627494  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.628335  4988 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:05.629245  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.630257  4989 raft_consensus.cc:2410] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:22:05.632121  4990 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:05.702834  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2528) took 2322 ms. Trace:
I20260709 12:22:05.544909  8888 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:05.704331  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 160628us
I20260709 12:22:05.703358  4326 rpcz_store.cc:276] 0709 12:22:03.342022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.345012 (+  2990us) service_pool.cc:224] Handling call
0709 12:22:03.345352 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.635976 (+290624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.663742 (+2027766us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54003d3954. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.663915 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584070912}
I20260709 12:22:05.706501  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1004) took 1352 ms. Trace:
I20260709 12:22:05.706671  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.540735  8824 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:05.711593  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.662573  8875 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:05.711668  4989 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:05.725649  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.728380  4988 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:05.725564  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.662002  8938 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:05.731834  4986 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:22:05.711057  4991 rpcz_store.cc:276] 0709 12:22:04.354553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.354686 (+   133us) service_pool.cc:224] Handling call
0709 12:22:04.367874 (+ 13188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.493106 (+125232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.706283 (+1213177us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400718754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.706444 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286570368}
I20260709 12:22:05.531241  8956 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.665382  8909 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.737310  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:05.709594  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 184889us
I20260709 12:22:05.609112  8952 consensus_queue.cc:1059] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:22:05.782200  8962 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.782975  8952 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:05.783021  8962 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.717285  8848 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:05.784493  8848 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.782266  8909 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.789124  8962 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:05.790406  8933 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:05.791742  4254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 2081) took 4264 ms (client timeout 1669 ms). Trace:
W20260709 12:22:05.792289  4254 rpcz_store.cc:269] 0709 12:22:01.526969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:01.527277 (+   308us) service_pool.cc:224] Handling call
0709 12:22:05.791495 (+4264218us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b540023ffd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:05.791629 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6115900160}
I20260709 12:22:05.794101  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 924) took 1623 ms. Trace:
I20260709 12:22:05.794576  4256 rpcz_store.cc:276] 0709 12:22:04.170873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.171010 (+   137us) service_pool.cc:224] Handling call
0709 12:22:04.171392 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.242689 (+ 71297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.793778 (+1551089us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b540016d354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.794029 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156065024}
I20260709 12:22:05.797719  8869 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.733023  8960 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:05.800211  8960 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.710017  8372 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:22:05.732671  8888 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:05.803898  8888 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.726086  8647 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.809283  8647 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.811421  4984 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 1091) took 2164 ms. Trace:
I20260709 12:22:05.813151  8647 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.810503  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.815764  4247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 2114) took 1374 ms. Trace:
I20260709 12:22:05.808492  4333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2858) took 2305 ms. Trace:
I20260709 12:22:05.817391  4333 rpcz_store.cc:276] 0709 12:22:03.502646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.933017 (+430371us) service_pool.cc:224] Handling call
0709 12:22:03.933267 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:04.037080 (+103813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.037100 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:04.037128 (+    28us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:04.037153 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.808228 (+1771075us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400252bd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.808268 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.808423 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238363008}
I20260709 12:22:05.717420  8699 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:05.819907  8699 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.820403  8699 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:05.826380  8959 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.827071  8959 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.831972  4992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 1296) took 1403 ms. Trace:
I20260709 12:22:05.832518  4992 rpcz_store.cc:276] 0709 12:22:04.428256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.428433 (+   177us) service_pool.cc:224] Handling call
0709 12:22:05.831753 (+1403320us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b5400637ed4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:05.831894 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683075456}
I20260709 12:22:05.816130  4247 rpcz_store.cc:276] 0709 12:22:04.441354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.443008 (+  1654us) service_pool.cc:224] Handling call
0709 12:22:05.810292 (+1367284us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:22:05.815707 (+  5415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4342016}
W20260709 12:22:05.775691  8954 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:22:05.727598  8824 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.772516  8823 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:05.727973  8875 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:05.734777  8938 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.783640  8952 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:22:05.838725  4252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 2106) took 1481 ms (client timeout 1811 ms). Trace:
I20260709 12:22:05.841627  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 999) took 2198 ms. Trace:
I20260709 12:22:05.842049  4983 rpcz_store.cc:276] 0709 12:22:03.643602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.643803 (+   201us) service_pool.cc:224] Handling call
0709 12:22:03.644102 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.774233 (+130131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:03.774268 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:03.774311 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:03.774351 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.839193 (+2064842us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002c3dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.839239 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.841575 (+  2336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298797824}
I20260709 12:22:05.844578  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:05.841204  4252 rpcz_store.cc:269] 0709 12:22:04.357520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.358544 (+  1024us) service_pool.cc:224] Handling call
0709 12:22:05.838523 (+1479979us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540044ded4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:05.838668 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481408256}
I20260709 12:22:05.867008  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:05.868249  4992 raft_consensus.cc:2393] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:05.811801  4984 rpcz_store.cc:276] 0709 12:22:03.647070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.647185 (+   115us) service_pool.cc:224] Handling call
0709 12:22:03.647471 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.782502 (+135031us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:03.961264 (+178762us) log.cc:844] Serialized 14 byte log entry
0709 12:22:04.176517 (+215253us) log.cc:844] Serialized 14 byte log entry
0709 12:22:04.176746 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:04.176789 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:04.176836 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.808011 (+1631175us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4800041c58. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:22:05.811159 (+  3148us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400498254. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:05.811207 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.811346 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19635,"prepare.queue_time_us":311187,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":3194,"raft.run_cpu_time_us":27619,"raft.run_wall_time_us":1712534,"spinlock_wait_cycles":313576192,"thread_start_us":337858,"threads_started":3,"wal-append.queue_time_us":141089,"wal-append.run_cpu_time_us":1883,"wal-append.run_wall_time_us":1111352}
I20260709 12:22:05.893776  4252 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:22:05.895354  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 2080) took 1426 ms. Trace:
I20260709 12:22:05.898523  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:05.807881  8935 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 1.523s	user 0.015s	sys 0.018s
I20260709 12:22:05.840744  8875 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:05.846287  8938 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:05.798401  8869 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.899212  4247 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:22:05.907604  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.895853  4250 rpcz_store.cc:276] 0709 12:22:04.469235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.127122 (+657887us) service_pool.cc:224] Handling call
0709 12:22:05.130749 (+  3627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:05.173669 (+ 42920us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:05.173696 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:05.174107 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:22:05.360202 (+186095us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:05.360242 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.360313 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.895082 (+534769us) raft_consensus.cc:1685] finished
0709 12:22:05.895109 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.895268 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":185792,"threads_started":1,"wal-append.queue_time_us":208827}
I20260709 12:22:05.909376  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.911773  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:05.923013  4372 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.004s	sys 0.014s
W20260709 12:22:05.913573  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 383102us
I20260709 12:22:05.919824  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.924096  4256 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:22:05.915894  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:05.924918  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:05.925676  4989 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:05.921269  4252 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:05.890523  8582 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:05.934209  4407 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:22:05.923368  4372 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.014s
W20260709 12:22:05.935073  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 588409us
W20260709 12:22:05.936059  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 391398us
I20260709 12:22:05.899240  8848 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:05.898838  8860 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:05.914414  8785 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.903806  8824 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.936726  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:06.047456  8372 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.036446  8901 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:22:05.943316  8582 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.050729  8372 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.959213  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.051601  8938 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.052934  8372 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.053220  8582 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:06.053653  8938 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.959547  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:06.038811  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.003755  8877 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.054553  4252 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:06.055114  8528 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.001562  8947 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:05.998952  8827 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.055734  8528 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.973754  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.056663  8827 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.991755  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2755) took 1858 ms. Trace:
W20260709 12:22:05.959780  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 205168us
I20260709 12:22:05.992296  8875 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.936575  8952 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:05.949565  8860 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.979491  8858 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.063632  8858 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.064531  8860 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:05.964332  8956 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.066007  8956 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.066373  8647 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.066493  8956 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:05.930032  8792 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:05.964723  8959 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.068176  8372 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:06.068576  8372 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.068919  8372 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.058848  8827 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.060441  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.072664  8915 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.058372  8528 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.062865  8875 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:05.961275  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:06.066902  8647 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.059029  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.015282  8960 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.077183  8647 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.079737  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.080410  4326 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
W20260709 12:22:06.067551  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 130895us
I20260709 12:22:06.081506  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:05.964931  8909 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:06.082860  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.082811  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:06.083786  8959 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.084831  8792 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:06.085515  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.087745  8922 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:22:06.087821  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 126633us
I20260709 12:22:06.093859  8792 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.094159  4984 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEARNER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:06.076916  8952 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.095517  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.096880  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.093400  8956 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.096432  8922 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:06.098264  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.098412  8922 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.099895  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.100337  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.101290  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:06.102079  4984 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:06.104796  8915 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.105252  8915 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.105638  8915 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.107937  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:05.991267  8774 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.110342  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.111052  4326 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:06.111125  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:06.112325  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 176536us
I20260709 12:22:06.112597  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.113924  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.114603  4252 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:06.116468  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.117286  4326 raft_consensus.cc:2410] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:22:06.118851  8910 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.964607  8869 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.119407  8910 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:06.121313  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 211707us
I20260709 12:22:06.122855  8910 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.123579  8860 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:06.127414  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.128589  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.129830  8967 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.130384  4325 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:06.130416  8959 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:06.131314  8959 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:06.133112  4992 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:06.131775  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:06.132356  4325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40644 (request call id 1201) took 2083 ms (client timeout 1926 ms). Trace:
I20260709 12:22:06.133383  8959 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:06.134536  4325 rpcz_store.cc:269] 0709 12:22:04.049078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.055132 (+  6054us) service_pool.cc:224] Handling call
0709 12:22:06.132170 (+2077038us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54001d51d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:06.132263 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4752369024}
I20260709 12:22:06.136618  8792 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:06.136860  8647 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:06.137280  8960 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.137418  8647 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.138002  8647 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:06.059963  4406 rpcz_store.cc:276] 0709 12:22:04.133375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.133539 (+   164us) service_pool.cc:224] Handling call
0709 12:22:04.133881 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:04.134317 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:04.134610 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:22:04.217837 (+ 83227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.218610 (+   773us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.218743 (+   133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:04.218777 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.218846 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.796628 (+1577782us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b48002001d8. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:22:05.806687 (+ 10059us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:05.991481 (+184794us) raft_consensus.cc:1685] finished
0709 12:22:05.991512 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.991682 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":612,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":7013,"raft.queue_time_us":964,"raft.run_cpu_time_us":40478,"raft.run_wall_time_us":1671330,"spinlock_wait_cycles":15532288,"thread_start_us":82796,"threads_started":1,"wal-append.queue_time_us":109371}
I20260709 12:22:06.137929  8960 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.145516  8875 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.146593  8875 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.147082  8858 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.148756  8875 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.149302  8875 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.149760  8875 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.151793  8827 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:06.153139  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:06.153836  4330 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.114871  8915 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.160043  8915 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.161505  4330 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:06.153227  8827 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:06.152611  8938 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.162572  8938 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.162992  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.166621  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.168097  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.166800  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.168713  4247 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:06.168864  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.169934  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.170224  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:06.170828  4326 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.171600  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:06.172595  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.173122  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.173723  4330 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:06.175132  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:06.176275  4327 raft_consensus.cc:2410] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:22:06.176568  8901 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:06.177208  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.177603  8938 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:06.178377  4406 raft_consensus.cc:2410] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:22:06.179593  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:06.180979  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.182005  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.182250  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.186673  4372 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.187704  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.192498  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.193641  4255 raft_consensus.cc:2368] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11.
I20260709 12:22:06.178009  8647 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.194944  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.196189  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.196645  4331 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:06.196996  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:06.197613  4406 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.197654  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.198664  8910 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.199172  8910 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.194772  8972 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.200018  4334 raft_consensus.cc:2368] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10.
I20260709 12:22:06.196189  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.197127  8779 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.208045  4332 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:06.208468  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.208827  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.208568  4329 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 6.
I20260709 12:22:06.211283  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.211539  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.211947  4327 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:06.213305  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:06.188474  8568 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:06.221477  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.207970  8860 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.223073  8910 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.222187  8972 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.226451  8972 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.221261  8568 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.227479  8694 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.227591  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.228235  4403 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:06.228379  8869 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.228643  8568 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.228973  8869 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.220345  4326 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:06.232761  4325 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:06.217509  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.163932  8827 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:06.251924  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.254319  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.255028  4372 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.263789  4406 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:06.200903  8915 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.267632  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.267586  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:06.272163  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 54773.7us
W20260709 12:22:06.275015  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 58616us
I20260709 12:22:06.270447  4219 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:06.275944  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.280716  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:06.285403  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.284646  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.289917  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.291361  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.278867  8972 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.270479  8951 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:06.280639  8824 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:06.277088  8568 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.298877  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.215898  8779 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.291316  8694 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:06.274525  8910 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.364917  8910 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.366592  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.297624  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.287199  8875 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.279493  8915 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.370508  8915 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:06.329933  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.306797  8901 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:06.372491  8901 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:06.287415  8949 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:06.323423  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.374433  4406 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 6.
I20260709 12:22:06.374205  8901 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.304401  4956 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.340554  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:06.330902  4219 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:06.420011  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 89179.8us
I20260709 12:22:06.420895  4219 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:22:06.331673  8699 consensus_meta.cc:287] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.000s
I20260709 12:22:06.424091  8699 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.426681  8699 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.317391  8165 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:06.427743  8165 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:06.428411  8165 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:06.429474  8165 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.431614  4401 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:22:06.306733  8916 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.435689  8916 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.309131  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.326017  8647 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.314843  8372 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.343487  8779 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.306402  8725 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:06.334698  8967 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.295395  8029 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:06.294811  8565 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:06.299721  8960 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.306162  8972 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.321171  8869 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.331050  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.507155  4407 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:06.364917  8694 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:06.377300  8910 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.284071  8827 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.391458  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.396165  4371 leader_election.cc:400] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11.
I20260709 12:22:06.521863  4371 leader_election.cc:403] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:06.412216  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 141063us
I20260709 12:22:06.419026  8959 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:06.423382  8923 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:06.419114  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 114802us
I20260709 12:22:06.457418  8725 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.450356  4405 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
W20260709 12:22:06.450572  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 141536us
I20260709 12:22:06.450675  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.507737  4333 raft_consensus.cc:1240] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
W20260709 12:22:06.529047  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 133079us
I20260709 12:22:06.452852  8699 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.538852  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.534960  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:06.452251  8778 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:06.458601  8029 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.458257  8565 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.547911  4372 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.550081  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:06.551236  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.533639  8915 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:06.524060  8959 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.536399  8947 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:06.566636  4372 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.542816  8725 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.555150  8565 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.553926  8716 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.623060  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:06.559636  8923 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:06.554100  8971 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:22:06.560045  8647 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:06.557114  8914 consensus_queue.cc:1059] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:22:06.622514  8831 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:06.618955  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52367us
I20260709 12:22:06.559523  8168 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:06.617766  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:06.644219  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 85105us
I20260709 12:22:06.544327  8778 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:06.556770  8960 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:06.611119  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.627605  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:06.591761  8959 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:06.589780  8823 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:06.547923  8029 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.633169  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.636204  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.636330  8916 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.628607  8774 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:06.635116  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.639362  8947 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.639921  4404 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:06.643272  4372 leader_election.cc:400] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10.
I20260709 12:22:06.608402  4405 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:06.642789  8831 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:06.655782  4325 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:06.631173  8647 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.650169  8910 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.665781  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.669750  4408 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:06.677618  8372 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.681336  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:06.681931  4325 raft_consensus.cc:2376] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11. Re-sending same reply.
I20260709 12:22:06.682848  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.683552  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.684652  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.685050  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:06.685192  4403 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:06.685981  8916 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:06.676071  8647 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:06.689579  8792 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:06.676412  8910 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.690543  8910 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.691074  8792 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:06.691561  8792 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:06.673594  8831 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:06.692481  8792 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.693657  8792 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:06.695176  8985 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:22:06.695957  8976 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.696527  8976 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.698664  8976 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.699648  8778 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.700682  8778 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:06.667387  8875 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:22:06.710458  8875 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:06.710829  8875 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:06.711961  8875 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.713598  8875 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.716449  8950 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:06.719329  4372 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.672791  8774 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.720717  8823 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:06.721246  8823 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:06.722126  8774 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.722098  8823 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.655467  8960 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.716898  8950 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:06.727252  8372 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:06.665247  8947 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:06.629736  8694 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.675465  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:06.734189  4406 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
W20260709 12:22:06.723402  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 46900.5us
I20260709 12:22:06.648648  4401 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:06.730996  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:06.736393  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.673868  4405 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:06.728894  8923 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.729123  8960 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:06.752023  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:06.741006  8910 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.752910  4984 raft_consensus.cc:2410] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:22:06.750792  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.751605  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:06.734380  8983 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 12:22:06.765278  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.759801  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.768097  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.768718  4986 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:06.732774  8972 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.769991  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.771104  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.777107  4984 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:06.763571  8725 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:06.778616  8982 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 12:22:06.780155  8725 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.781359  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.752461  8372 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.783814  8950 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.785009  8950 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.790274  8029 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.791872  8716 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.769145  8785 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:06.762890  8766 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:06.771823  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.772970  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.802269  8029 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:06.800547  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.807384  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.811450  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:06.824625  4252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.034s	sys 0.050s
I20260709 12:22:06.826227  8869 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.827265  8869 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.830067  8869 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.832031  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.834391  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:06.840910  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:06.818791  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 281041us
I20260709 12:22:06.826653  8888 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.842717  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:22:06.855782  4252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.034s	sys 0.050s
W20260709 12:22:06.875583  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 60662.4us
I20260709 12:22:06.868638  8849 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:06.822026  8716 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.877830  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:06.878306  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.800076  8766 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:22:06.843389  8785 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:06.882753  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:06.868350  8725 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:06.893559  8168 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:06.892963  8029 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:06.921990  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.892501  8785 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.920192  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:06.875726  8888 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.899631  8976 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:06.934899  4956 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:06.939549  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 271324us
I20260709 12:22:06.946971  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:06.924149  8877 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:06.931919  8785 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:06.925107  8869 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:06.966372  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 258044us
I20260709 12:22:06.951082  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.924471  8766 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.937989  8779 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.972445  8779 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.972745  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.974562  8779 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.938200  8165 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.958897  4256 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:06.943037  8773 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.924496  8975 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:06.976594  8975 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:06.965677  4148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 261) took 40034 ms (client timeout 15000 ms). Trace:
I20260709 12:22:06.944044  8976 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.978468  8647 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.969157  4152 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 8 to 9, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 9 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.966838  8869 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.967571  8565 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.974503  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:06.963639  4250 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:06.975251  8165 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:06.976500  8773 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.979457  8910 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.980209  8976 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:06.969538  8766 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.940310  8991 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:06.985754  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:06.988991  4983 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:06.990525  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:06.959995  8938 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:06.966851  8774 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:07.033492  4152 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 7 to 10, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 10 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.033882  4983 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:22:07.036051  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.038409  4334 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:06.961411  8810 consensus_queue.cc:1059] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:22:06.985497  8960 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:06.997087  8785 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.034456  8774 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:07.068955  8988 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:22:07.069972  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:07.072078  8773 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.069531  8774 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.073813  8774 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.074816  8766 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:06.996852  8869 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.058682  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.078389  4152 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 9, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 9 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.004360  8888 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.041812  4984 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.026273  8915 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11.
I20260709 12:22:07.010800  8725 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.109397  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.110122  4329 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:07.111651  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:07.111210  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:07.068248  8993 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:07.086199  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.123915  4327 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.031273  8991 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:07.049033  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 214724us
I20260709 12:22:07.128701  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:07.129861  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:07.026908  8998 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:06.977669  4148 rpcz_store.cc:269] 0709 12:21:26.927002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:26.932404 (+  5402us) service_pool.cc:224] Handling call
0709 12:22:06.961717 (+40029313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:05.839732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:05.840250 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:05.840290 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:22:05.840306 (+    16us) tablet.cc:662] Decoding operations
0709 12:22:05.844105 (+  3799us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:05.844180 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:05.844208 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:05.844405 (+   197us) tablet.cc:701] Row locks acquired
0709 12:22:05.844423 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:22:05.844596 (+   173us) write_op.cc:270] Start()
0709 12:22:05.844710 (+   114us) write_op.cc:276] Timestamp: P: 1783599725844544 usec, L: 0
0709 12:22:05.844730 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:05.845394 (+   664us) log.cc:844] Serialized 530 byte log entry
0709 12:22:06.104079 (+258685us) op_driver.cc:464] REPLICATION: finished
0709 12:22:06.354874 (+250795us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7b32a 00007fdbb0d00f14 00007fdbb0d00ec3 00007fdbb0d00e38 00007fdbb0d00df3 00007fdbb0d000dc 00007fdbb0d29e16 00007fdbb0d11cbb 00007fdbb0cfc39d 00007fdbb0cffd75
0709 12:22:06.554814 (+199940us) write_op.cc:301] APPLY: starting
0709 12:22:06.560882 (+  6068us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:06.783745 (+222863us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:06.783775 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:06.784592 (+   817us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:06.784757 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:22:06.784800 (+    43us) write_op.cc:312] APPLY: finished
0709 12:22:06.784970 (+   170us) log.cc:844] Serialized 25 byte log entry
0709 12:22:06.785137 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:06.785220 (+    83us) write_op.cc:454] Released schema lock
0709 12:22:06.785260 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:06.785648 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:06.785676 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4163860,"reported_tablets":41,"spinlock_wait_cycles":542592,"child_traces":[["op",{"apply.queue_time_us":420058,"apply.run_cpu_time_us":4365,"apply.run_wall_time_us":247560,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":508262,"prepare.run_cpu_time_us":17482,"prepare.run_wall_time_us":95784,"raft.queue_time_us":87498,"raft.run_cpu_time_us":52078,"raft.run_wall_time_us":300908,"replication_time_us":259171,"spinlock_wait_cycles":114311936,"thread_start_us":523576,"threads_started":4,"wal-append.queue_time_us":112726}]]}
I20260709 12:22:07.136655  4255 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:07.085995  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:07.077255  8975 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.137434  8991 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.146692  8998 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.105532  8976 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:22:07.148306  8976 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:07.148712  8976 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:07.149199  8998 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.149745  8869 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:07.149500  8976 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.150565  8823 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:07.151139  8976 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.151500  8647 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.151700  8823 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.152088  8823 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:07.113376  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:07.077020  8565 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.009819  8959 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.115226  4991 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:07.026984  8831 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.136432  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.165012  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.114425  8785 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.085024  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.092736  4152 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 10 to 13, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 13 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.166705  4332 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:07.141585  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.144363  4409 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:07.157961  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:07.168561  4329 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:07.152702  4985 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:07.168231  4152 catalog_manager.cc:5697] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:07.134618  4327 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:07.170228  4334 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:07.163182  4326 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.172626  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:07.173535  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.176534  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.177438  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 183302us
I20260709 12:22:07.177623  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.178176  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.178995  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.180217  4254 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:07.183099  4992 raft_consensus.cc:1240] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: []
W20260709 12:22:07.186571  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 295982us
I20260709 12:22:07.162221  8888 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.188565  4408 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:07.187949  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
W20260709 12:22:07.182633  8699 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 12:22:07.189100  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.199543  8029 raft_consensus.cc:3055] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:07.177083  8647 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:07.251561  8647 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:07.252167  8647 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:07.187691  8998 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:22:07.254303  8998 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.254655  8998 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:07.179466  8875 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:07.220330  4402 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:07.202523  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.199546  8372 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:07.220732  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:07.241173  8029 raft_consensus.cc:740] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:07.259478  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 52925.4us
W20260709 12:22:07.258845  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 56380.6us
W20260709 12:22:07.241865  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50423.1us
I20260709 12:22:07.221284  8699 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.263587  8029 consensus_queue.cc:260] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.268103  8029 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:07.274499  8947 consensus_meta.cc:287] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.001s
I20260709 12:22:07.259462  8858 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.259091  8938 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:07.274964  8947 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.255524  9005 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.257767  8875 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:07.276039  8938 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.285899  8938 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.285732  8823 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.279405  8716 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:22:07.267755  8998 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.292016  8947 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.292397  8998 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.293206  8831 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:07.288654  8875 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:07.298867  8959 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.287112  8823 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.303995  8960 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.309077  8165 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.315964  8991 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.318259  8991 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:07.325893  8875 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.363025  4152 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.380667  4152 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 12 to 14, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.382687  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.386093  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.386323  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:07.224218  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51708.9us
I20260709 12:22:07.389653  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.390259  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:07.401377  4330 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.403640  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:22:07.388499  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.409915  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 129674us
I20260709 12:22:07.411818  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.412842  4252 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:07.386281  4152 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:07.426067  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.430254  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.436121  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.436167  4152 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.453464  4986 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.472425  8787 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:07.473439  8787 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:07.476224  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:07.476984  8875 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.477300  4989 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:07.480839  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 207804us
I20260709 12:22:07.483702  8792 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:07.488567  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 300589us
I20260709 12:22:07.488976  8998 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.489657  8998 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.490077  8998 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.478886  8875 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:07.491729  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 85345.3us
I20260709 12:22:07.493860  4219 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.494035  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:07.495628  8774 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:07.493024  4152 catalog_manager.cc:5697] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 8, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 8 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.498925  4254 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:07.504841  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.501094  8725 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:07.499652  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.505264  8716 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:07.511029  8827 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.511911  8827 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.515826  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.515646  8647 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.518447  8647 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.512145  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:07.523388  8792 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.526296  4327 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:07.527880  8991 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:07.530454  8991 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:07.530905  8991 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:07.533030  8792 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:07.537110  8582 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:22:07.539309  4409 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:22:07.533259  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.534396  4986 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:07.532612  8991 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.534940  8916 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:07.540074  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:07.543756  8831 consensus_queue.cc:1059] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:07.475023  8787 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.544806  8774 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:07.547329  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.545737  8774 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.548004  8716 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:07.548765  8716 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:07.550788  8916 raft_consensus.cc:3055] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:07.551364  8916 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:07.515208  8827 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.553131  8916 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.554538  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:07.550362  8716 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.556322  8716 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.556546  8991 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:07.557444  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.561189  8916 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.569567  8823 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:07.570752  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.575448  8647 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:07.546917  4219 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.580255  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.590109  8774 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:07.595456  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 48774.8us
I20260709 12:22:07.596170  8165 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:07.595679  4152 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:07.576073  8647 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.610951  4989 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:07.618171  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:07.623976  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.625077  8849 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:07.625571  8849 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:07.625924  8849 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.584270  4986 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:07.636310  8725 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:07.636122  8787 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:07.636936  8725 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:07.637636  8725 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.638338  8888 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:07.638907  8888 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:07.639588  4985 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.639714  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.640170  8888 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.642088  8888 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.611413  8165 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.642724  8165 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:07.651008  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.619642  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.656730  8947 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:07.656909  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55257.8us
I20260709 12:22:07.613720  8647 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.625077  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.664386  8976 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:07.664985  8976 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:07.666038  4330 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.666101  8976 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.669576  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:07.672473  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 142837us
I20260709 12:22:07.681412  8792 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:07.682376  8792 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.683648  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.684487  4330 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:07.685051  8792 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.687114  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.688161  4329 raft_consensus.cc:2410] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:07.695637  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.697528  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.703691  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.711802  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.711943  8998 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.714753  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.715490  4408 raft_consensus.cc:2468] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
I20260709 12:22:07.716482  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.718721  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.719784  8938 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:07.720446  8774 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:07.721164  8774 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.720467  8938 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.723919  8824 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:07.724041  8165 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.724632  8824 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.725159  8938 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.751626  8372 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:07.749329  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.751238  8787 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.755765  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.750968  8910 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.739287  8792 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:07.773857  8910 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.726325  8165 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.760895  8923 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.714998  8998 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.775681  8923 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.777060  4252 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.778541  8923 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.766748  8774 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.779237  8923 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.764879  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.780012  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.697436  4152 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 8 to 9, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 9 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.737246  4955 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.695904  8849 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:07.781661  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 44537.5us
I20260709 12:22:07.783111  8849 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:07.767757  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.784293  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.733352  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.784444  8991 raft_consensus.cc:2804] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:07.787186  8991 raft_consensus.cc:697] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:07.739354  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:07.788805  4402 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.789677  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.790323  8991 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.779836  8923 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.792670  4256 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:07.774309  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.793489  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.794883  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.795608  4255 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:07.796989  4406 raft_consensus.cc:2410] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:22:07.799430  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.800129  4255 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:07.773880  8792 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.800148  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.774505  8824 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.734047  4329 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:07.795902  8923 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:07.833920  4254 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:07.838397  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.767287  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.841356  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.842711  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.835088  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.852458  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.794921  8787 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:07.854864  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.862040  4254 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:07.848785  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.843248  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.863098  4330 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:07.849149  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.865754  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:07.866074  4252 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:07.868589  4333 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:07.864603  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.871031  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.873863  8792 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:07.874539  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.875746  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:07.879493  8910 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:07.869010  8725 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.853499  8372 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:07.874586  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:22:07.889117  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 83896.6us
I20260709 12:22:07.892311  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:07.895711  4247 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:07.898008  8647 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.899446  8998 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:07.900415  8998 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:07.849957  8565 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:07.900768  8998 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:07.901146  8565 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.901726  8998 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:07.903600  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:07.908427  9005 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:07.908887  9005 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.909245  9005 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:07.912122  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.913031  8823 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:07.914469  8831 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:07.915534  8372 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:07.916684  8372 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.903052  8998 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:07.888104  8916 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:07.926483  4992 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:07.919046  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.930508  4402 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:07.931027  4219 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.935400  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:07.937148  4255 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:07.938457  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:07.947636  4328 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:07.880040  8875 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:22:07.960139  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:07.961978  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46952.2us
I20260709 12:22:07.963004  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:07.964264  8823 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:07.965426  8029 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:07.932305  8888 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:07.966667  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 43718.8us
I20260709 12:22:07.975641  8914 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:07.982784  8875 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:07.983269  8875 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:07.947430  8849 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:07.965818  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:07.984277  8875 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:07.956898  8565 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:08.005548  4247 raft_consensus.cc:2468] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
I20260709 12:22:08.005996  8647 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.061844  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:08.007233  8923 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.008716  8914 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:08.074257  4330 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:08.002341  8165 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 12:22:08.113478  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 237823us
I20260709 12:22:08.097441  8916 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.125936  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 131305us
I20260709 12:22:08.080731  8923 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.103747  8910 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:08.127987  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:08.118602  8875 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.131260  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:08.118669  8725 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:08.139978  4247 pending_rounds.cc:85] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 8
W20260709 12:22:08.140239  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 174498us
I20260709 12:22:08.127061  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:08.137481  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:08.145834  4986 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:08.146363  9021 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:22:08.152832  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.140333  4247 pending_rounds.cc:107] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:22:08.144565  4219 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:08.154318  4986 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:08.127924  8916 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.153575  4247 raft_consensus.cc:2889] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:08.157680  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:08.176760  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:08.173167  4253 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:08.185626  8888 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:08.158630  8165 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:08.143932  8773 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 12:22:08.205799  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.208993  8165 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:08.211766  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 54169.2us
I20260709 12:22:08.212633  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:08.213894  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:08.214666  8787 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:08.214905  8960 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:08.215196  8787 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:08.214246  4253 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:08.215538  8960 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:08.216189  8787 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.216991  8960 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:08.186342  8888 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.218981  8774 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.225162  8774 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.226504  4331 raft_consensus.cc:1240] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:08.229420  9030 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:08.189760  8976 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:08.236510  8914 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:08.239578  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:08.220013  8916 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:08.254127  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48459.2us
I20260709 12:22:08.256490  4333 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
W20260709 12:22:08.264783  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.265051  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.265918  4408 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:08.265959  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.243309  8991 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.269906  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.270614  4402 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:08.267705  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.291013  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.263969  8774 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.302690  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.302481  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.303337  4406 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:08.301184  4409 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:08.269531  8716 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.313489  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 77540.1us
I20260709 12:22:08.309767  8976 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:08.294034  8916 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:08.289723  8823 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:22:08.256340  8910 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.325096  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.343037  4409 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.327175  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:22:08.328461  9026 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:22:08.347545  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.336078  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.330854  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.332448  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.323194  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.353156  4407 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:08.298645  8991 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.354669  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.358572  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:08.362721  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.349136  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:08.361263  4403 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
W20260709 12:22:08.366871  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 90564.6us
W20260709 12:22:08.371411  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 56556.2us
I20260709 12:22:08.357434  4408 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:08.312958  8938 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:22:08.313148  8716 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.381062  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.381501  4985 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:08.382236  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.384567  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.385324  4407 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 7: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:08.385581  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.386040  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.389964  8029 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:08.391672  4403 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:08.349857  8916 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:08.320005  8165 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.417158  4332 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:08.381250  9028 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:08.381376  8823 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:08.432219  8938 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.422565  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:08.436053  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.458844  4405 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:08.421806  9005 consensus_meta.cc:287] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.002s
I20260709 12:22:08.436607  8916 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:08.436739  8998 consensus_meta.cc:287] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.004s
I20260709 12:22:08.437069  4255 raft_consensus.cc:1240] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:08.437629  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.438086  8716 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.438989  8923 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.440893  4256 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:08.441871  4402 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:08.447146  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:08.450110  4406 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:08.493098  4401 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:08.499946  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:08.500726  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 177596us
I20260709 12:22:08.501549  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:08.362399  8976 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.509667  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:08.511039  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 63981us
I20260709 12:22:08.511987  4991 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.512296  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.456107  8823 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:08.516522  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.523941  4986 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
W20260709 12:22:08.524915  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 152629us
I20260709 12:22:08.538013  4956 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.510763  8647 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.509189  8716 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:08.498865  9005 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:08.525549  8824 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:08.555657  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 118125us
I20260709 12:22:08.558403  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.560029  8991 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:08.561384  4407 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:08.564412  9005 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:08.566416  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.567627  8773 consensus_queue.cc:1059] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:08.569563  9035 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:08.543625  8947 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:08.499374  9028 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.587090  9028 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.588195  9041 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:08.590452  9035 raft_consensus.cc:3055] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:08.590821  9035 raft_consensus.cc:740] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:08.591226  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.592118  8725 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.591698  9035 consensus_queue.cc:260] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:08.593116  9035 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:08.593611  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.594455  8725 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:08.596429  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.597249  8725 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:08.597730  8725 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:08.598659  8725 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:08.508605  8938 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:08.607457  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 91039.3us
I20260709 12:22:08.544473  8998 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:08.610824  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:08.611104  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.626570  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.577611  8831 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:08.632112  4404 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:22:08.633060  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.573415  8824 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:08.631626  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:08.630483  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 118790us
I20260709 12:22:08.635102  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.556569  8716 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.655848  8029 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:08.670548  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 59799.2us
W20260709 12:22:08.639599  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 99516.3us
I20260709 12:22:08.685878  9052 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.677304  9028 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:08.686576  9028 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:08.686825  9047 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:08.686949  9028 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:08.632059  8831 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.689597  4332 raft_consensus.cc:3060] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:08.692519  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:08.693250  4326 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:08.634752  9043 raft_consensus.cc:2764] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:22:08.701604  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.676903  8824 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:08.709743  4955 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.663050  8976 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:22:08.696718  8831 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:08.676512  8888 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:08.712790  8029 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.676903  8998 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:08.720507  8875 consensus_meta.cc:287] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.579s	user 0.014s	sys 0.001s
I20260709 12:22:08.714651  8947 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:08.750777  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 85324.7us
W20260709 12:22:08.752929  9023 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:08.756562  4331 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:08.756820  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47174us
I20260709 12:22:08.757623  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:08.760823  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 49721us
W20260709 12:22:08.754312  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 121278us
I20260709 12:22:08.687527  9047 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.782960  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.786276  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.783982  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:08.808431  4253 consensus_meta.cc:287] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.000s
I20260709 12:22:08.812673  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.815311  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:08.815426  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.816131  9056 raft_consensus.cc:2804] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:08.816000  9044 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:22:08.816835  9056 raft_consensus.cc:697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:08.816046  9048 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:08.817803  8888 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:08.818096  9051 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:08.818740  8888 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:08.819896  9062 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:08.820966  9050 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:22:08.822222  9032 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.822744  9032 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:08.823621  9063 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:22:08.823870  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.825423  9032 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.820010  8997 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:08.807955  9005 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:08.814715  9035 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:08.819185  8888 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:08.847437  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 79696us
W20260709 12:22:08.848297  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 211559us
I20260709 12:22:08.849593  8947 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.851094  9062 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.864212  4407 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:22:08.884219  4409 consensus_meta.cc:287] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.001s
I20260709 12:22:08.817766  9048 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.892203  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.892946  4983 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:08.893186  9048 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.872253  9062 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.897243  4409 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:22:08.897384  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 80816.7us
I20260709 12:22:08.898387  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:08.900161  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:08.900777  4326 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:08.818934  9051 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.901067  4403 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:08.902321  4406 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:08.863812  8888 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:08.898898  8716 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:08.947484  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.964205  4986 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:08.885520  8938 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:08.966061  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:08.968722  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:08.969559  4256 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:08.817970  9056 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.972092  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.974123  4405 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:08.974900  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:08.868650  8947 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:08.905279  8923 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:22:08.977399  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:08.988215  4409 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
W20260709 12:22:08.989650  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 58830.2us
I20260709 12:22:08.989760  8869 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:08.977087  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:08.997649  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:09.000065  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 95737.1us
I20260709 12:22:09.003847  4991 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:08.965454  9044 consensus_queue.cc:1059] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
W20260709 12:22:08.995568  9049 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:22:09.007082  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:08.985297  8849 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.972743  8716 consensus_queue.cc:1059] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:22:08.995935  8998 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.022178  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.023772  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:09.029613  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 194396us
I20260709 12:22:09.035187  4326 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:09.049259  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.049564  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.049289  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.050217  4255 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:09.052783  4326 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:09.030537  9074 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.033355  9061 raft_consensus.cc:3055] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:09.052317  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.054580  4983 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:09.020721  8849 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.053212  9044 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:09.055719  9053 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:09.057052  4985 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:22:09.064101  4325 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:09.072033  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:09.072644  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:09.059490  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 52522.2us
I20260709 12:22:09.080528  4332 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:09.056232  8950 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.027719  8831 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.060129  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.038897  9060 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.089525  4218 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:09.061656  9072 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:22:09.067466  9071 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:22:09.086246  9030 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:22:09.057098  8716 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:09.057248  9062 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.060981  9009 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:09.064832  9086 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:09.071491  9044 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:09.056770  9061 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:09.054219  9047 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.109804  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.104928  8716 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.122419  9094 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:22:09.115939  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 87406.2us
I20260709 12:22:09.122310  9051 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:09.116282  9034 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.823s	user 0.006s	sys 0.000s
I20260709 12:22:09.140789  9085 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:09.113847  8923 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:22:09.141510  9092 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:09.136159  8716 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.082015  9074 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.165084  9074 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.113142  9083 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.167101  9092 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.144912  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.171396  4328 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:09.117215  8725 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.147957  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.174422  4405 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:09.099884  9060 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.148450  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:09.094624  8950 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.146667  9051 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:22:09.186501  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.152482  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.187170  4992 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:09.151957  9061 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.171114  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.189069  8950 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:09.189855  9061 raft_consensus.cc:3060] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:09.190107  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:09.190265  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:09.190729  4983 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.194504  9036 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:09.194977  9083 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:09.195399  9083 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.195577  4403 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 12: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:09.195708  4409 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:22:09.195878  8923 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:09.196245  8923 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:09.195731  9083 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.197207  8923 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.198649  4331 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:09.201326  8824 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.201486  9097 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:09.203730  4404 raft_consensus.cc:2376] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11. Re-sending same reply.
I20260709 12:22:09.204847  9060 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:09.205981  8372 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:09.206092  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 57754.9us
I20260709 12:22:09.206565  8372 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:09.206981  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.207515  8372 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.208933  8869 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.210251  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:09.210827  4257 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.212667  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:09.213388  4252 raft_consensus.cc:2393] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:09.216188  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.144315  9047 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:09.218129  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.198599  8923 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:09.215106  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.218547  9083 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.243319  4254 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:09.245051  9083 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.222636  9044 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:09.246919  9028 consensus_meta.cc:287] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.003s
I20260709 12:22:09.231837  4257 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
W20260709 12:22:09.234750  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.248224  9069 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.240281  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.248893  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.249583  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:09.250137  4327 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.250288  4248 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:09.241025  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.252127  4252 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:09.241698  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.242769  8998 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:09.254087  8998 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.254443  8998 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.120013  9009 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.254485  4250 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:22:09.259006  4250 pending_rounds.cc:85] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 8
I20260709 12:22:09.259266  4250 pending_rounds.cc:107] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:22:09.259545  4250 raft_consensus.cc:2889] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:09.257002  4983 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:09.257905  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.262843  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.233583  4371 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:09.264665  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.267040  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.269197  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.272820  9078 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:22:09.274510  9048 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:09.275004  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:09.276360  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:09.276912  4403 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.277361  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.278436  8947 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.279814  4405 raft_consensus.cc:2393] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 16: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:09.283820  4989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1332) took 1412 ms. Trace:
I20260709 12:22:09.284300  4989 rpcz_store.cc:276] 0709 12:22:07.871688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.872037 (+   349us) service_pool.cc:224] Handling call
0709 12:22:07.872473 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:07.887196 (+ 14723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.887243 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:07.939740 (+ 52497us) log.cc:844] Serialized 26 byte log entry
0709 12:22:08.121206 (+181466us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:08.121283 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.121386 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.115558 (+994172us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:09.272479 (+156921us) raft_consensus.cc:1685] finished
0709 12:22:09.272500 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.283734 (+ 11234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5755,"spinlock_wait_cycles":2896256,"thread_start_us":133177,"threads_started":1,"wal-append.queue_time_us":305382}
I20260709 12:22:09.269333  8875 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.271454  9030 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:09.286203  8875 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.271970  4985 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:09.294309  4985 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:09.267858  9032 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:09.267796  9095 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:09.296588  9095 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.296936  9095 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.300645  8875 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:09.302183  9037 log.cc:927] Time spent T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.925s	user 0.000s	sys 0.003s
I20260709 12:22:09.286767  9030 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:09.305646  9030 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.310322  9044 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:09.216892  9091 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:22:09.314374  9009 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:09.315845  9054 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.559s	user 0.003s	sys 0.000s
I20260709 12:22:09.318001  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2929) took 1088 ms. Trace:
I20260709 12:22:09.299849  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.318356  4334 rpcz_store.cc:276] 0709 12:22:08.229113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.229267 (+   154us) service_pool.cc:224] Handling call
0709 12:22:08.229702 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.237855 (+  8153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.237883 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:08.290779 (+ 52896us) log.cc:844] Serialized 26 byte log entry
0709 12:22:08.578883 (+288104us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:08.578928 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.578993 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.315117 (+736124us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:09.317710 (+  2593us) raft_consensus.cc:1685] finished
0709 12:22:09.317732 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.317921 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":764,"raft.queue_time_us":15785,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5401,"spinlock_wait_cycles":42721024,"thread_start_us":284944,"threads_started":1,"wal-append.queue_time_us":394183}
I20260709 12:22:09.320077  4983 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:09.322701  8888 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.324599  9043 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:09.325011  9043 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:09.325878  9043 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.324858  8888 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.328279  8888 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:09.328787  8888 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.334483  8998 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.335762  4249 raft_consensus.cc:2368] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 13. Current term is 14.
I20260709 12:22:09.336781  4406 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:22:09.339351  4403 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:09.338943  8823 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.331007  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.327132  9043 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:09.353446  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.368613  4332 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:09.259976  9028 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.368788  4327 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:09.380174  4956 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.381213  4372 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.382302  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.384188  4985 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:09.385648  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:09.349200  4296 leader_election.cc:400] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 13. Current term is 14.
I20260709 12:22:09.349294  4328 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:09.387276  4296 leader_election.cc:403] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:09.387360  9092 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:09.389593  9092 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:09.370087  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.350307  9091 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.398741  4326 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:09.398131  8165 consensus_queue.cc:1059] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:22:09.382221  9009 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:09.403707  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.387574  9052 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:09.408283  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.415611  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.405820  9091 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.416971  9048 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:09.417824  9048 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:09.418053  9091 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.405992  9009 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.419143  9009 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.422214  4408 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:09.405463  8960 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:22:09.424367  9028 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.414423  9085 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:09.414832  9032 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:22:09.426824  9101 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:09.427228  9101 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:09.391366  8997 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:22:09.403323  9044 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:09.428054  9101 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.433049  9101 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.414775  9052 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.434051  9052 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.390472  9092 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.391552  8991 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:09.436157  8991 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.436568  8991 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.353940  9069 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:22:09.343250  8875 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.378779  8716 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.402781  8869 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.458679  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:09.465611  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 48883.4us
I20260709 12:22:09.467051  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.468410  8849 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:09.470144  9112 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:22:09.483198  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:09.486444  9052 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.487484  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.487975  4404 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:22:09.488412  8823 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.490358  4250 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:22:09.491576  9090 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.492439  8831 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.493199  4986 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:09.492187  9090 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.498757  4986 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:09.500864  4985 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:09.515326  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.516222  4257 raft_consensus.cc:2368] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13.
I20260709 12:22:09.520563  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:09.521179  4989 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.523136  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:09.524673  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.524482  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.533700  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:09.534439  4408 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:09.537770  8869 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 13. Current term is 14.
I20260709 12:22:09.538070  4400 raft_consensus.cc:2410] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:22:09.512359  9032 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.539928  8029 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.539842  9032 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.540406  8029 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.542238  9032 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.542240  8029 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:09.553208  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.558727  4408 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:09.560122  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.561429  4404 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:09.562211  4250 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:09.564328  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.565323  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.556428  8823 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:09.584273  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:09.586712  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 59007.9us
I20260709 12:22:09.591373  4989 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:09.592944  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.508682  8372 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:22:09.602573  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.603392  4331 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:09.614727  9109 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:09.615535  8716 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.599105  8029 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:09.619807  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:09.619565  8029 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.621310  9076 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:22:09.621915  8029 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.623564  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:09.625311  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:09.628135  8792 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:09.628820  8792 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.628144  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:09.629252  8792 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.629436  4253 raft_consensus.cc:606] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.629808  4253 raft_consensus.cc:614] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:09.628185  9118 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:22:09.581856  8888 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.633816  9076 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:09.634234  9076 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:09.581450  9032 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:09.646315  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:09.650417  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:09.589864  9094 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:09.655956  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:09.578156  8869 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:22:09.660171  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.601498  8998 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.674909  8869 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:09.675400  8869 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:09.676330  8869 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.676636  8792 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.677712  8869 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.679818  9032 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:09.681615  9076 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.683178  4989 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:09.683316  9076 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:09.596405  9030 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:22:09.659350  8923 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:09.698432  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:09.699127  4253 raft_consensus.cc:606] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.699546  4253 raft_consensus.cc:614] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:09.648777  9097 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:22:09.635486  9095 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.659085  9083 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:22:09.720916  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:09.720608  8923 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:09.724920  9079 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:09.725502  9079 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:09.725927  9079 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:09.725744  8923 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.726488  9095 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:09.727900  9108 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:22:09.720078  8792 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:09.735033  4400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60144 (request call id 2801) took 1162 ms. Trace:
I20260709 12:22:09.735598  4400 rpcz_store.cc:276] 0709 12:22:08.572542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.671763 (+ 99221us) service_pool.cc:224] Handling call
0709 12:22:09.734722 (+1062959us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54003af054. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:09.734916 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659898240}
I20260709 12:22:09.739873  8372 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:09.756517  8372 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:09.758852  8372 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.765458  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:09.780346  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:09.811496  8849 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:09.824518  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:09.824966  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.837548  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:09.825994  4250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:09.831283  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.850518  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.839789  4250 raft_consensus.cc:606] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.856745  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:09.857543  4332 raft_consensus.cc:3060] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:09.869969  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.877228  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:09.878363  4252 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 14: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:09.880920  4257 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:09.882592  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:09.875931  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:09.885736  8165 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:09.825709  8716 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.835944  8849 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.900489  4249 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:22:09.837967  9052 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:09.869355  9054 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:22:09.922749  4333 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:09.925499  4955 leader_election.cc:400] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13.
I20260709 12:22:09.943236  4955 leader_election.cc:403] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:09.916198  9084 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:22:09.931613  4406 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:22:09.941296  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:09.942399  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:09.843547  9097 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:09.960424  9097 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:09.965035  4332 raft_consensus.cc:2468] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:09.969586  9090 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.971432  8875 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.987569  8824 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:09.963129  9097 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:09.952495  9092 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:10.005198  4249 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 14: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:10.026361  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:10.028959  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:10.029603  4252 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:09.896430  9047 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 12:22:09.956184  9043 consensus_meta.cc:287] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 12:22:10.032743  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:09.999545  9092 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.045463  8029 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:10.047806  8029 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.048190  8029 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:10.049283  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:09.930377  8716 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.054941  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:10.055850  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 288075us
I20260709 12:22:10.001794  8938 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13.
I20260709 12:22:10.082401  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:10.028306  9091 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:10.089656  4989 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:10.055248  8792 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:10.057863  9051 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:22:10.092780  9092 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.073966  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:10.101403  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:10.105648  4253 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:10.108728  4403 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:10.104761  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:10.112831  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.114418  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.129119  4983 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:10.108320  8725 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:10.122450  9049 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:22:10.095181  9077 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 12:22:10.147692  9121 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:22:10.155474  4248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:10.156179  4248 raft_consensus.cc:606] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:10.156522  4248 raft_consensus.cc:614] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:10.162865  9101 consensus_meta.cc:287] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.004s
I20260709 12:22:10.100171  9091 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.169955  4252 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:10.171650  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:10.175411  4400 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:10.175657  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:10.167683  9123 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:22:10.188521  4327 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:10.180832  8960 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:10.178326  9028 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:10.191921  9122 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:22:10.146338  8725 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.326084  8029 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.425539  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:10.428220  4253 raft_consensus.cc:606] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:10.428651  4253 raft_consensus.cc:614] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:10.445923  8029 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:10.452874  4408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.017s	sys 0.047s
W20260709 12:22:10.458914  4408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.017s	sys 0.047s
W20260709 12:22:10.452713  4372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.030s	sys 0.026s
W20260709 12:22:10.456590  4402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.021s	sys 0.043s
W20260709 12:22:10.459720  4372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.030s	sys 0.027s
W20260709 12:22:10.459856  4402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.021s	sys 0.044s
W20260709 12:22:10.473940  4254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.035s	sys 0.036s
W20260709 12:22:10.475200  4254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.035s	sys 0.037s
W20260709 12:22:10.439885  9126 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.309s	user 0.005s	sys 0.005s
I20260709 12:22:10.399895  9044 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.500061  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:10.507694  4255 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:10.479477  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 288194us
W20260709 12:22:10.439885  8869 consensus_meta.cc:287] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.762s	user 0.028s	sys 0.019s
W20260709 12:22:10.476589  9079 consensus_meta.cc:287] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.008s
I20260709 12:22:10.440157  9051 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:10.517272  4332 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:22:10.522533  4332 pending_rounds.cc:85] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:22:10.522891  4332 pending_rounds.cc:107] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:22:10.523211  4332 raft_consensus.cc:2889] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:10.529626  4328 raft_consensus.cc:2410] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:22:10.539880  4374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.018s
I20260709 12:22:10.500963  8849 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.500413  9061 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:10.541777  4374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.007s	sys 0.018s
I20260709 12:22:10.547521  8029 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:10.548708  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:10.559192  9092 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.559906  9028 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:10.560065  9092 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.560508  9028 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.562768  9092 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:10.528965  8875 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:10.563783  8938 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:10.584290  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 74912us
I20260709 12:22:10.528690  8372 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:22:10.520496  9044 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.596962  4985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1056) took 1083 ms. Trace:
I20260709 12:22:10.547072  8565 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:10.609787  9140 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:22:10.580642  8950 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:10.614152  8950 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.616142  8725 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:10.616693  8950 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.617026  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:10.577662  8716 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.586434  8849 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.585681  9092 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.651396  9092 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.652287  8849 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.653760  9092 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.654798  8849 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:10.655007  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:10.658105  9086 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:10.658728  9086 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.660858  9086 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.628561  8565 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.662808  9091 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:10.621076  9044 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:10.530735  9079 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.625363  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:10.664598  4332 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:10.543416  9051 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.665544  9079 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.626298  8938 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.666831  9051 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:10.581559  8875 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.564671  9061 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.668800  8875 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:10.668946  9061 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:10.670065  4400 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:10.637465  4405 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:10.645918  4255 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:10.650574  9097 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:10.666501  8938 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.603704  4985 rpcz_store.cc:276] 0709 12:22:09.516375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.517037 (+   662us) service_pool.cc:224] Handling call
0709 12:22:09.517255 (+   218us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:09.564402 (+ 47147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.564434 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:09.588547 (+ 24113us) log.cc:844] Serialized 52 byte log entry
0709 12:22:09.837013 (+248466us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:09.837054 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.837122 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.596691 (+759569us) raft_consensus.cc:1685] finished
0709 12:22:10.596716 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.596882 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48518,"raft.queue_time_us":47340,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":16518,"thread_start_us":183814,"threads_started":1,"wal-append.queue_time_us":431301}
I20260709 12:22:10.674499  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:10.680341  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.693392  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:10.697649  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.673849  9097 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:10.693187  8824 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:10.789525  4328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 2598) took 1004 ms. Trace:
I20260709 12:22:10.692461  9086 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.790890  4328 rpcz_store.cc:276] 0709 12:22:09.779866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.780053 (+   187us) service_pool.cc:224] Handling call
0709 12:22:10.784029 (+1003976us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54002521d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:10.784227 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720669952}
I20260709 12:22:10.782776  8849 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.784677  8565 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:10.828955  8849 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.803525  9097 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.819694  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:10.819595  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:10.820590  9028 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:10.820925  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2820) took 1079 ms. Trace:
I20260709 12:22:10.821105  4331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55272 (request call id 2948) took 1078 ms. Trace:
I20260709 12:22:10.857089  4403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35534 (request call id 1049) took 1027 ms. Trace:
I20260709 12:22:10.781843  9078 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.862063  4403 rpcz_store.cc:276] 0709 12:22:09.829607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.830916 (+  1309us) service_pool.cc:224] Handling call
0709 12:22:10.856925 (+1026009us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:10.857027 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618301696}
I20260709 12:22:10.867856  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:10.860608  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:10.693212  9051 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.131s
I20260709 12:22:10.876730  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:10.877758  4989 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:10.879976  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:10.869093  4325 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:10.896464  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:10.860020  4408 rpcz_store.cc:276] 0709 12:22:09.742006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.743778 (+  1772us) service_pool.cc:224] Handling call
0709 12:22:09.744015 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.744348 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.744368 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:09.776287 (+ 31919us) log.cc:844] Serialized 26 byte log entry
0709 12:22:10.459339 (+683052us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:10.599265 (+139926us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.820407 (+221142us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b540006dc20. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0cf9733 00007fdbb0d7edbf 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c
0709 12:22:10.820472 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.820567 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.820617 (+    50us) raft_consensus.cc:1685] finished
0709 12:22:10.820696 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.820840 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50066,"prepare.queue_time_us":200288,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":22097,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":51900,"spinlock_wait_cycles":39723776,"thread_start_us":656310,"threads_started":2,"wal-append.queue_time_us":743138}
I20260709 12:22:10.899204  4330 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 7: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:10.867492  8565 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:10.917012  8165 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.923427  8165 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.923530  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:10.926079  4332 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:10.789788  9094 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:10.860177  4331 rpcz_store.cc:276] 0709 12:22:09.742947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.743106 (+   159us) service_pool.cc:224] Handling call
0709 12:22:09.743439 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.773319 (+ 29880us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:10.046662 (+273343us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.566371 (+519709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.566430 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:10.566474 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.820890 (+254416us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54002030d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:10.820938 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.821061 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53903,"prepare.queue_time_us":152706,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":25792,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9953,"spinlock_wait_cycles":68176256,"thread_start_us":711560,"threads_started":2,"wal-append.queue_time_us":579471}
I20260709 12:22:10.944800  8565 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:10.918471  9028 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.945739  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:10.946413  4403 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:22:10.916545  9078 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:10.945560  9028 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.945894  8565 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.954305  8823 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:10.954885  8823 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.955682  4327 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:22:10.948786  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.956543  4247 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:10.955185  9078 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:10.860034  8824 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:10.963596  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.965499  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.966230  4247 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 7.
I20260709 12:22:10.924214  9083 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.993533  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:10.996562  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:10.971148  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:10.971485  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:10.998562  4332 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:10.972090  4250 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:22:10.959496  4257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.040s	sys 0.098s
I20260709 12:22:10.992738  8165 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:10.999934  4257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.040s	sys 0.098s
I20260709 12:22:10.837721  9086 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:10.993191  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.006914  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:10.994426  4248 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:11.009306  4409 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:10.939916  9035 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.017356  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.018328  8824 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.032407  9035 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.019192  9097 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:10.970444  9109 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.035992  9109 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.038690  9109 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:11.021569  9150 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:22:11.024014  8998 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:11.024531  8938 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.024477  8976 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:11.025105  8823 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.025866  9047 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:11.026199  9079 raft_consensus.cc:993] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:11.025882  8849 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.027526  9082 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.029881  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:10.961551  9101 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:10.946620  9094 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:10.965420  9009 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.546s	user 0.012s	sys 0.009s
W20260709 12:22:10.970683  8991 consensus_meta.cc:287] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 1.534s	user 0.011s	sys 0.011s
I20260709 12:22:11.073032  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.079288  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.083958  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.013288  9083 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.048172  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.035168  9035 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.064471  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.067013  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:11.001390  8774 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:11.002365  9090 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:11.098273  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.099064  4329 raft_consensus.cc:2393] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:11.099141  4983 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:11.010908  4372 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.095152  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.097364  4403 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
W20260709 12:22:11.101823  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 91040.6us
I20260709 12:22:11.065459  8998 raft_consensus.cc:1081] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:11.076619  9101 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.118341  4987 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:11.087343  9082 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.125445  9082 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.127561  9094 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.076162  9079 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:11.106276  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.058808  9070 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:22:11.091099  9134 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:11.154505  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.104992  9095 raft_consensus.cc:2804] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:11.087936  9009 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.143285  9079 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.088249  8991 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.148412  8916 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.171172  4372 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.181811  4991 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:11.105377  8774 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.184288  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:22:11.236958  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52759.6us
I20260709 12:22:11.239130  4986 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:11.239280  9051 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:11.105252  9090 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.175031  9067 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.172667  9079 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.182881  9095 raft_consensus.cc:697] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:11.191051  9146 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:11.246311  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:11.244817  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 983) took 1412 ms. Trace:
I20260709 12:22:11.192329  8831 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:22:11.246170  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.160706  9134 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.239943  9051 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:11.256502  4254 rpcz_store.cc:276] 0709 12:22:09.823768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.823912 (+   144us) service_pool.cc:224] Handling call
0709 12:22:09.864185 (+ 40273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.963559 (+ 99374us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:10.475862 (+512303us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.597017 (+121155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.597063 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:10.597116 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.841193 (+244077us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b18000c7f00. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc5f2a6 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419
0709 12:22:11.235401 (+394208us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b54003c05d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:11.235464 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.235617 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":706572,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":89,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":21025,"spinlock_wait_cycles":249124864,"thread_start_us":632621,"threads_started":2,"wal-append.queue_time_us":311853}
I20260709 12:22:11.252079  9146 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.254761  9048 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:11.258673  9127 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.278062  9146 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:11.293181  9086 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.324083  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.297587  9095 consensus_queue.cc:237] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.328050  9090 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.284601  9048 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.330121  9048 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.288390  9127 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.332156  9127 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.336607  8947 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:11.337356  8947 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.340014  9009 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:11.340337  9151 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:22:11.350243  4987 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 7.
I20260709 12:22:11.358141  9079 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.359486  4247 raft_consensus.cc:2368] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12.
I20260709 12:22:11.361933  9079 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:11.366119  9155 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:22:11.367162  8947 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.367843  8947 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.368372  8947 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.370636  8947 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.313936  9154 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.371659  9154 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.374068  9154 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:11.375065  9148 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:11.376315  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 992) took 1245 ms. Trace:
I20260709 12:22:11.376657  4257 rpcz_store.cc:276] 0709 12:22:10.130536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.131285 (+   749us) service_pool.cc:224] Handling call
0709 12:22:10.169047 (+ 37762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.182348 (+ 13301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.182379 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.187452 (+  5073us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.000389 (+812937us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:11.000429 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.000864 (+   435us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.376108 (+375244us) raft_consensus.cc:1685] finished
0709 12:22:11.376128 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.376255 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3196,"raft.queue_time_us":4168,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":16454,"thread_start_us":555600,"threads_started":1,"wal-append.queue_time_us":1057636}
W20260709 12:22:11.381325  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 216494us
I20260709 12:22:11.346241  9083 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.350973  8991 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.350622  9101 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:11.386314  4955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.040s
W20260709 12:22:11.389184  4955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.012s	sys 0.040s
W20260709 12:22:11.389585  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 530011us
I20260709 12:22:11.390383  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:11.391902  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 148745us
I20260709 12:22:11.393378  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:11.398207  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:11.404048  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.411759  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:11.417685  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.418371  4331 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:11.419601  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.420449  4257 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:11.421031  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:11.421793  4332 raft_consensus.cc:2393] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 12: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:11.349387  9051 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.394850  9074 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.395051  9067 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.420169  4331 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 7.
I20260709 12:22:11.426807  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:11.395215  9044 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:11.396858  9076 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.397475  9160 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:11.424609  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.423940  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.443674  4254 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:11.430255  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:11.424330  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.431926  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.417096  8823 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:11.445462  4332 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.402863  9161 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.445940  4331 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:11.446688  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.440836  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.454730  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.455189  4253 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:22:11.421418  9086 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:11.445952  9074 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.474169  9074 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.457145  9164 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:11.474848  9164 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.475224  9164 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.477021  4332 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:11.477835  9028 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.459982  9134 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.460533  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.462404  9137 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:11.482532  9137 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.484628  9137 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.485054  9137 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.462666  9048 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:11.445289  9076 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.443014  9044 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.467140  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.469038  8831 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:11.472079  8774 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.520794  4990 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:11.487097  8823 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:11.523576  8823 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:11.485522  9137 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:11.533526  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 106803us
I20260709 12:22:11.537143  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.550102  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.550398  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.552827  9009 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.553360  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:11.564157  4989 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:11.553376  9160 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:11.560111  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 144447us
I20260709 12:22:11.443420  9067 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.573827  4219 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.574366  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.575037  4332 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:22:11.575367  4991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52864 (request call id 1351) took 1813 ms (client timeout 1771 ms). Trace:
I20260709 12:22:11.575699  8774 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:11.575933  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.576251  8774 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.576649  8774 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.580363  9028 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:11.580900  9028 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.582880  9028 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.591118  4986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52880 (request call id 1157) took 2072 ms. Trace:
I20260709 12:22:11.686719  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.567057  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:11.584831  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.703704  4331 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:11.583848  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.692706  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.704772  4332 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:11.693668  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.694552  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.697153  4986 rpcz_store.cc:276] 0709 12:22:09.518335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.518445 (+   110us) service_pool.cc:224] Handling call
0709 12:22:09.518706 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.239680 (+1720974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.590884 (+351204us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400718754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:11.591055 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3847167872}
W20260709 12:22:11.575780  4991 rpcz_store.cc:269] 0709 12:22:09.755756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.765179 (+  9423us) service_pool.cc:224] Handling call
0709 12:22:11.568424 (+1803245us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400729cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:11.568596 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3255177600}
I20260709 12:22:11.704939  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:11.707377  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 140410us
I20260709 12:22:11.586390  8831 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:11.711038  8991 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:11.708413  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.708791  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.708758  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:11.726639  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 189568us
I20260709 12:22:11.713801  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:11.585835  9097 consensus_meta.cc:287] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 12:22:11.568208  9095 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.731714  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.730731  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.738652  4333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:22:11.743824  4333 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:11.744239  4333 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.746134  8029 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:11.746533  8029 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.585368  9076 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.731812  9078 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:22:11.703145  9074 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:11.703349  9077 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.729118  9028 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.749473  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:11.711340  8831 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.711506  8991 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.732245  8875 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:11.729483  9032 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.757637  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.767810  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:11.735054  8947 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:11.769170  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.769385  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.760304  4331 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:22:11.728534  9167 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:11.568964  9009 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.711625  9091 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:11.770637  8165 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:11.771368  8165 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:11.772254  8165 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:11.773280  9009 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.773351  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:11.771062  9091 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.774031  4334 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.583228  9146 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.740547  8849 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.740777  9154 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:11.774717  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.780185  8029 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.784833  4333 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.758987  9127 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:11.767025  9076 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:11.799122  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.768443  9067 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.769850  8991 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.811113  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.816792  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:11.818850  4371 leader_election.cc:400] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12.
I20260709 12:22:11.802335  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:11.820626  4371 leader_election.cc:403] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:11.774281  9167 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.774789  9043 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:11.769284  8875 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:11.826718  4333 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.827458  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:11.821498  9076 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.833923  9076 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:11.834492  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.777383  9095 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:11.843242  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.766777  9074 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.843242  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:11.800549  9127 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.768290  9077 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.822598  9047 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:11.849404  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:11.812685  9154 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:11.775331  9032 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.776947  8774 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.827458  8998 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:11.832712  9167 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:11.832432  9069 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:11.847909  9095 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.854435  9164 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.775130  8831 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.905160  9069 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.914849  9069 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:11.915284  8831 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.835266  8875 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:11.918498  9082 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.850730  9127 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:11.858737  9074 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.865093  9097 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:11.865986  9043 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.866569  9044 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.868903  9091 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:11.870132  4334 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:11.870234  9146 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.879616  9173 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:22:11.882251  9137 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:11.895772  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 46477.1us
I20260709 12:22:11.895454  8998 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.922392  8938 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.913002  9164 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.822921  8849 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:11.928256  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 196627us
I20260709 12:22:11.929700  8029 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.908447  9174 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:11.905558  9047 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:11.911175  8774 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.919029  9082 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.922470  8823 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.969835  8565 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:11.931957  9043 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.982316  9069 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:11.984040  9077 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.984861  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.990240  9167 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.991938  9095 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:11.823189  9160 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:11.912362  9032 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:11.996539  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:11.974723  8875 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.005342  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:12.006910  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 179987us
I20260709 12:22:11.997210  8998 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.026422  4248 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:12.028999  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.042877  9095 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:12.058144  9043 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.001631  8938 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.059423  8875 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.034373  8565 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.061343  9082 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:12.061714  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:22:12.041651  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 45236.6us
I20260709 12:22:12.013267  9051 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.052693  8823 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.017518  9154 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.034864  8029 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.067981  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:12.073532  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.077430  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.078234  4254 raft_consensus.cc:2410] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:22:12.078711  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.079100  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.079684  4254 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.080567  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.082331  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.082604  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.061367  8565 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.083515  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.083899  9047 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.084679  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.085364  4252 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:12.087060  9127 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.089134  9127 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.089792  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.095623  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:12.096251  9175 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 12:22:12.096441  4406 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 12: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:12.096810  9167 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:12.098425  9069 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.069208  9051 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.101362  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.102694  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.102963  9051 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.024040  9076 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.103492  4986 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:12.104591  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.104988  9076 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:12.064741  8774 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:22:12.106676  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.074174  4253 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:12.107246  4991 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:12.110154  8991 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.112380  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:12.112814  9179 log.cc:927] Time spent T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:22:12.113651  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.115779  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.115986  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:12.116357  4332 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.105873  8849 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.119977  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.121388  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.122989  4328 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:12.123665  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.124625  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.124877  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.125857  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.116102  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.127909  4983 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:12.128425  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.128644  4253 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:22:12.133320  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 65721.5us
I20260709 12:22:12.135279  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.138700  4334 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:12.144850  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.145720  4400 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:12.056708  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:12.150316  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.150574  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:12.135136  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 384263us
I20260709 12:22:12.134426  4332 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:12.151127  4402 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:12.161836  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.162645  4333 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:12.164551  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.165091  4333 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.166544  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.167086  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.165208  4328 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:12.167171  4400 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:22:12.171233  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.151719  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.184361  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.185120  8029 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:12.187206  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:12.189154  4152 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 262) took 22848 ms (client timeout 15000 ms). Trace:
I20260709 12:22:12.191504  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.206655  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:12.206022  8029 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.192216  4330 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:12.149832  9083 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:12.196149  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.209455  4402 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:12.210328  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:12.198225  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:12.168416  9173 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12.
I20260709 12:22:12.165716  9177 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.200621  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.201632  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.204191  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.207253  8029 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.213486  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.215632  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:12.222714  4400 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:12.223579  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.224681  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.225782  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.226840  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.226943  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.227788  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.228411  4328 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.217131  4402 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 12: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:12.230466  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.231274  4402 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:12.231331  8938 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.232163  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:12.232887  4402 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:12.236512  8029 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:12.239521  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 90033.2us
I20260709 12:22:12.241086  8165 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:12.241199  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.222175  4406 raft_consensus.cc:2393] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 14: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:12.242864  4406 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:12.243098  8165 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.243531  8165 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.243876  8165 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.245152  9083 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:12.246105  9083 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.247776  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.248546  4332 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 8: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:12.249020  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.250133  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.253731  8165 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.269035  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.257555  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.258270  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.270808  4250 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:12.260123  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.262319  4404 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:12.258618  4407 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:12.274626  4333 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:12.222489  4153 catalog_manager.cc:5697] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 11, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.218178  9134 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:12.278082  8165 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:12.279145  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 72577us
I20260709 12:22:12.257071  4252 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:12.288285  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.289166  4325 raft_consensus.cc:2393] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:12.291318  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.291491  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.271872  4400 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:12.293706  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.283237  4255 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.295569  4407 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:12.293304  4219 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:12.296296  4328 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
W20260709 12:22:12.275688  9184 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:12.361722  4330 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:12.362921  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.278523  4153 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.262956  8029 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:12.218000  9171 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.369285  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.372968  4219 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:12.373636  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:12.374581  8165 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:12.375174  8165 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:12.378618  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.298091  8787 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.294334  4400 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:12.365031  4153 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 13, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:12.368221  9148 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:22:12.378813  8165 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.355921  9189 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:12.384523  4153 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.251224  9177 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.389668  4153 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 13, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 13 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:12.206234  4152 rpcz_store.cc:269] 0709 12:21:49.341177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:49.341421 (+   244us) service_pool.cc:224] Handling call
0709 12:21:50.250759 (+909338us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b5400002490. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc5a0b2 00007fdbb6bd3759 00007fdbb6b6ba76 00007fdbb6b3cd58 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc
0709 12:22:12.189046 (+21938287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:08.216421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:08.217142 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:08.217207 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:22:08.217246 (+    39us) tablet.cc:662] Decoding operations
0709 12:22:08.218555 (+  1309us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:08.218667 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:08.218696 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:22:08.329381 (+110685us) tablet.cc:701] Row locks acquired
0709 12:22:08.329441 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:22:08.329611 (+   170us) write_op.cc:270] Start()
0709 12:22:08.329767 (+   156us) write_op.cc:276] Timestamp: P: 1783599728329549 usec, L: 0
0709 12:22:08.329810 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:22:08.330592 (+   782us) log.cc:844] Serialized 4678 byte log entry
0709 12:22:09.019610 (+689018us) op_driver.cc:464] REPLICATION: finished
0709 12:22:09.121994 (+102384us) write_op.cc:301] APPLY: starting
0709 12:22:09.122098 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:09.348017 (+225919us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:09.348145 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:09.463582 (+115437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:09.611382 (+147800us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:22:09.611491 (+   109us) write_op.cc:312] APPLY: finished
0709 12:22:09.612137 (+   646us) log.cc:844] Serialized 113 byte log entry
0709 12:22:09.612404 (+   267us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:09.612635 (+   231us) write_op.cc:454] Released schema lock
0709 12:22:09.612726 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:09.613271 (+   545us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:09.613304 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":889629,"reported_tablets":45,"spinlock_wait_cycles":17465728,"child_traces":[["op",{"apply.queue_time_us":99127,"apply.run_cpu_time_us":18833,"apply.run_wall_time_us":491240,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":370371,"prepare.run_cpu_time_us":58218,"prepare.run_wall_time_us":298260,"raft.queue_time_us":162795,"raft.run_cpu_time_us":2552,"raft.run_wall_time_us":100376,"replication_time_us":675111,"thread_start_us":477287,"threads_started":4,"wal-append.queue_time_us":224846,"wal-append.run_cpu_time_us":23071,"wal-append.run_wall_time_us":2047299}]]}
I20260709 12:22:12.391995  4153 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 11, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.393388  4252 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:12.368037  9171 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.394420  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.397864  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.398725  4253 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.393687  4153 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 13, leader changed from <none> to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.399741  9079 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.384892  9077 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:12.399977  4153 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.400408  9079 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.401981  9171 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.401584  4153 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.402487  9079 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.405484  8991 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:12.405591  8565 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:12.406751  8565 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:12.399667  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.354050  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:12.301968  9134 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.379691  9161 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:12.407099  8565 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:12.403258  4153 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 9, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130), pending config changed. New cstate: current_term: 9 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: NON_VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.417943  8976 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:12.418455  8976 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:12.418233  8565 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.419356  9078 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:12.419353  8976 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.419569  4153 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.441110  4153 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 9, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:12.421526  9187 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:22:12.421705  9134 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.423447  9177 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.393997  9189 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.426397  4405 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:12.451491  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.359591  9043 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.437902  9078 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.447592  4255 raft_consensus.cc:1275] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:12.452239  4329 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:12.448482  4253 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:12.449683  4153 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 13 to 14, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 14 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:12.453470  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 98835.9us
I20260709 12:22:12.454216  4153 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 10, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.455479  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:12.158820  4254 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:12.455971  4153 catalog_manager.cc:5697] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.458527  4153 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 9, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 9 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.454336  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:12.467361  8029 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:12.468006  8029 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.468335  9154 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:12.468886  9154 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:12.468451  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:12.469847  9154 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.470474  8029 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.471629  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.473033  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.473173  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.475674  9009 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:12.476235  9009 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:12.476459  4249 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:12.476962  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:12.477546  4330 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:12.477162  9009 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.480208  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.481168  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.483747  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.484540  4991 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:12.484371  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:12.485690  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 258800us
I20260709 12:22:12.470978  8029 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:12.488571  4153 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 8, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 8 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.496079  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:12.496912  4985 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:12.487217  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:12.486650  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.534991  4153 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 10, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 10 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.536486  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.537870  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:12.538779  4253 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:12.538195  4153 catalog_manager.cc:5697] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.541343  4153 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.544631  4153 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 12 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:12.547889  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 61353.8us
I20260709 12:22:12.548231  4153 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 9, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 9 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:12.549604  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.550026  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:12.452783  9189 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:12.556430  4987 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:22:12.558545  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.554059  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:12.556874  4153 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 5 to 7, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 7 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:12.534806  9187 log.cc:927] Time spent T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:22:12.459069  8565 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.451457  9101 consensus_queue.cc:1059] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:22:12.484650  8787 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:12.565501  4153 catalog_manager.cc:5697] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.485388  8976 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:12.567570  4255 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:12.564095  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:12.590363  4253 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:12.569003  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.580440  8029 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:12.565079  8774 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:12.587638  4153 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 12, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.465314  9161 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 12:22:12.591005  8029 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.596297  4153 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 12 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 13 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:12.543850  9076 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:12.592299  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 105155us
I20260709 12:22:12.466256  9043 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.612649  4330 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:22:12.551723  8998 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.592526  9079 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:12.633109  8998 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.633522  9095 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:12.637739  4219 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:12.638019  8029 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:12.648797  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 58124.7us
I20260709 12:22:12.668363  4372 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.654820  4257 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:22:12.657526  4990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.067s	sys 0.091s
W20260709 12:22:12.661754  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52193.7us
W20260709 12:22:12.670454  4990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.068s	sys 0.092s
I20260709 12:22:12.596903  8774 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.607244  9146 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:12.688117  4372 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:12.680439  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 130929us
I20260709 12:22:12.672312  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:12.850448  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 178222us
I20260709 12:22:12.851621  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:12.852597  9164 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:12.853253  9164 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:12.853942  8823 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:12.691537  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 53916.5us
I20260709 12:22:12.854476  9164 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.852989  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.856431  9173 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:12.857987  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:12.858882  9173 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.695261  4372 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.656411  9079 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.861107  9079 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:12.705335  9183 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:12.707329  9076 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:12.628890  9181 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.146s
I20260709 12:22:12.692390  9146 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.838332  4985 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
W20260709 12:22:12.841864  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 248771us
W20260709 12:22:12.864717  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 169554us
I20260709 12:22:12.690807  8774 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:12.682791  8824 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.733515  9186 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:12.707971  8938 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:12.692673  9095 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:12.868130  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 299904us
I20260709 12:22:12.871393  9067 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:12.872205  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:12.917062  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 44963.5us
I20260709 12:22:12.918078  9183 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.918644  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.919427  9183 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.923751  9183 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.924270  9183 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:12.925426  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.927378  9078 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.918859  9189 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:12.929564  9183 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.930624  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.931938  9009 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:12.931977  9189 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:12.932461  9009 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.932922  9009 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:12.872496  9160 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:12.876338  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:12.971230  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 94963.3us
W20260709 12:22:12.982803  9201 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260709 12:22:12.984812  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 124126us
I20260709 12:22:12.986479  8774 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.990624  9079 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:12.886044  9186 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.991755  9067 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:12.992276  9173 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.905148  9095 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:12.910866  9154 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:13.023157  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:12.980011  9181 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:22:12.979091  9213 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:12.883632  9043 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.889235  9076 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:12.877206  9146 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:12.889726  9210 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:12.897168  9101 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:12.899288  9171 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.010949  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:12.960522  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:13.049202  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 88751.8us
I20260709 12:22:13.015584  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.016518  4248 raft_consensus.cc:3055] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:13.017455  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.050743  4326 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:13.051082  9043 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:12.909559  9167 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:13.051579  9043 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:13.052012  9043 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:13.051749  9167 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.053328  8774 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.053936  9167 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:12.892189  9069 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.054574  9069 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.040966  9076 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.056620  9069 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.057013  9076 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.057188  9161 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:12.890792  8938 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.020388  9204 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.043637  4257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57876 (request call id 1000) took 1243 ms. Trace:
I20260709 12:22:13.058516  4257 rpcz_store.cc:276] 0709 12:22:11.798079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.801673 (+  3594us) service_pool.cc:224] Handling call
0709 12:22:13.041000 (+1239327us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54000866d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:13.041148 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879160192}
I20260709 12:22:13.051002  4218 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.058533  9204 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.050071  4248 raft_consensus.cc:740] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:13.061158  4248 consensus_queue.cc:260] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.061555  9204 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.062069  4248 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:13.062268  4330 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:13.062881  9213 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.065562  9079 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.066991  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.027515  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.019845  9186 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.070858  8938 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:13.072865  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.073117  9181 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:13.029873  9220 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:13.093679  4253 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:22:13.094075  4253 pending_rounds.cc:85] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 11
I20260709 12:22:13.094291  4253 pending_rounds.cc:107] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:22:13.094509  4253 raft_consensus.cc:2889] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:13.094841  4250 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:13.072520  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:13.024840  9173 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.071532  9183 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:13.078378  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.102790  4248 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:13.080698  4955 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.083673  9171 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.106004  9161 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.092132  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.092375  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.092535  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:13.096540  4252 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:13.046525  9210 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.023476  9067 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.030607  9154 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.049829  9101 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.103912  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:13.100368  4296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.131:36481 timed out after 1.523s (SENT) [suppressed 9 similar messages]
I20260709 12:22:13.092126  9181 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:13.109889  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:13.106774  9203 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:22:13.111014  4248 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:13.116057  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.119804  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.124487  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.125376  4408 raft_consensus.cc:2368] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:13.126930  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.127065  9009 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.128870  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.129304  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.129890  4407 raft_consensus.cc:2393] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 8: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:13.130087  4402 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:13.130954  9069 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.131858  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.134442  9009 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.138306  4408 raft_consensus.cc:3060] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:13.140367  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.120595  9181 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.141136  9009 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.109479  9177 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.142161  4249 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:13.143046  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.146720  4409 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.143790  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.148428  4404 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:13.144466  4400 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:13.145061  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.150090  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.123167  9160 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:22:13.163401  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 63061.7us
I20260709 12:22:13.155668  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.157552  8565 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:13.158286  9173 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.159894  9009 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:13.167672  9154 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:13.160084  9101 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.162083  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.169221  4332 raft_consensus.cc:2393] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:13.162880  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.112272  8938 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:22:13.112605  9161 consensus_queue.cc:1048] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:22:13.171780  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.104611  9220 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.183387  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.184625  9220 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.175019  9101 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.200150  4409 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:13.177827  9134 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.202502  9210 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.203457  9067 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:13.176818  9160 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:13.204929  9160 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.205875  9186 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.164021  9167 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:22:13.208858  9186 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.199987  4408 raft_consensus.cc:2468] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:13.216866  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.217749  4407 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:13.228910  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.233289  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:13.237332  4250 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:22:13.242805  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.225652  9146 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.252933  9146 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:13.255878  9082 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:22:13.257781  9160 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:13.255697  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.258330  9160 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:13.259837  4409 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.306252  4409 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:13.307788  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:13.307777  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.311172  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.297703  9154 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:13.344410  4985 raft_consensus.cc:1275] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:13.314606  8976 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:22:13.353643  9237 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:13.350723  8976 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:13.356314  4407 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:13.356840  8976 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.357712  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:13.361184  9208 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.476s	user 0.001s	sys 0.000s
W20260709 12:22:13.368871  9221 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.485s	user 0.001s	sys 0.003s
I20260709 12:22:13.366581  9043 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.389895  4218 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.393667  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.396173  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.397585  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.299546  9160 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.346978  9154 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.393015  9210 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.403081  9101 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:13.389011  9213 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:13.394771  9203 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:13.424618  9203 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:13.424307  9181 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.425575  9203 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:13.426628  9181 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.428001  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.429533  4988 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:13.402407  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.430156  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.394574  9205 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:13.413122  4989 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.431470  9205 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.424193  9213 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.419052  9154 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.419494  9101 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:13.409344  9160 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:13.421638  4405 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:13.431087  4992 raft_consensus.cc:2410] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:22:13.417972  4986 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:22:13.438395  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:13.436408  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.436692  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:13.432971  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:13.441445  4402 raft_consensus.cc:2393] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:13.442476  9230 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:13.430226  9043 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:13.457962  8849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.015s	sys 0.010s
W20260709 12:22:13.465586  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.472209  4987 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:13.473282  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.474038  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:13.474287  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.468050  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:13.480851  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.481240  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.451208  9067 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:22:13.483578  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:22:13.466734  8849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.015s	sys 0.010s
I20260709 12:22:13.490790  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.491698  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.471117  9101 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.495848  9205 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.497973  9213 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.500602  9249 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:22:13.500952  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.500885  9127 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:13.501579  9249 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:13.501626  9127 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.502413  9249 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.503819  9127 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.504307  9127 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:13.504514  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.504806  9127 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.503062  9249 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:13.480624  9051 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:13.509744  4333 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:13.518200  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.510756  4334 raft_consensus.cc:1240] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:13.511608  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.507160  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.508474  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.520152  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.514540  9228 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:13.521945  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.522339  9228 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.523139  9127 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.524706  9228 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:13.514932  9249 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:13.527173  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:13.527256  9249 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.528388  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.528766  9249 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:13.529136  4252 raft_consensus.cc:2393] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:13.530272  4252 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:13.531215  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.533111  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.534509  4326 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:13.536410  4983 raft_consensus.cc:2410] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:22:13.541380  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.547086  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.548682  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.550899  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.558075  4296 leader_election.cc:400] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:13.558529  4296 leader_election.cc:403] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:13.559617  9127 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:13.560801  8787 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:13.546329  9069 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:13.561707  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:13.549639  9051 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:13.546787  9032 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:13.627269  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.708107  9218 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:13.708612  9218 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.706878  4407 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.708994  9218 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:13.709249  4331 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:13.710752  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.578670  4333 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.708791  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.633690  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.717684  9218 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:13.718523  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 156881us
I20260709 12:22:13.721431  4296 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:13.575803  4359 heartbeater.cc:646] Failed to heartbeat to 127.3.7.190:34185 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.7.190:34185 timed out after 15.000s (SENT)
I20260709 12:22:13.719707  9032 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:13.578125  9197 log.cc:927] Time spent T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.589s	user 0.004s	sys 0.000s
I20260709 12:22:13.572350  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.741287  9032 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.810956  4330 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:13.814733  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.816236  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.816373  9218 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.816773  9069 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:13.817267  9160 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.817499  9069 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.817884  9160 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.563290  9051 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.820422  9160 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:13.817879  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.821746  9213 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:13.823513  4219 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.824328  9083 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:13.826391  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.726116  9048 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:13.721072  9205 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:13.832342  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:13.838004  4956 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.846058  4328 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:13.851243  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:13.855670  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.828941  9083 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:13.863351  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:13.892369  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:13.848317  9048 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:13.895087  4992 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:13.896066  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:13.899385  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.856791  9215 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:13.859721  9032 raft_consensus.cc:2804] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:13.911549  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.912477  4990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1370) took 1840 ms. Trace:
W20260709 12:22:13.916200  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 409410us
I20260709 12:22:13.916936  4372 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.891785  9213 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:13.918339  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 379375us
I20260709 12:22:13.920972  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:13.858366  9160 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 12:22:13.923951  9251 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:13.852288  9205 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:13.914755  4990 rpcz_store.cc:276] 0709 12:22:12.072546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.072651 (+   105us) service_pool.cc:224] Handling call
0709 12:22:12.077253 (+  4602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.098042 (+ 20789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.098071 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.098477 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.671381 (+572904us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:12.671438 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.671539 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.577309 (+905770us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:13.909054 (+331745us) raft_consensus.cc:1685] finished
0709 12:22:13.909080 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.912399 (+  3319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20344,"raft.queue_time_us":22592,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":35698432,"thread_start_us":572471,"threads_started":1,"wal-append.queue_time_us":890643}
I20260709 12:22:13.943158  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.979709  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:13.912477  9189 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:13.918967  9077 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.994710  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:13.921926  9032 raft_consensus.cc:697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:14.002523  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:14.012220  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.014456  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:13.974678  9174 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:13.925954  9082 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:22:14.111703  4332 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:14.113765  4332 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:14.111517  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:13.980837  8875 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:13.930265  9213 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.006402  9230 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.018370  9204 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.023545  8787 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:13.982210  9078 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 12:22:13.997733  8869 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 12:22:13.997489  9173 consensus_queue.cc:1048] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 12:22:14.115025  4332 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.138582  4332 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:14.002168  9189 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.112785  8991 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:14.148337  9032 consensus_queue.cc:237] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.147544  8875 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:14.164065  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 218408us
I20260709 12:22:14.167873  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:13.997491  9048 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:14.166580  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 252048us
I20260709 12:22:14.172320  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.172205  9051 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:14.173269  8824 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.174250  9230 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:14.175190  9154 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:22:14.177469  9259 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:22:14.179342  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:14.175729  9154 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:14.202761  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 2148) took 1682 ms. Trace:
W20260709 12:22:14.186648  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 238576us
I20260709 12:22:14.203279  4254 rpcz_store.cc:276] 0709 12:22:12.520312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.520507 (+   195us) service_pool.cc:224] Handling call
0709 12:22:12.520987 (+   480us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:12.691883 (+170896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.691931 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:12.778752 (+ 86821us) log.cc:844] Serialized 52 byte log entry
0709 12:22:12.948742 (+169990us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:12.949424 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.186900 (+1237476us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400085cd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:14.186981 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:14.187056 (+    75us) raft_consensus.cc:1685] finished
0709 12:22:14.187079 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.202675 (+ 15596us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83519,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":57653,"spinlock_wait_cycles":391831296,"thread_start_us":63944,"threads_started":1,"wal-append.queue_time_us":152021,"wal-append.run_cpu_time_us":10405,"wal-append.run_wall_time_us":1086408}
I20260709 12:22:14.205171  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:14.211143  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:14.213003  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 95771.1us
I20260709 12:22:14.216893  4332 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:14.166021  9028 consensus_queue.cc:1059] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:22:14.221740  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:14.223574  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 99314.3us
I20260709 12:22:14.224630  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:14.167629  8991 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.218551  8938 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:14.293573  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52215.3us
W20260709 12:22:14.323827  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 77859.6us
I20260709 12:22:14.226457  9070 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:14.384614  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 239932us
I20260709 12:22:14.220875  9174 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:22:14.223896  9181 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:22:14.232084  9266 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:14.238087  8938 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:14.432389  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.437505  4403 raft_consensus.cc:2376] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13. Re-sending same reply.
I20260709 12:22:14.434325  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.434796  4401 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:14.435210  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.435441  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.443238  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.444089  4409 raft_consensus.cc:2376] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12. Re-sending same reply.
I20260709 12:22:14.392786  9205 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:14.452788  9213 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:14.458207  9249 consensus_meta.cc:287] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.929s	user 0.014s	sys 0.000s
I20260709 12:22:14.388527  9218 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:14.461107  9218 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:14.384007  9079 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:22:14.462358  4253 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:14.392518  9146 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:14.463665  9146 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.465695  9146 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:14.438019  9261 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:22:14.477377  4409 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:22:14.440464  8938 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.241356  9154 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.480473  9070 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:14.486518  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.505473  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:14.486754  9272 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:14.487565  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.490449  8991 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:14.492847  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.493918  9274 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:14.494910  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:14.498571  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.502713  4405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60144 (request call id 2849) took 1358 ms. Trace:
I20260709 12:22:14.516794  4405 rpcz_store.cc:276] 0709 12:22:13.144735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.184351 (+ 39616us) service_pool.cc:224] Handling call
0709 12:22:13.421462 (+237111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.443972 (+ 22510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.502525 (+1058553us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000aee50. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:14.502654 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544649472}
I20260709 12:22:14.504164  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:14.506201  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.518447  4400 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 13: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
W20260709 12:22:14.506860  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.514513  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.519775  4956 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.520051  4401 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:14.528056  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.528422  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.529613  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:14.518541  9262 log.cc:927] Time spent T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.306s	user 0.004s	sys 0.000s
I20260709 12:22:14.526486  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:14.513584  9272 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:14.544982  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:14.523283  8991 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.548164  4296 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:14.555342  9275 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:14.555970  9275 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:14.556366  9275 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:14.559845  4983 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52880 (request call id 1191) took 1091 ms. Trace:
I20260709 12:22:14.560344  4983 rpcz_store.cc:276] 0709 12:22:13.468011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.468778 (+   767us) service_pool.cc:224] Handling call
0709 12:22:14.559572 (+1090794us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b54002c3dd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:14.559759 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116188416}
I20260709 12:22:14.565179  9220 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.565702  9220 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.568727  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2187) took 1061 ms. Trace:
I20260709 12:22:14.570005  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 1390) took 1035 ms. Trace:
I20260709 12:22:14.525421  9189 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.573379  4402 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:14.578538  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:14.578697  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:14.579227  4990 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:14.525707  9009 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:14.581741  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.584646  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:14.585516  4405 raft_consensus.cc:2393] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:14.581894  4992 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:14.509567  8824 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:22:14.570402  4991 rpcz_store.cc:276] 0709 12:22:13.534696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.534913 (+   217us) service_pool.cc:224] Handling call
0709 12:22:13.550274 (+ 15361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:13.554834 (+  4560us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:13.554879 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:13.718734 (+163855us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.877825 (+159091us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:13.877889 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.877996 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:14.498827 (+620831us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:14.569722 (+ 70895us) raft_consensus.cc:1685] finished
0709 12:22:14.569743 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.569943 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4137,"raft.queue_time_us":4278,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":29005,"spinlock_wait_cycles":10189696,"thread_start_us":158624,"threads_started":1,"wal-append.queue_time_us":439553}
I20260709 12:22:14.569252  4256 rpcz_store.cc:276] 0709 12:22:13.506906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.507048 (+   142us) service_pool.cc:224] Handling call
0709 12:22:13.593097 (+ 86049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.593365 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:13.593407 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:13.593474 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:13.593524 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.593607 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.568516 (+974909us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b5400121450. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:14.568655 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156367616}
W20260709 12:22:14.593544  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 45480.2us
I20260709 12:22:14.516156  9070 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.610651  9266 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:14.611244  9266 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.612733  4407 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:14.611101  9272 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.621106  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.632881  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.633692  4249 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:22:14.636997  4256 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:14.638376  8938 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.604568  8991 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.639889  9220 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:14.640530  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:14.641285  4327 raft_consensus.cc:2393] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:14.641806  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 3004) took 1009 ms. Trace:
I20260709 12:22:14.642318  4371 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:14.642473  9266 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.643365  9146 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:14.643447  9266 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:14.643816  9146 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.644191  9146 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:14.644018  9266 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.647217  9266 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.648109  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:14.648960  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 2636) took 1092 ms. Trace:
I20260709 12:22:14.649166  8875 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:14.649345  4326 rpcz_store.cc:276] 0709 12:22:13.556701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.740916 (+184215us) service_pool.cc:224] Handling call
0709 12:22:14.647948 (+907032us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:22:14.648901 (+   953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8446208}
I20260709 12:22:14.523737  9274 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.641201  8991 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:14.642114  4327 rpcz_store.cc:276] 0709 12:22:13.632591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.632757 (+   166us) service_pool.cc:224] Handling call
0709 12:22:14.640384 (+1007627us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5800176a98. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59a22 00007fdbb6b728d9 00007fdbb5cccee0 00007fdbb5d960ab 00007fdbb5d96131 00007fdbb5d440a0 00007fdbb5d43984 00007fdbaf2be6d4 00007fdbaf2be662
0709 12:22:14.641739 (+  1355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12964736}
I20260709 12:22:14.671411  9028 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:14.672686  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.673436  4256 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:14.675165  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.650051  8875 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:14.672129  9028 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.704394  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.707427  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.709447  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.698679  8869 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:14.711922  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:14.695950  9276 raft_consensus.cc:2764] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:22:14.714006  9134 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:14.713907  9101 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:14.714236  8869 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:14.719082  9043 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:14.702666  9271 consensus_queue.cc:1059] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:22:14.749593  4401 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:14.724867  9266 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:14.747421  9043 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:14.756062  9210 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.755256  8938 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:14.798362  8165 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:14.800774  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:14.806469  4401 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:22:14.807904  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 262523us
I20260709 12:22:14.788897  9043 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:14.813050  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.795095  9101 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:14.783505  9266 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.808595  9189 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:14.818419  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.824162  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:14.827075  8029 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:14.827566  8029 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.827943  8029 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:14.836510  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.817557  8938 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:14.799494  9210 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.823657  9161 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:14.833834  9278 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:22:14.838884  9048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.018s
I20260709 12:22:14.858258  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:14.807884  8869 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.860390  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:14.866925  4256 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:14.868213  4257 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:22:14.868657  4257 pending_rounds.cc:85] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 7
I20260709 12:22:14.868897  4257 pending_rounds.cc:107] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:22:14.869174  4257 raft_consensus.cc:2889] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:14.844894  9078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.014s	sys 0.003s
I20260709 12:22:14.870716  8029 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.878279  8029 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:14.839800  9274 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:14.861836  9048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.009s	sys 0.019s
I20260709 12:22:14.825363  9101 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.859939  9278 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:14.855698  9281 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:14.881438  9078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.014s	sys 0.003s
I20260709 12:22:14.919092  4986 raft_consensus.cc:1240] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:14.894135  8869 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:14.934365  4983 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:14.938162  9028 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.941514  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:14.943583  9285 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:14.944170  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.945101  9266 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.946997  4331 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:22:14.947592  9028 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.948062  9280 log.cc:927] Time spent T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:22:14.949815  9283 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:22:14.951756  9282 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:22:14.952091  9146 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.954773  9146 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:14.955456  9294 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:14.956069  9294 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.948133  9028 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.960526  9210 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.964288  9278 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.966192  9028 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:14.913659  9281 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.969436  9043 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.970259  9281 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.971205  9275 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.973812  9275 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.958626  9294 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:14.976173  9279 log.cc:927] Time spent T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:14.930752  9078 consensus_queue.cc:1243] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:22:14.977649  9171 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:14.978699  4328 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:14.979678  4372 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:14.979079  4328 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:14.982054  4328 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:14.983330  4328 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:14.984032  9146 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:14.984968  9070 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:14.989344  9173 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:14.989903  9173 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:14.993485  9101 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:14.994858  4328 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:14.999255  4326 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:15.001932  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:15.002749  4249 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:15.001844  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:15.015439  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.017268  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:15.018031  4403 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:15.019564  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:15.016170  4331 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:22:15.027354  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.032557  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.033370  4331 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 8.
I20260709 12:22:15.034581  4333 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:15.035609  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.037931  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:15.040246  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:14.995127  9274 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:15.042447  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.043201  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:15.052642  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:15.053287  4331 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:15.037457  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:15.031574  9204 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:22:15.016543  9218 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:15.091234  4332 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:15.065613  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:15.088857  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.093854  4328 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:15.097922  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:15.107666  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:15.110240  9173 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:15.025750  9047 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:22:15.115087  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:15.120702  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:15.121327  9294 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:15.121901  9294 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.124081  9294 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:15.134981  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:15.135816  4255 raft_consensus.cc:3060] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:15.063696  9210 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.144526  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.050067  9271 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:15.039115  9189 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 12:22:15.151083  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.156328  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 214892us
I20260709 12:22:15.163343  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.065164  9274 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.176532  4956 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:15.184302  4255 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:15.185340  8029 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:15.133153  9218 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.189272  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:15.160454  9160 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.201503  8029 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:15.204298  9082 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:15.205039  9082 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.205556  9082 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.149513  9210 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:15.151889  9271 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:15.188356  9161 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:22:15.223608  9160 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:15.224751  9312 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
W20260709 12:22:15.281013  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.170785  9230 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:22:15.320693  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.331751  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 153511us
W20260709 12:22:15.328030  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 272127us
I20260709 12:22:15.234323  9285 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
W20260709 12:22:15.343564  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 142613us
I20260709 12:22:15.344764  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:15.345960  4331 raft_consensus.cc:2468] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:15.347218  4955 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:15.338819  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:22:15.298763  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 131105us
W20260709 12:22:15.330865  9295 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:22:15.350943  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 150340us
I20260709 12:22:15.354739  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:15.358132  4955 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.358336  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:15.357739  4372 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:15.351267  9311 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:15.368474  9302 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 12:22:15.369464  9305 log.cc:927] Time spent T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:22:15.370270  9314 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:22:15.371217  9308 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:15.348542  9078 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:15.395004  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:15.397225  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:15.400061  4992 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
W20260709 12:22:15.454998  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.352864  9303 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.386041  8823 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:15.401432  9309 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:22:15.385475  9266 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:15.397913  9319 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:15.505600  9304 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:22:15.403232  9048 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:15.540234  9274 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:15.542776  9230 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:15.505730  9078 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.545902  9218 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:15.572151  9315 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:22:15.583722  9310 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:22:15.520223  9323 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 12:22:15.619194  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:15.623533  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 261970us
I20260709 12:22:15.573185  9082 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.574213  9160 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:15.561398  9210 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:15.580576  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:15.679574  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 55003us
I20260709 12:22:15.680416  4372 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:15.682994  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 63529.9us
W20260709 12:22:15.695009  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 336736us
I20260709 12:22:15.701241  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:15.562345  9048 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:15.703181  4371 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:15.702066  9274 raft_consensus.cc:2804] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:15.710959  9274 raft_consensus.cc:697] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:15.711900  9274 consensus_queue.cc:237] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:15.704988  9266 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:15.717162  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:15.717891  4401 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:15.728112  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.761150  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 58045.9us
I20260709 12:22:15.761986  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:15.767367  4401 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:15.734941  9160 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.770763  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:15.770434  9331 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.768738  9266 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:15.798236  9154 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.812613  9082 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:15.813385  9078 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:15.815047  9048 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:15.783171  9160 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.822310  9160 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:15.838081  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:15.848290  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 87082.7us
W20260709 12:22:15.849853  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 89464.6us
I20260709 12:22:15.855227  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:15.862409  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 76235.3us
I20260709 12:22:15.865329  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.866292  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:15.866961  4329 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:15.890211  9290 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:15.908190  4329 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:15.910008  9290 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:15.926079  9043 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:15.915716  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.008s	sys 0.027s
W20260709 12:22:15.945262  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.008s	sys 0.027s
I20260709 12:22:15.949097  9340 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:15.949903  9340 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:15.953328  9340 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:15.952052  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 870779us
I20260709 12:22:15.955870  4252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 1049) took 1343 ms. Trace:
I20260709 12:22:15.956341  4252 rpcz_store.cc:276] 0709 12:22:14.612140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.612747 (+   607us) service_pool.cc:224] Handling call
0709 12:22:14.617199 (+  4452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.617457 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:22:14.859170 (+241713us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.955550 (+1096380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.955607 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:15.955656 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.955718 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.955818 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":862430,"prepare.queue_time_us":320970,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":455812,"threads_started":2,"wal-append.queue_time_us":367062}
I20260709 12:22:15.958778  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:15.969046  9290 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:15.972306  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:15.984699  9271 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:15.994333  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:15.996830  9336 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:22:15.997218  9301 log.cc:927] Time spent T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.827s	user 0.008s	sys 0.008s
I20260709 12:22:16.002017  9161 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.002647  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.403s	user 0.022s	sys 0.016s
W20260709 12:22:16.003041  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.022s	sys 0.016s
I20260709 12:22:16.002772  9161 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.006059  9161 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:16.009649  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 1.41017e+06us
I20260709 12:22:16.017050  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:16.022536  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:16.019392  9078 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:16.038918  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.040381  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.041513  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.042024  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.042740  4983 raft_consensus.cc:2368] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:16.021127  9336 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:16.043840  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.044370  9048 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.044956  9048 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.047078  9048 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:16.047254  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:16.048211  9078 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:16.047991  9336 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.037586  9204 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:16.049136  9204 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.045368  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.049539  9204 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.053936  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:16.054821  8787 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:16.056313  8787 consensus_queue.cc:1059] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:16.057356  9048 raft_consensus.cc:3055] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:16.057757  9048 raft_consensus.cc:740] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:16.058727  9048 consensus_queue.cc:260] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.060333  9048 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.062546  4983 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:22:16.063060  4983 pending_rounds.cc:85] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Aborting all ops after (but not including) 10
I20260709 12:22:16.063390  4983 pending_rounds.cc:107] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:22:16.063704  4983 raft_consensus.cc:2889] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:16.067409  4296 leader_election.cc:400] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:16.067776  4296 leader_election.cc:403] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:16.068744  8787 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:16.070770  8787 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:16.075065  9278 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:16.075246  9204 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.077524  9204 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:16.088150  9275 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:16.088821  9275 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.091068  9275 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.093262  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:16.094450  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:16.095476  4404 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:16.098004  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:16.101233  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.102150  4983 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:16.106503  9218 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:16.107586  4409 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:16.109290  9218 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:16.110205  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:16.111960  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:16.112922  9278 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:16.107611  9204 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:16.116470  9204 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:16.117563  9204 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.119457  9320 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:16.119618  9204 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:16.120117  9320 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.122654  9320 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:16.124076  9275 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.124560  9275 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.124837  9320 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:16.126129  9320 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.126653  9275 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.128412  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.129115  4983 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:16.130292  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:16.131191  9275 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:16.131394  9320 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.131629  9275 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.132081  9275 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:16.133133  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 176728us
I20260709 12:22:16.135275  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.136206  4983 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 15: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:16.154162  9204 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.155576  9204 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.158325  9204 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:16.153823  9218 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.159377  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:16.159250  9218 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.160036  4405 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:16.161478  9218 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.164047  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.164788  4983 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:16.165669  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.167394  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.168875  9307 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:16.169864  9307 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.183548  9307 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:16.170583  9275 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.176126  9218 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:16.189013  9218 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.189421  9218 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.197047  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:16.197750  4983 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:16.201115  9342 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 12:22:16.201640  9218 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.203830  9218 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.205037  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:16.205686  4984 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.220530  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:16.223656  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:16.225052  9032 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:16.231173  4983 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:16.232887  4371 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:16.233788  9275 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.235550  4984 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:16.237257  4296 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.238231  9032 raft_consensus.cc:2804] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:16.238786  9032 raft_consensus.cc:697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:16.239806  9032 consensus_queue.cc:237] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.234452  9275 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:16.244061  9340 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.247677  9340 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.249244  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:16.241017  9220 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:16.251928  9275 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:16.252628  9220 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.253738  9275 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.251123  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:16.260380  4328 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:16.255473  9321 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.261533  9321 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.264091  9321 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:16.264829  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:16.265441  9300 log.cc:927] Time spent T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 1.151s	user 0.006s	sys 0.006s
I20260709 12:22:16.265522  4329 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:16.257333  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:16.250208  9340 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:16.255131  9220 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:16.257290  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:16.256397  4372 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:16.273923  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:16.274744  4329 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:16.275844  9220 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.278242  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:16.279783  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:16.281112  9340 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:16.281633  9340 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:16.281117  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.282145  9340 raft_consensus.cc:3060] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:16.283483  9321 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:16.283900  9321 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.284317  9321 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.282895  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.288885  9174 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:16.289379  9174 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.289788  9174 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:16.194610  9307 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.301496  9307 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:16.302063  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:16.302598  4405 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:16.310532  9321 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.313022  4405 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:16.314157  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.314527  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:16.315213  4329 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.315100  9218 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:16.322418  4329 raft_consensus.cc:2468] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:16.315346  9220 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:16.323810  4372 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.318847  9218 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:16.316836  9321 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:16.327214  8823 raft_consensus.cc:2804] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:16.327832  8823 raft_consensus.cc:697] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:16.328651  9218 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.329746  9220 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.330292  9220 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.333099  9220 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:16.333492  9337 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:16.333776  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:16.333994  9337 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.336174  9337 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:16.328658  8823 consensus_queue.cc:237] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:16.338691  9078 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:16.339841  9271 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:16.340204  9271 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:16.341943  4400 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:22:16.341888  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:16.343240  4329 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:16.344169  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:16.346520  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:16.347669  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.344995  9337 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:16.353204  9337 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.349493  9220 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:16.340986  9271 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:16.346323  9171 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:22:16.355558  9271 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:16.361770  9220 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.186605  9220 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.072363  9048 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:17.101986  4327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55256 (request call id 2639) took 2156 ms. Trace:
I20260709 12:22:17.187498  4327 rpcz_store.cc:276] 0709 12:22:14.945732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.956617 (+ 10885us) service_pool.cc:224] Handling call
0709 12:22:14.956927 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.998045 (+ 41118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.998074 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.998109 (+    35us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:14.998137 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.101694 (+2103557us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b54003d3954. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:17.101748 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.101896 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94173056}
I20260709 12:22:17.102777  8875 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:16.862299  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.158039  8029 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.191836  8029 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:17.119093  9340 consensus_meta.cc:287] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.836s	user 0.005s	sys 0.011s
I20260709 12:22:17.187282  9048 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.193830  9340 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.144345  8823 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:17.062034  4218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.003s	sys 0.006s
W20260709 12:22:17.195570  4218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.004s	sys 0.006s
W20260709 12:22:17.195871  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 1.8561e+06us
I20260709 12:22:17.195814  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.197052  4401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 1996) took 1108 ms. Trace:
I20260709 12:22:17.170667  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 1356) took 2703 ms. Trace:
I20260709 12:22:17.197410  4401 rpcz_store.cc:276] 0709 12:22:16.088726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.195541 (+1106815us) service_pool.cc:224] Handling call
0709 12:22:17.196990 (+  1449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:17.189111  8875 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:17.040756  4406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.008s
W20260709 12:22:17.199510  4406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.000s	sys 0.009s
I20260709 12:22:17.197921  4330 rpcz_store.cc:276] 0709 12:22:14.467385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.467535 (+   150us) service_pool.cc:224] Handling call
0709 12:22:14.477160 (+  9625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.726817 (+249657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.726850 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.746777 (+ 19927us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.934891 (+188114us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:15.047606 (+112715us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.047831 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.047900 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.799718 (+751818us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003fe920. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:22:16.264823 (+465105us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:17.170432 (+905609us) raft_consensus.cc:1685] finished
0709 12:22:17.170457 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.170602 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8535,"prepare.queue_time_us":115653,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":15561,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":222,"spinlock_wait_cycles":75920512,"thread_start_us":383200,"threads_started":2,"wal-append.queue_time_us":329514}
W20260709 12:22:17.173555  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.200047  8875 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.200536  8875 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.195241  8823 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.201444  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.202059  4984 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:17.176759  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.203820  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.197405  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.201035  8875 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.221683  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.222296  9368 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.226992  9368 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.157640  9358 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.195259  9048 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.178376  9363 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.231171  8029 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.236637  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.240041  4329 raft_consensus.cc:1275] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:17.174093  9362 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.229914  9275 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:17.250908  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.227771  9370 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.266002  4329 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:17.310945  9340 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.309486  8029 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:17.311913  8029 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.251667  9359 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.238060  9369 raft_consensus.cc:476] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:22:17.241614  9177 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.314687  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:17.316725  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:17.316875  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 77892.8us
I20260709 12:22:17.320961  8029 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:17.328330  9218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.003s	sys 0.006s
I20260709 12:22:17.232791  9358 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.239188  9363 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.339082  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.350637  4983 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
W20260709 12:22:17.332432  9356 log.cc:927] Time spent T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:17.337785  8875 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.353232  8875 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.353716  8875 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.355631  8875 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.356102  8875 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:17.356717  9358 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.356969  8875 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.329089  9368 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.357693  9368 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.358270  9368 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.360388  9368 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:17.336491  9218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.004s	sys 0.006s
I20260709 12:22:17.357506  8875 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.363282  4330 raft_consensus.cc:2468] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:17.327611  9369 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:17.329344  9048 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:17.328002  8823 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.303160  9362 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.362018  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.329833  9371 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.313083  9370 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.367856  9371 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.368584  9363 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.369222  9370 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.369957  9371 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.370051  9220 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:17.371892  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001b3320 after lost signal to thread 3102
I20260709 12:22:17.372239  9362 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.365724  9358 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:22:17.373368  9048 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.366001  9218 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.374315  9218 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.378113  9218 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.379408  8029 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:17.379967  4406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60136 (request call id 2011) took 1021 ms. Trace:
I20260709 12:22:17.372278  9220 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.380409  8029 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.385833  8029 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.381239  9048 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.383023  9372 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:17.380416  4406 rpcz_store.cc:276] 0709 12:22:16.358978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.359109 (+   131us) service_pool.cc:224] Handling call
0709 12:22:16.359582 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:16.359978 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.360006 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:16.365040 (+  5034us) log.cc:844] Serialized 52 byte log entry
0709 12:22:17.199899 (+834859us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:22:17.232814 (+ 32915us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.366821 (+134007us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.379639 (+ 12818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.379721 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:17.379767 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:17.379780 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.379911 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25166,"prepare.queue_time_us":111256,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":910588,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":1715,"spinlock_wait_cycles":99584,"thread_start_us":987814,"threads_started":3,"wal-append.queue_time_us":675751}
I20260709 12:22:17.382813  8875 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:17.386157  9174 consensus_meta.cc:287] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 1.096s	user 0.013s	sys 0.007s
I20260709 12:22:17.337226  9177 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.387897  9311 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:17.395246  9311 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.396986  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.388021  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.398051  9311 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:17.372306  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca6a0 after lost signal to thread 3105
I20260709 12:22:17.390799  8029 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.399235  9311 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:17.399058  4989 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:17.399751  8029 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.399818  9311 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.401708  8029 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.401954  4401 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:17.402864  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.320304  9359 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.408138  9359 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.391580  9372 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.409250  9372 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.409687  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.366110  9369 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.393339  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.413960  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.392000  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:17.416994  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 195628us
I20260709 12:22:17.415426  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.417106  4401 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:17.420226  8875 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.420965  8875 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.422292  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.423889  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.423992  9173 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.424708  9173 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.425740  4401 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:17.427084  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.427647  4401 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:17.428438  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.428804  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.429379  4401 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:17.429563  9370 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:17.430454  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.431874  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:17.432879  4983 raft_consensus.cc:2393] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 15: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:17.433053  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.434589  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.435915  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.438195  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.438758  4989 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:17.438659  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.439488  8875 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.440016  9173 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.441650  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.441519  9363 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:17.442431  8875 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:17.442497  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.443742  9368 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:17.444128  9368 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.444475  9368 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.444757  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.446681  9177 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.446024  9218 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:17.447199  9218 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.416800  9204 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.471318  9204 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.473397  9204 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.416643  9174 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.418423  9369 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:17.418264  9048 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.475765  9048 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.477903  9272 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:17.478164  9048 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.470719  9337 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:17.483901  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.484722  9048 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.485321  9048 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.453009  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.488590  8787 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.489094  8787 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.489759  9048 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.493817  4334 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:17.496400  9154 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:17.496503  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 2660) took 1246 ms. Trace:
I20260709 12:22:17.496965  9154 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.496996  4334 rpcz_store.cc:276] 0709 12:22:16.250355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.257112 (+  6757us) service_pool.cc:224] Handling call
0709 12:22:17.496283 (+1239171us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540013c754. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:17.496415 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822024448}
I20260709 12:22:17.456509  9368 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.457551  4296 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:17.501011  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 43553.7us
I20260709 12:22:17.501799  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.501952  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.502106  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.502576  4406 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 9: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:17.502718  9371 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:17.459926  9311 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.503381  9371 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:17.461084  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.462671  9218 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:17.505016  9174 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.464991  8875 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.507493  8875 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.513970  4956 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.470707  4329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50060
I20260709 12:22:17.515455  9311 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:17.515594  4329 raft_consensus.cc:606] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Received request to transfer leadership
I20260709 12:22:17.517412  4956 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.522413  9051 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.491046  8787 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.523020  9051 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.523777  8029 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:17.524272  8029 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:17.525017  8029 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.525451  9051 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.525928  9372 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.499086  9154 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.533788  4956 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.542465  4329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50060
I20260709 12:22:17.544229  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.544665  4329 raft_consensus.cc:606] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Received request to transfer leadership
I20260709 12:22:17.545154  4334 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:17.546517  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.547178  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.555181  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.555395  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.555656  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.557611  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.558612  9154 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:17.558817  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.559185  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.559609  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.560258  4408 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:17.562563  4955 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.563539  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.514832  8875 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.566447  8824 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:17.568732  9331 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.569325  9331 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.570847  8824 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:17.571844  9331 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.574636  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:17.580264  9372 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.580049  9009 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:17.581547  9009 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.582038  9009 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.584167  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.587364  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:17.583272  9294 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.595029  9294 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.542954  9218 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.592284  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.605724  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:17.610625  4327 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:17.608783  9337 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:17.612561  9337 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.613135  9337 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:17.617704  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 283822us
I20260709 12:22:17.562081  9369 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.621644  9369 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.626708  9322 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:17.632833  9307 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:17.633462  9307 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.634632  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.635910  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:17.636475  4983 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:17.636945  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.636561  9331 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:17.637866  4372 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:17.639518  4372 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.640455  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:17.641031  4986 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:17.643658  9321 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:17.644263  9307 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.643488  9174 raft_consensus.cc:2804] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:17.644989  9174 raft_consensus.cc:697] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:17.643478  9369 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:17.647753  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.649461  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.645720  9322 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:17.651578  9322 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.653268  8875 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.654455  9174 consensus_queue.cc:237] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.656883  4371 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.659072  4334 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:17.658979  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:17.659691  4329 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.663923  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:17.664642  4328 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:17.668984  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.670970  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:17.671917  8875 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:17.674082  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:17.674765  4404 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.644275  9321 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:17.675127  9173 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:17.667531  9331 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.676062  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.676546  9331 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.677058  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:17.677398  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.677650  4408 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:17.678217  4325 raft_consensus.cc:2393] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:17.678782  9331 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.675266  9321 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:17.681568  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.682229  4984 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 8.
I20260709 12:22:17.684098  9218 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.674211  9368 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.693207  9336 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:17.697897  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 105731us
I20260709 12:22:17.703588  4986 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:17.704077  4983 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:17.708271  9336 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.717072  9322 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.718209  9336 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.720086  9322 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.720861  9321 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.722363  9321 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:17.762364  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 91373.9us
I20260709 12:22:17.768644  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:17.756899  4138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 185208us
I20260709 12:22:17.775283  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.774664  4372 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.770678  4325 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:17.798280  9177 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:17.798784  9173 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:17.799685  9177 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.805039  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.810271  4325 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:17.817075  4296 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:17.818619  9218 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:17.818708  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:17.827031  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52994.2us
I20260709 12:22:17.829501  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:17.835980  9307 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:17.836982  9307 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:17.819550  9218 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:17.874398  8165 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.858565  4325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50060
I20260709 12:22:17.877895  8976 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:17.881928  9271 consensus_meta.cc:287] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 1.526s	user 0.017s	sys 0.008s
I20260709 12:22:17.884567  9267 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:17.869239  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:17.802989  9369 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:17.882946  9043 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.902630  4332 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
W20260709 12:22:17.905529  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55991.5us
W20260709 12:22:17.908273  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 280602us
I20260709 12:22:17.729001  9337 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.914567  4992 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:17.917497  9337 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:17.919907  8165 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.916927  8976 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.902019  4325 raft_consensus.cc:606] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Received request to transfer leadership
I20260709 12:22:17.923445  8165 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.925601  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:17.911049  9294 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.936797  9267 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.937740  9177 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:17.931737  9307 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.944738  8875 raft_consensus.cc:993] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: : Instructing follower 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:22:17.945502  8875 raft_consensus.cc:1081] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Signalling peer 899897e6794541b5ab538af361fc9e6c to start an election
I20260709 12:22:17.927454  9043 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:17.950380  9218 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:17.951869  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:17.952939  4325 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:17.954262  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:22:17.961545  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 1.82757e+06us
W20260709 12:22:17.961882  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 703299us
W20260709 12:22:17.975605  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68337.4us
I20260709 12:22:17.958182  9043 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:17.977226  4955 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:17.982991  4408 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:17.993036  9177 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:17.993702  9177 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.994132  9177 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:17.986220  4329 raft_consensus.cc:2468] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
W20260709 12:22:18.012466  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 81446.7us
I20260709 12:22:18.018818  9322 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:18.019207  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001200a0 after lost signal to thread 4187
W20260709 12:22:18.021513  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac4a0 after lost signal to thread 4281
W20260709 12:22:18.021862  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08000f0760 after lost signal to thread 4282
I20260709 12:22:18.025260  4992 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
W20260709 12:22:18.034039  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4500 after lost signal to thread 4358
I20260709 12:22:18.016752  9267 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.025563  8976 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.038141  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:18.039732  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:18.047436  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:18.045661  4992 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.048952  9322 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:18.049417  9322 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.049767  9322 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:18.052515  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 65979.4us
I20260709 12:22:18.054003  9387 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:18.054512  9387 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:18.054911  9387 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:18.059039  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.059805  4992 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:18.066779  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.070714  9009 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.072747  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.073930  9272 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:18.074560  9272 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:18.075763  9272 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.076599  9337 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.082966  9337 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:18.088137  4430 debug-util.cc:398] Leaking SignalData structure 0x7b0800278440 after lost signal to thread 4433
W20260709 12:22:18.088536  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9bc0 after lost signal to thread 4434
I20260709 12:22:18.102643  9009 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.111573  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.112541  4332 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:18.115988  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.110841  4372 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.118901  4404 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:18.119757  9362 raft_consensus.cc:2804] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:18.119879  4328 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:18.120559  9362 raft_consensus.cc:697] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:18.127504  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.129460  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:18.129369  9336 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:18.131168  9336 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.131559  9336 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:18.138198  4430 debug-util.cc:398] Leaking SignalData structure 0x7b0800419280 after lost signal to thread 5016
W20260709 12:22:18.138624  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08003fcbc0 after lost signal to thread 5018
I20260709 12:22:18.136333  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:18.121837  9362 consensus_queue.cc:237] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.140110  9358 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:22:18.140548  9407 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:22:18.141022  9134 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:18.141414  4430 debug-util.cc:398] Leaking SignalData structure 0x7b080032c5e0 after lost signal to thread 9202
W20260709 12:22:18.141763  4430 debug-util.cc:398] Leaking SignalData structure 0x7b080040f620 after lost signal to thread 9203
W20260709 12:22:18.142213  4430 debug-util.cc:398] Leaking SignalData structure 0x7b08001de460 after lost signal to thread 9213
W20260709 12:22:18.142925  4430 debug-util.cc:398] Leaking SignalData structure 0x7b080039e9e0 after lost signal to thread 9295
I20260709 12:22:18.143255  9186 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.144061  9186 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.145754  9101 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:18.145957  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 2159) took 3093 ms. Trace:
I20260709 12:22:18.146538  9101 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.146463  4254 rpcz_store.cc:276] 0709 12:22:15.052534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.053262 (+   728us) service_pool.cc:224] Handling call
0709 12:22:15.064331 (+ 11069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.064578 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:22:15.133989 (+ 69411us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.819669 (+2685680us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.145283 (+325614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.145359 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:18.145402 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.145542 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.145727 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2784314,"prepare.queue_time_us":44588,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":3043,"raft.queue_time_us":2809135,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"spinlock_wait_cycles":86272,"thread_start_us":268985,"threads_started":3,"wal-append.queue_time_us":425949,"wal-append.run_cpu_time_us":12671,"wal-append.run_wall_time_us":1955112}
I20260709 12:22:18.151985  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.152731  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.153497  4256 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:18.153558  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.153942  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.154832  4248 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:18.154736  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.155738  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.156127  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.155695  4249 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
W20260709 12:22:18.152737  4296 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.7.129:34061 timed out after 1.876s (SENT) [suppressed 20 similar messages]
I20260709 12:22:18.157554  9404 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.157696  9358 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:18.157696  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:22:18.159409  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 161489us
I20260709 12:22:18.159142  9358 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.162236  9186 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:18.157174  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 183108us
I20260709 12:22:18.163851  4983 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:22:18.164482  9405 log.cc:927] Time spent T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:22:18.165313  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.166464  8976 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:18.166927  9403 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:18.167495  9403 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.167946  9403 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:18.155710  9400 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.176787  9400 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:18.178246  9410 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:22:18.141670  9134 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.170506  4330 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:18.192685  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.179262  9400 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.199162  9404 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.201881  9404 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.206805  4328 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:22:18.207712  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.208027  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2207) took 3095 ms. Trace:
I20260709 12:22:18.208087  9390 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:18.207633  4333 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:18.209019  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.210652  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.214849  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:18.220095  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.191002  9387 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.208484  4253 rpcz_store.cc:276] 0709 12:22:15.112067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.114279 (+  2212us) service_pool.cc:224] Handling call
0709 12:22:15.114553 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.114715 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:15.224225 (+109510us) log.cc:844] Serialized 14 byte log entry
0709 12:22:17.889473 (+2665248us) log.cc:844] Serialized 14 byte log entry
0709 12:22:18.080526 (+191053us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b1800303ee0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbb09264bc 00007fdbadc7448b 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e23a
0709 12:22:18.185865 (+105339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:18.190413 (+  4548us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:18.194592 (+  4179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:18.207640 (+ 13048us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:18.207824 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2629577,"prepare.queue_time_us":112669,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":6174,"raft.queue_time_us":3017799,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":4375,"spinlock_wait_cycles":7585664,"thread_start_us":249815,"threads_started":2,"wal-append.queue_time_us":100925}
I20260709 12:22:18.229565  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:18.235280  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.236107  4329 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:18.244087  9047 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:18.245090  4984 raft_consensus.cc:1240] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:18.245193  9047 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.248587  9134 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.249935  9387 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.254822  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.255324  4332 raft_consensus.cc:1217] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 12:22:18.255895  4332 raft_consensus.cc:1240] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:22:18.258678  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.259613  4405 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.260661  4992 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:18.284013  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.284086  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:18.287314  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62585.7us
I20260709 12:22:18.289342  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.254910  9403 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.291473  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.296845  4403 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:18.301560  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:18.305039  9404 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.308617  9404 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.310356  4332 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:18.311828  4401 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:22:18.330876  9337 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.341802  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.341506  9177 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.342072  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.343111  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.343501  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.351521  9134 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.343619  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.343750  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.344696  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.345767  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.346439  9047 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.347029  9186 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.347817  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:18.355492  4256 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:18.307529  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.360186  4253 raft_consensus.cc:1275] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:22:18.369545  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.298044  9336 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.366011  9186 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.374023  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.374639  4983 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:18.354912  9404 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.370225  4256 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:18.355437  9101 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.368930  9134 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.371973  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.387871  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.389017  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.374672  4248 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:18.377630  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.370457  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.366041  4401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:60136
I20260709 12:22:18.384895  9186 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.385696  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.388250  4247 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:18.397701  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.407778  4409 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:18.408023  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.408645  4250 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:18.408829  9134 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.409626  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.409785  4249 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:18.410768  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.411391  9377 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:18.411495  4254 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:18.411934  9377 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:18.412226  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.412942  4401 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.413347  4401 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.414178  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.415346  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.400864  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.416182  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:18.416464  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.417258  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.417599  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.418154  4253 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:18.411415  4249 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:18.419883  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.412410  9377 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.418103  4256 raft_consensus.cc:3055] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:18.413342  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:18.422952  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 120474us
I20260709 12:22:18.423573  4253 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:18.422976  4256 raft_consensus.cc:740] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:18.425246  4247 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:18.425292  4257 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:18.419103  4248 raft_consensus.cc:1275] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:18.424345  4405 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
W20260709 12:22:18.428522  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 133219us
I20260709 12:22:18.430145  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.431879  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.431879  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.432695  4253 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:18.429605  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 122394us
I20260709 12:22:18.448800  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.432998  4252 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:18.454547  9067 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:18.454811  4256 consensus_queue.cc:260] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.458214  4372 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.462425  4249 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:18.462733  4256 raft_consensus.cc:3060] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.462885  4249 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:18.463727  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.464123  4334 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:18.463923  4249 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.465131  4249 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.467693  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.455719  9067 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:18.469419  9067 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.472559  9336 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:18.476948  9403 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.480022  4253 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:18.482535  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.488976  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:18.492100  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:18.491410  4983 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 15. Ops: []
I20260709 12:22:18.493842  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.494503  4333 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:18.495729  4256 raft_consensus.cc:1275] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:22:18.498631  9174 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:18.500656  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:18.488247  4218 connection.cc:256] RPC call timeout handler was delayed by -1.4579851789999339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:22:18.503224  4257 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
W20260709 12:22:18.504204  4218 connection.cc:256] RPC call timeout handler was delayed by -1.2923851790001208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
I20260709 12:22:18.511698  4983 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:18.511740  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.513401  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:18.500034  9174 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:18.518427  4333 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:18.512677  9177 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.522912  4327 raft_consensus.cc:1275] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:18.525893  4955 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:18.529650  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.530234  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.534078  4252 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:18.542565  9160 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:18.544826  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.547461  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.533216  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.549398  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.552145  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:18.549525  4401 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.552724  4254 raft_consensus.cc:606] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:18.570868  9415 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:22:18.575716  9271 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.576356  9271 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.578748  9271 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:18.581607  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 62724.3us
I20260709 12:22:18.583560  9205 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:18.584880  4401 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:18.585165  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:18.586001  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.587568  9174 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.589085  4409 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:18.589372  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.590780  9154 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:18.591271  9154 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:18.591879  9322 consensus_meta.cc:287] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.002s
I20260709 12:22:18.592360  9322 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.599777  9420 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:18.600545  9420 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:18.601689  9420 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.604584  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.605230  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.606033  4256 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:18.606077  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.606750  4253 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 7.
I20260709 12:22:18.592252  9154 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.609169  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:18.607468  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.613018  4400 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.614033  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.607051  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:18.615350  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.615980  4401 raft_consensus.cc:2368] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10.
I20260709 12:22:18.607179  4249 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:18.616273  4257 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:18.612344  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.609400  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.616835  4254 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:18.605294  4248 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:18.617811  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.628903  4328 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:18.632714  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:22:18.634209  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.636451  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.637193  4256 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:18.638348  4400 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:18.640547  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.641299  4329 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.643687  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.644323  4255 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:18.645452  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 142757us
I20260709 12:22:18.646394  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.648156  4250 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:22:18.648406  4252 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:18.595144  9322 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.662750  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.663185  4257 raft_consensus.cc:3055] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:18.668493  4257 raft_consensus.cc:740] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:18.668396  9160 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:18.670866  9160 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:18.671797  9160 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.675627  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.675964  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.676246  4256 raft_consensus.cc:2376] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11. Re-sending same reply.
I20260709 12:22:18.677146  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.670646  4257 consensus_queue.cc:260] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.678244  4257 raft_consensus.cc:3060] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:18.653514  9271 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:18.683701  9271 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:18.684585  9271 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.678221  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.685700  4250 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:18.686743  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.679932  4249 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:22:18.677155  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.688508  4296 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.689904  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.690390  9272 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:18.690903  9272 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:18.691037  9338 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:18.691458  9338 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.691823  9338 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.691944  9272 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.696770  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.697090  9376 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:18.697445  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.700158  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.700505  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.701511  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.702440  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.702939  4325 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:18.703626  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.704481  4330 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:18.708119  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 161557us
I20260709 12:22:18.703219  4325 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:18.709393  4329 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:18.711290  4956 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:18.718189  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.718590  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.722471  4333 raft_consensus.cc:1240] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:22:18.723562  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:18.728704  4257 raft_consensus.cc:1275] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:22:18.729775  4257 pending_rounds.cc:85] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 9
I20260709 12:22:18.719406  4325 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.736492  4325 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:18.737323  4955 leader_election.cc:400] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10.
I20260709 12:22:18.721297  9009 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:18.741952  9009 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:18.743041  9009 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:18.714094  9322 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:18.730477  4257 pending_rounds.cc:107] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:22:18.748966  4257 raft_consensus.cc:2889] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:18.752317  4327 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:18.754712  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.755600  4371 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:18.758930  9358 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:18.771754  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.772497  4248 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
W20260709 12:22:18.778218  9418 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.321s	user 0.001s	sys 0.007s
I20260709 12:22:18.784893  4255 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:18.788492  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:18.791056  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:18.804145  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 111296us
I20260709 12:22:18.780552  9322 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:18.834625  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46259us
I20260709 12:22:18.800493  9174 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:18.844107  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:18.855412  9422 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.385s	user 0.007s	sys 0.002s
I20260709 12:22:18.859313  4248 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:18.839356  9174 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:18.850256  9047 consensus_queue.cc:1059] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:22:18.863152  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.861071  9174 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:18.870682  8976 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.874434  8976 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.876533  8976 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.861200  9400 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:22:18.872920  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.881026  4248 raft_consensus.cc:2376] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13. Re-sending same reply.
I20260709 12:22:18.873699  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:18.883055  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:18.883616  9177 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:18.884048  9337 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:18.894011  4325 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:18.861289  9377 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:18.901808  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:18.902575  4248 raft_consensus.cc:2376] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12. Re-sending same reply.
I20260709 12:22:18.905743  4332 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:22:18.916872  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.917619  4248 raft_consensus.cc:2468] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:18.918833  4328 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:18.931799  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 86474.8us
I20260709 12:22:18.933224  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:18.944736  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:18.952190  9101 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:18.952638  9101 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:18.953632  9101 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:18.960068  9426 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:22:18.978446  9430 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:22:18.979916  9429 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:18.985363  9338 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:18.987015  9434 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:18.991941  9322 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:18.994882  9337 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:19.000051  9377 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:19.013648  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.014376  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.016278  4255 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:22:19.030644  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.031420  9009 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.031975  9009 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.034626  9009 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:19.035313  4149 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 8, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 8 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.038307  4149 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 10 to 15, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:19.050259  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 127159us
I20260709 12:22:19.051496  9358 consensus_queue.cc:1048] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:19.053674  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.054526  9358 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.054956  9358 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.055415  9358 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.066955  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:19.067116  9177 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.073107  4326 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:22:19.073951  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.096218  9338 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:19.100757  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 55275.5us
W20260709 12:22:19.108771  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 303942us
I20260709 12:22:19.138267  4153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 388) took 9806 ms. Trace:
W20260709 12:22:19.144357  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90789us
W20260709 12:22:19.153924  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 173594us
I20260709 12:22:19.156886  4326 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:22:19.158507  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.122666  9338 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:22:19.121033  9177 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:22:19.161629  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 321330us
I20260709 12:22:19.107144  9174 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.164664  9276 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:22:19.168356  4219 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:19.167605  4149 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.170759  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.170961  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:19.171602  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.168321  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.176586  9134 consensus_queue.cc:1059] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:19.177094  8824 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:22:19.177729  9134 raft_consensus.cc:3055] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:19.178071  4406 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:19.187345  4326 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:19.187769  9438 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:19.188115  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:19.189263  4326 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:19.189415  4331 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 15. Ops: []
I20260709 12:22:19.190716  4328 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:19.190646  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.191628  4252 raft_consensus.cc:2368] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:19.191670  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.192517  4247 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:19.192692  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.193274  4247 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.179811  8976 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:19.197093  9067 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:19.197576  8976 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.198066  8976 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.197782  9067 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.175530  9440 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:19.184070  9186 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:22:19.199801  9440 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.200203  9440 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.200559  4983 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:19.200717  4409 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:19.201346  9403 raft_consensus.cc:3055] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:19.205690  9403 raft_consensus.cc:740] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.206552  9174 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.206506  9403 consensus_queue.cc:260] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.207806  9403 raft_consensus.cc:3060] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.208001  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.208668  4255 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:19.209676  4408 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:19.210626  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.211072  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 44328.6us
I20260709 12:22:19.194145  4247 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.213007  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:22:19.213469  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.214457  4255 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:19.214967  4255 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.215884  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.178084  9134 raft_consensus.cc:740] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.179697  9377 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.224233  9134 consensus_queue.cc:260] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.225478  9134 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.225131  4149 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 8 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.226718  4149 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.227488  4255 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.227993  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.222666  9336 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:19.220857  9205 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:22:19.230983  9377 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.231489  9377 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.228706  4255 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.233100  4248 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:19.233439  4248 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.234227  4248 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.241508  9101 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.242373  4248 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:19.243582  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 90474.9us
I20260709 12:22:19.245404  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:19.248384  9321 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.252188  9067 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:19.147845  4153 rpcz_store.cc:276] 0709 12:22:09.332213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.332523 (+   310us) service_pool.cc:224] Handling call
0709 12:22:19.138054 (+9805531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:13.043921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:13.044525 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:13.044565 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:22:13.044584 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:13.084763 (+ 40179us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:13.084826 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:13.084854 (+    28us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:22:13.090359 (+  5505us) tablet.cc:701] Row locks acquired
0709 12:22:13.090382 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:22:13.090528 (+   146us) write_op.cc:270] Start()
0709 12:22:13.090673 (+   145us) write_op.cc:276] Timestamp: P: 1783599733090478 usec, L: 0
0709 12:22:13.090698 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:22:13.199111 (+108413us) log.cc:844] Serialized 10356 byte log entry
0709 12:22:13.458749 (+259638us) op_driver.cc:464] REPLICATION: finished
0709 12:22:13.490857 (+ 32108us) write_op.cc:301] APPLY: starting
0709 12:22:13.490939 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:14.642104 (+1151165us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:14.642213 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:15.925256 (+1283043us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:15.925656 (+   400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 12:22:15.925708 (+    52us) write_op.cc:312] APPLY: finished
0709 12:22:15.926228 (+   520us) log.cc:844] Serialized 228 byte log entry
0709 12:22:16.032835 (+106607us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.033154 (+   319us) write_op.cc:454] Released schema lock
0709 12:22:16.033263 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:16.033886 (+   623us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.033941 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59700,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":29675,"apply.run_cpu_time_us":122440,"apply.run_wall_time_us":2542955,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112807,"num_ops":26,"prepare.queue_time_us":339708,"prepare.run_cpu_time_us":13400,"prepare.run_wall_time_us":201844,"raft.queue_time_us":80384,"raft.run_cpu_time_us":3620,"raft.run_wall_time_us":52923,"replication_time_us":360405,"thread_start_us":495702,"threads_started":5,"wal-append.queue_time_us":171149,"wal-append.run_cpu_time_us":29312,"wal-append.run_wall_time_us":2649302}]]}
I20260709 12:22:19.260895  9400 consensus_queue.cc:1059] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:19.261730  9400 consensus_queue.cc:1243] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:22:19.268877  4333 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:22:19.247126  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.243311  9358 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.239686  4149 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.272603  9051 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.282651  9449 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:19.284675  4255 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:22:19.282701  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 54814.2us
W20260709 12:22:19.292055  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 91797.2us
I20260709 12:22:19.287143  9377 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.293853  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.275452  9186 consensus_queue.cc:1243] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:22:19.290184  9449 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:19.305711  4330 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:19.312785  4407 raft_consensus.cc:1240] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:19.308051  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:19.314222  9445 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.315572  9358 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.315220  4149 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 4 to 11, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:19.316344  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 69272.8us
I20260709 12:22:19.316574  8976 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.317590  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:19.317377  4149 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 7 to 12, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 12 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.318648  8976 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.319581  4149 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 4 to 12, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.294561  9337 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.322608  4253 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:19.323103  4253 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.304682  4248 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:19.335780  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.341993  4253 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.324534  9358 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:19.343179  4149 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 11 to 15, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.344280  9358 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.344972  4253 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.320545  9438 consensus_queue.cc:1243] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:19.289603  9205 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:22:19.322744  9337 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:19.346204  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 54477.5us
I20260709 12:22:19.348037  4400 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:19.345021  4149 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 7 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.355373  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.344731  9358 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.290571  9051 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.357146  9337 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.357353  9177 consensus_queue.cc:1059] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:19.357795  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.357398  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.358425  9446 consensus_queue.cc:1048] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:19.360976  8824 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:19.325367  8976 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:22:19.320662  9449 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.366628  4149 catalog_manager.cc:5697] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.372519  9388 consensus_queue.cc:1059] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:19.373632  9160 consensus_queue.cc:1059] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:22:19.386622  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 166749us
I20260709 12:22:19.395435  4253 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:19.396135  4404 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:22:19.400416  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.401739  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 190644us
I20260709 12:22:19.382185  9387 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:22:19.433099  4247 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:19.426914  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 81336.5us
W20260709 12:22:19.420640  9047 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:22:19.440836  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:19.441130  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:19.444259  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.440415  8976 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:22:19.445912  9377 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.448153  9051 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:19.448086  9276 consensus_queue.cc:1048] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:19.442553  9440 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.449968  9444 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:22:19.454267  4252 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:19.462987  9421 raft_consensus.cc:3055] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:19.460314  9134 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.465363  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.451092  9440 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:19.468065  4149 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:19.470343  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.471122  4252 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:19.469960  9421 raft_consensus.cc:740] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.474504  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.474154  9421 consensus_queue.cc:260] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.478232  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.484579  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.484208  4149 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:19.487646  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 94990.8us
I20260709 12:22:19.482378  9338 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:19.489114  9338 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.489569  9338 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.466154  9154 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:19.477862  9067 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:19.491504  9154 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.491653  9067 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.492173  9377 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.492417  9154 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.493515  9321 consensus_queue.cc:1059] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:19.494678  9321 raft_consensus.cc:3055] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:19.495111  9321 raft_consensus.cc:740] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:19.498106  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.498486  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.492061  9067 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:19.502784  4247 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:22:19.510913  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.513674  9440 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.520598  4253 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:19.522348  4253 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.521874  4252 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:19.522877  4252 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.525208  4252 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:19.525098  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 136505us
I20260709 12:22:19.496333  9376 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:22:19.535919  4253 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:19.537161  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 110579us
I20260709 12:22:19.520260  9321 consensus_queue.cc:260] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.540668  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.540967  4252 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.526755  9421 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:19.547712  9452 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:22:19.539778  9177 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:22:19.550020  9358 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.551517  4401 raft_consensus.cc:1240] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:19.551864  9337 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.543253  4253 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.543771  4247 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:19.544821  9321 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:19.561528  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.566917  9453 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:19.567408  9453 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.568305  9453 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.569729  9453 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.569581  9449 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.571491  9174 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:19.571878  9174 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:19.572608  9154 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.572806  9449 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.545783  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.558944  9404 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:19.559267  9388 raft_consensus.cc:3055] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:19.579779  4253 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:19.580547  4325 raft_consensus.cc:1217] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Deduplicated request from leader. Original: 10.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:22:19.581084  4325 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:19.572759  9174 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.582695  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:19.579533  9436 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.583520  4328 raft_consensus.cc:2393] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:19.583482  9436 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.584031  9436 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.586998  9457 consensus_queue.cc:1048] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:19.580116  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:19.588961  4331 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:19.578107  9388 raft_consensus.cc:740] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.592301  9388 consensus_queue.cc:260] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.593366  9388 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.597697  9338 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.599607  9449 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.8, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:19.577307  9404 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:19.601068  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 55410.4us
I20260709 12:22:19.601840  9449 consensus_queue.cc:1243] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer b3efae3bdfff46bb9bbff1ed1ea70a90 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:19.601902  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.602955  9271 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:19.603387  9271 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.603744  9271 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.604524  9067 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.606693  4328 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:19.607110  9338 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.611662  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:19.612347  9067 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.612850  4983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "752b8a9170934f31b770429d237cdb43"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:19.613540  4983 raft_consensus.cc:606] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.613936  4983 raft_consensus.cc:614] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.614997  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.616412  9404 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.617631  9404 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.624236  4218 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.627468  4218 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.623556  9174 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.629873  9444 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:19.629957  9449 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.631372  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.631999  9271 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.634907  4252 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:22:19.635717  4331 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:19.629931  9358 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:19.636821  9403 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:22:19.640674  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 59862.7us
I20260709 12:22:19.642620  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.645148  9271 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.645423  4401 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:19.647029  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.642684  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:19.648759  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.649219  9337 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:19.649819  9271 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:19.650607  9271 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.650961  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:19.651120  9271 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:19.652761  9421 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:19.654130  4400 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:19.655289  4221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.656625  9431 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:19.656977  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.657084  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:19.658252  9464 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:19.659955  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.649276  9436 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.671888  4984 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:19.668645  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.675513  4218 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.673056  4992 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:19.661787  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.685897  4986 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:19.669721  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.689059  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.690409  4409 raft_consensus.cc:1240] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:19.690644  9467 consensus_queue.cc:1059] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:19.691479  9467 raft_consensus.cc:3055] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:19.691804  9467 raft_consensus.cc:740] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.692613  9467 consensus_queue.cc:260] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.660948  9338 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:19.693704  9467 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.657047  9431 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:19.695572  9431 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:19.661185  9421 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.701009  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.702081  9464 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:19.703886  9421 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:19.705018  9387 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:19.705572  9271 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.706475  9439 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:19.706852  9439 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.707633  9439 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.708914  9439 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:19.712754  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.715867  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.716830  4407 raft_consensus.cc:2410] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:22:19.716688  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48792.7us
I20260709 12:22:19.717523  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:19.718115  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.708055  9271 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.719472  9404 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:19.732249  4401 raft_consensus.cc:1240] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: []
W20260709 12:22:19.732718  4220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.741798  9453 consensus_queue.cc:1059] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:19.754518  9464 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:19.755028  9464 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:19.755834  9338 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:19.756207  9464 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.744305  9436 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.719915  9276 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.748888  9154 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:19.761842  9154 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.766706  9154 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:19.758297  9464 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:19.767874  9431 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:19.770457  9431 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:19.746974  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.783934  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.787261  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:19.725929  9387 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:19.791697  4992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:19.792402  4992 raft_consensus.cc:606] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:19.799786  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.800675  4409 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:19.801134  4400 raft_consensus.cc:1240] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:19.801287  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.801940  9404 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:19.802630  9404 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.803081  4401 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:19.803256  4409 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:19.804337  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.804982  4253 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:19.805547  9404 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:19.806382  4992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b18524a049aa4e8687009c73a015e710"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:19.806746  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:19.807055  4992 raft_consensus.cc:606] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.807667  4992 raft_consensus.cc:614] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.808072  4408 raft_consensus.cc:2410] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:22:19.809633  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 92191.3us
I20260709 12:22:19.810777  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.812728  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.812860  4984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:19.813625  4984 raft_consensus.cc:606] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.813829  9276 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:19.815101  4992 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:22:19.819598  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.820369  4253 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:19.822365  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.815060  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.823530  4984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:19.824054  9276 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.824815  9276 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.825376  9276 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.828179  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.816083  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:19.829720  4400 raft_consensus.cc:2393] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:19.793404  9453 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:19.824180  4984 raft_consensus.cc:606] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.831389  4984 raft_consensus.cc:614] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:19.833163  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:19.834726  4253 raft_consensus.cc:1275] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:19.835513  9436 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:19.823052  4992 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.835901  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:19.837173  9436 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:19.840312  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.841046  9453 raft_consensus.cc:993] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
W20260709 12:22:19.841284  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 94445.9us
I20260709 12:22:19.841678  9387 raft_consensus.cc:1081] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:19.844017  4325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:22:19.844569  4325 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.844936  4325 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.847507  9436 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:19.849188  9436 consensus_queue.cc:1048] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:19.851260  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:19.852813  4253 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:22:19.853245  4253 pending_rounds.cc:85] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Aborting all ops after (but not including) 6
I20260709 12:22:19.853570  4253 pending_rounds.cc:107] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:22:19.853896  4253 raft_consensus.cc:2889] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.854346  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:22:19.855141  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 170998us
I20260709 12:22:19.852870  4325 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.857966  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.860972  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:19.858326  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.862318  4247 raft_consensus.cc:1240] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:19.864739  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.865020  4992 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:19.869575  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.870299  4256 raft_consensus.cc:3060] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:19.872162  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.872519  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:19.872990  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.874264  4253 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.875228  4325 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:19.877132  4218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.878068  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.880801  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.883421  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:19.883642  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:19.884420  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:19.885663  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.892448  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:19.889192  4371 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.887109  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:22:19.897358  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46176.9us
I20260709 12:22:19.897759  4408 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:19.873085  9436 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:19.892531  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:19.899900  4409 raft_consensus.cc:2410] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:22:19.902570  4296 leader_election.cc:400] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13.
I20260709 12:22:19.901437  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:19.904757  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.876399  9464 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:19.884359  9444 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:19.900601  9404 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:19.908439  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:22:19.911584  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52283.8us
I20260709 12:22:19.915822  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:19.922461  4992 raft_consensus.cc:2468] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:19.922516  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:19.903337  9436 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.907903  9449 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:19.923405  8976 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:22:19.926488  8976 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:19.926900  8976 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:19.925477  9449 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:19.908558  9177 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:19.932096  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.916060  9464 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.934124  8976 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:19.935954  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:19.937733  4256 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:19.938473  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:19.941643  4218 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.920459  9440 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:19.947916  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.936405  9457 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:19.948683  9134 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:19.949568  9431 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:19.929145  9436 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:19.952267  9453 raft_consensus.cc:993] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:19.952816  9453 raft_consensus.cc:1081] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:19.954959  9464 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:19.959627  4990 raft_consensus.cc:2468] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:19.962433  4986 raft_consensus.cc:2468] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:19.930418  9449 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:19.936635  8976 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:19.974184  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.941071  9404 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:19.981055  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.980798  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:19.982182  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.984136  4326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
W20260709 12:22:19.984716  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48844.4us
I20260709 12:22:19.985026  4326 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.985220  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.985752  4326 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:19.994396  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.972684  9457 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:19.981472  9439 raft_consensus.cc:2764] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:19.967592  9276 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.006345  4371 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:19.986822  9440 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:22:20.007908  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 60112.6us
I20260709 12:22:19.991523  9321 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:20.010622  4371 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:20.007184  9460 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:20.048192  9460 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:20.050665  9460 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:20.011602  9377 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:20.051641  9377 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:20.052682  9377 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:20.054594  9457 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.053367  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:20.013633  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.056671  4371 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:20.057291  9376 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:20.012842  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:19.981980  9470 consensus_queue.cc:1048] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:19.990784  9473 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:22:20.058126  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45399.4us
I20260709 12:22:20.018509  8824 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:20.059072  9338 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:20.059549  9338 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.021314  4330 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:19.983783  9444 consensus_queue.cc:1059] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:22:19.986209  9358 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:20.055281  4990 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:22:20.009796  9481 log.cc:927] Time spent T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:22:20.068327  4331 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:20.033612  9467 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:20.081768  9467 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.083166  4984 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:20.084710  9467 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:20.068202  9431 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:22:20.094377  9431 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:20.068115  9271 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:22:20.097431  9404 raft_consensus.cc:3055] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:20.097568  9444 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.097998  9404 raft_consensus.cc:740] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:20.098363  9444 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.099056  9404 consensus_queue.cc:260] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:20.063380  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 54011.2us
I20260709 12:22:20.064291  4371 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:22:20.103418  4219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.990672  4218 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:20.104898  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 114765us
I20260709 12:22:20.059505  8824 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.107200  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:20.061623  9338 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:20.110176  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:20.062971  9469 raft_consensus.cc:2804] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:20.051221  9460 raft_consensus.cc:2804] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:20.076771  9276 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.076776  4332 raft_consensus.cc:1240] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:20.066114  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:20.069690  4326 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.111928  9376 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:22:20.120376  8824 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:20.105947  9009 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:22:20.121177  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:20.121258  9205 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:20.122112  9009 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:20.122496  9009 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:20.122782  9134 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:20.122967  9205 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:20.123811  9205 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:20.124228  9205 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.125511  9404 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:20.125649  9444 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.108254  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:20.122941  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:20.106159  9358 raft_consensus.cc:2804] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:20.147204  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:20.148607  4326 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.091068  9449 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.154871  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:20.155586  4257 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:20.141144  9469 raft_consensus.cc:697] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:20.131587  9460 raft_consensus.cc:697] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:20.146023  9453 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:20.166102  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:20.112293  9154 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:22:20.149500  9376 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:22:20.180601  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 57713.9us
I20260709 12:22:20.181759  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:20.208806  9009 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.217761  4256 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:20.152279  9358 raft_consensus.cc:697] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:20.228471  9358 consensus_queue.cc:237] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.210942  9009 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.140856  9436 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.255287  8976 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.256198  8976 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.259228  8976 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.198942  9154 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:20.164326  9470 consensus_queue.cc:1059] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:22:20.178870  9465 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:22:20.259704  9480 log.cc:927] Time spent T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:20.288470  4333 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
W20260709 12:22:20.299980  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 118356us
I20260709 12:22:20.312103  8976 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.308844  8824 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:22:20.312853  8976 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.313364  9460 consensus_queue.cc:237] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.314486  9469 consensus_queue.cc:237] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.307484  9421 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:20.268208  9154 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:20.288897  9465 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:20.324965  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 262811us
I20260709 12:22:20.329911  4256 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:20.336345  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:20.354184  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 244062us
I20260709 12:22:20.317420  9421 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.360411  4218 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:20.362797  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:20.363556  4247 raft_consensus.cc:2376] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11. Re-sending same reply.
I20260709 12:22:20.363982  4984 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:20.369094  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.335340  8976 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.335186  9465 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:20.375900  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:20.309717  9467 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:22:20.365996  9440 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:20.377609  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.363689  9470 raft_consensus.cc:3055] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:20.362021  9376 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:20.366714  9421 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:20.388931  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 215639us
I20260709 12:22:20.336181  9276 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:22:20.389160  4400 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:20.395473  4990 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:20.381130  9134 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:20.360989  8824 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 12:22:20.441277  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.449169  4333 raft_consensus.cc:1240] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:20.452162  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:20.452430  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:20.482527  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:20.358793  9205 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.386946  9470 raft_consensus.cc:740] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:20.491546  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:20.491546  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.523047  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:20.524542  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.524609  4406 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:22:20.481973  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:22:20.568229  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 44501.6us
I20260709 12:22:20.569303  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.569929  4989 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:20.568079  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1abb211136c54a29beecc019715aaa2d" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:20.576159  4402 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:20.570251  4989 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:20.487521  9449 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.583544  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:20.587729  4989 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.615537  4989 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:20.632608  9485 log.cc:927] Time spent T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:22:20.636408  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 53128.3us
I20260709 12:22:20.623066  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:20.620908  9436 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.493382  9154 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.638171  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.616540  9453 consensus_queue.cc:1059] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:22:20.671187  4985 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:20.678020  9154 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:20.680460  9491 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:22:20.667049  9470 consensus_queue.cc:260] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:20.682669  9404 consensus_meta.cc:287] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.005s
I20260709 12:22:20.682983  9470 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:20.676662  4985 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:20.666885  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 183920us
W20260709 12:22:20.692430  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.621181  9500 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:22:20.745157  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 45955.9us
I20260709 12:22:20.751696  4987 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:20.684612  9453 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:20.685369  9403 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.731432  4985 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.770212  4985 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:20.772642  9501 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:22:20.733088  9449 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.733974  9404 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.778545  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:20.780643  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:20.781461  4988 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 11: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:20.782403  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:20.787818  9507 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:20.788561  9338 consensus_meta.cc:287] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.001s
I20260709 12:22:20.788372  9507 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.789006  9338 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.762555  9453 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:20.861975  9453 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.863430  9453 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:20.797334  4326 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:20.663954  9376 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.795754  9337 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:22:20.805673  4985 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
W20260709 12:22:20.830752  4373 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.791452  8976 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:20.877004  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.876721  8976 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:20.792315  9449 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.853319  4992 raft_consensus.cc:1240] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:20.879134  8976 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:20.855605  9507 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:20.794405  9404 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.858958  9338 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.774968  9403 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.907534  4332 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:20.908987  4333 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:20.913053  9337 consensus_queue.cc:1059] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:20.915684  4331 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:20.917742  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:20.952272  4327 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:20.954383  9403 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.955986  9449 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:20.922761  9404 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:20.945899  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.964177  9495 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:20.965021  9495 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:20.970198  9497 raft_consensus.cc:3055] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:20.970832  9497 raft_consensus.cc:740] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:22:20.971442  4986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.041s	sys 0.065s
W20260709 12:22:20.972105  4986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.041s	sys 0.066s
W20260709 12:22:20.974606  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 67686.1us
W20260709 12:22:20.975488  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.002835  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 479148us
W20260709 12:22:21.007965  4983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.010s	sys 0.044s
I20260709 12:22:20.974081  9439 consensus_queue.cc:1059] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:22:21.014567  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:21.009940  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 413159us
I20260709 12:22:21.017334  9338 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:21.052242  9338 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:21.052659  9338 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:21.053479  9338 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:21.047731  9009 consensus_meta.cc:287] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.786s	user 0.007s	sys 0.006s
I20260709 12:22:21.054638  9338 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.046674  9431 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:22:21.055927  9421 consensus_meta.cc:287] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
I20260709 12:22:21.056373  9421 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.056478  9487 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:21.057273  9276 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:21.064782  4991 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:21.070189  9500 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.070890  9504 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:21.075841  9497 consensus_queue.cc:260] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.077296  9495 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.077878  9421 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:21.078487  9465 consensus_meta.cc:287] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
I20260709 12:22:21.081178  8976 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.081435  4255 raft_consensus.cc:3060] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.087266  4989 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
W20260709 12:22:21.036877  8824 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.040s
I20260709 12:22:21.096949  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:21.120362  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 135014us
I20260709 12:22:21.138300  4408 raft_consensus.cc:1240] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:21.091089  9276 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:22:21.112677  9504 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:21.141330  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 44872.9us
I20260709 12:22:21.144629  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.142879  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:21.140256  8824 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.040s
I20260709 12:22:21.098577  9436 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:22:21.148558  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:21.149796  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 186647us
I20260709 12:22:21.155822  4331 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:21.147360  9497 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.143811  9487 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.145412  9431 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.112859  9500 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.148093  9469 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.195932  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.151631  9449 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:21.203857  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55392.9us
I20260709 12:22:21.204057  4990 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:21.152413  9509 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:21.161280  9460 raft_consensus.cc:493] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.214095  4247 raft_consensus.cc:1240] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:21.137789  9465 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:21.218390  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 73825us
I20260709 12:22:21.219255  4218 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:21.142158  8976 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.216329  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.219425  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.197477  9403 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:21.206363  9376 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.226293  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.214071  9134 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.232292  4400 raft_consensus.cc:2368] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12.
I20260709 12:22:21.227973  4249 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:21.231737  9276 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:21.234591  9276 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:21.241503  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:21.244046  9276 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.245743  9465 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:21.205147  9431 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.250027  9404 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:21.227326  9504 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.251571  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:21.251673  9467 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:21.223187  9460 raft_consensus.cc:515] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.252419  9467 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:21.252554  9519 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:21.253494  9467 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.254215  9464 consensus_queue.cc:1059] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:21.254748  9431 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.255262  9464 raft_consensus.cc:3055] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:21.235991  9134 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.255849  9464 raft_consensus.cc:740] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:21.256711  9464 consensus_queue.cc:260] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.257447  9134 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:21.257829  9464 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.210520  9449 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.285650  9449 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.276083  9530 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:21.287565  9530 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.251741  9504 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:21.289901  9530 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.290568  9530 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:21.290984  9530 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:22:21.288000  9508 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:22:21.292235  9521 log.cc:927] Time spent T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:22:21.240361  9376 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.207878  9469 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.295113  9376 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.297037  9469 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.298743  9500 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:21.300505  9500 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.300942  9500 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.306027  9530 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.199090  9487 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.308750  9500 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.255185  9467 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.309589  9487 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.311615  8976 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.235448  9440 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:21.326689  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 119171us
I20260709 12:22:21.320202  9440 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.332336  9440 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:21.337072  9470 consensus_meta.cc:287] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 12:22:21.340180  8824 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:21.340956  8824 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.342697  9453 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.343240  9453 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.345485  9440 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.346570  8824 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:21.361655  4252 raft_consensus.cc:3060] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:21.365947  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.372965  4249 raft_consensus.cc:2468] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
I20260709 12:22:21.374881  4955 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:21.375514  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.376130  4253 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.376192  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:21.376241  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.377080  4256 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:21.379009  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.380867  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.381721  4403 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:21.382280  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:21.385865  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.386693  4986 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
W20260709 12:22:21.391479  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 414290us
W20260709 12:22:21.393002  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 173666us
I20260709 12:22:21.393131  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.393887  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.394599  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.395192  4406 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:21.394130  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:21.399735  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:21.400520  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:21.402659  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.403076  4253 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
W20260709 12:22:21.404506  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 192378us
I20260709 12:22:21.378420  9440 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:21.409216  4372 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:21.351605  9509 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:21.389084  8824 raft_consensus.cc:2804] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:21.388067  9271 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:21.412137  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:21.413877  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.412657  4252 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:21.415922  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.416164  4403 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 10: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:21.418918  4989 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:21.406270  9527 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:21.420795  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.406038  9177 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:21.406286  8976 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:21.416325  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.424474  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.421070  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:21.428356  4986 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:21.422151  4371 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:21.430498  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.430745  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.431371  4327 raft_consensus.cc:1240] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:21.431663  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.431802  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:21.432256  4330 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:21.432427  9449 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:21.432890  9449 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.433326  9449 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:21.432056  4201 auto_rebalancer.cc:893] Removing replace marker failed: Replica b3efae3bdfff46bb9bbff1ed1ea70a90 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:21.431150  4325 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
W20260709 12:22:21.460278  4201 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 374e8fa3690a41af9874f32b270bf3e1 already in progress
W20260709 12:22:21.456214  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.441596  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:21.461521  4404 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.462208  4983 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:21.463181  4218 leader_election.cc:400] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12.
I20260709 12:22:21.463528  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.463757  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4dedbb3ee0412db92c974e0c25a776" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:21.463567  4218 leader_election.cc:403] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:21.451490  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.465314  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:21.467396  9541 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:21.468032  4248 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:21.468583  9533 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:21.470232  9495 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:21.471805  9470 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:21.471698  9509 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.472492  9470 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:21.473459  9470 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.474880  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.439172  9460 leader_election.cc:290] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.435653  9535 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:21.423247  8824 raft_consensus.cc:697] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:21.430848  9388 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:21.480927  9388 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.420167  9271 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.481447  9388 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.481388  8824 consensus_queue.cc:237] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.422086  9465 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:21.423022  9527 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.479745  9534 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:21.483335  9271 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.483625  9527 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:21.483951  9534 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.486371  9534 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:21.487150  9535 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:21.488183  9535 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.490321  9453 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:21.460727  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 374e8fa3690a41af9874f32b270bf3e1 already in progress
I20260709 12:22:21.499184  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.499961  4986 raft_consensus.cc:2393] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 15: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:21.500264  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.480149  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.502051  4985 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:21.503232  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.504364  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.505579  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.502022  4296 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.507053  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.507697  4327 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
W20260709 12:22:21.445864  9523 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:22:21.510973  4371 leader_election.cc:304] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:21.515507  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.425963  9177 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.424940  8976 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.521008  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.522013  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:21.522118  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:21.435205  9205 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:21.524384  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.525040  4333 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:21.414901  9440 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.519810  9436 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:21.529387  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.525192  9177 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:21.530023  8976 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:21.468070  9541 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:21.528316  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:21.527812  9376 raft_consensus.cc:2749] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:21.506358  9504 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.528093  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:21.490367  9337 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.540354  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.530627  4404 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:21.634665  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:21.511858  9534 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:21.877223  4403 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:21.879164  9541 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.532095  9321 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.164s
W20260709 12:22:21.891600  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 248295us
I20260709 12:22:21.917220  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:21.898242  4405 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 14: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:21.906509  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:21.882835  9134 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.661736  4988 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:21.881011  9449 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.884781  8976 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.885615  9440 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:21.957300  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 373766us
I20260709 12:22:21.958097  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:21.885928  4991 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:22:21.885805  9177 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.540472  9492 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12.
I20260709 12:22:21.886693  9276 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:21.887480  9540 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.226s	user 0.006s	sys 0.004s
I20260709 12:22:21.864289  9519 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:21.898481  9534 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:21.921196  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 393158us
I20260709 12:22:21.921480  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:21.922911  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.996944  4256 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:21.998190  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.953792  9507 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.923843  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.880815  9388 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.925388  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.890393  9527 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.926697  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.952759  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.953557  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.010690  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:21.893832  9504 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.952894  9541 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.964286  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.920456  9271 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:21.966805  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.981856  9464 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:21.971879  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.891723  9431 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:21.904567  9444 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.026332  9444 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.027387  9504 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.028611  9444 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.029276  9559 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:22.029527  9444 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.030272  9559 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.030217  9444 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:21.895697  9404 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.031623  9404 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.895562  9436 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:22.037859  9436 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.902210  9530 raft_consensus.cc:493] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.039713  9530 raft_consensus.cc:515] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.039628  9431 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.042312  9530 leader_election.cc:290] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:21.903203  9488 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.043465  9488 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.045995  9488 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:21.895450  4404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 2043) took 1408 ms. Trace:
I20260709 12:22:22.046639  4404 rpcz_store.cc:276] 0709 12:22:20.486620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.441295 (+954675us) service_pool.cc:224] Handling call
0709 12:22:21.895382 (+454087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.999661  4249 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:21.996450  4253 raft_consensus.cc:2410] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 13 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:22:22.052561  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:22.020423  9465 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.053465  9465 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.054009  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:21.998924  4256 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:22.006513  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:22.063771  4255 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.018105  9470 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.064895  9470 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.966598  9321 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:22.068212  9530 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.954327  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:22.069638  4248 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:22.070139  8976 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.072960  4408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35534 (request call id 1212) took 1688 ms. Trace:
I20260709 12:22:22.073472  4408 rpcz_store.cc:276] 0709 12:22:20.384277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.384475 (+   198us) service_pool.cc:224] Handling call
0709 12:22:20.384777 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.138762 (+753985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.072595 (+933833us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54002b66d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:22.072848 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732518656}
I20260709 12:22:21.894411  9337 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.076975  9337 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.015267  9525 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:21.967432  9440 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:22.078008  9440 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.077955  9525 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:21.969895  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:21.948987  9134 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.015552  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.015836  4247 raft_consensus.cc:1240] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:22:21.982339  9536 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:22.018471  4334 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 15: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:22.025025  9388 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.067727  9271 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.008682  9534 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:21.972769  9532 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:22.079532  4325 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:22.011533  4257 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:22.017585  4372 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:22.020205  9464 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.035043  9404 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.021107  9154 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:22.115695  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 107239us
I20260709 12:22:22.130873  4255 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:22.135540  4248 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 8.
I20260709 12:22:22.138514  4249 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:21.997280  9276 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.013418  9507 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.087687  8976 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.191231  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.151973  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.204391  4408 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:22.112758  9492 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.151467  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:22.147917  4990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52862 (request call id 1136) took 1623 ms (client timeout 1718 ms). Trace:
I20260709 12:22:22.207494  8976 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.208087  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.208356  9337 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.208933  9337 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.209820  8976 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.031077  9559 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.146597  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.152202  9404 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.212596  9404 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.213301  9525 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.213944  9556 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.214448  9556 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.139853  9431 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.145187  9470 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.020555  9541 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.219059  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.191354  4256 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:22.202344  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.220966  9558 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.231009  4256 raft_consensus.cc:1240] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:22:22.140748  9464 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:22.112232  9530 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.145890  9271 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.234961  4249 raft_consensus.cc:1240] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:22.206714  4990 rpcz_store.cc:269] 0709 12:22:20.524142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.524307 (+   165us) service_pool.cc:224] Handling call
0709 12:22:22.147667 (+1623360us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b540071f2d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:22.147807 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528237824}
I20260709 12:22:22.237180  4255 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
W20260709 12:22:22.232671  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 315554us
I20260709 12:22:22.143271  9533 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:22.241284  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 282133us
I20260709 12:22:22.246759  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.242054  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:22.145691  9134 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.255720  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.261233  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:22.262033  4329 raft_consensus.cc:3060] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:22.269577  4328 raft_consensus.cc:3055] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:22.270143  4328 raft_consensus.cc:740] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:22.275832  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.276753  4325 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:22.277899  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.151983  9154 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.110277  9536 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.271166  4328 consensus_queue.cc:260] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.288383  4328 raft_consensus.cc:3060] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:22.293047  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
W20260709 12:22:22.296389  4956 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.297762  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.298014  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.298636  4983 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:22.259887  9388 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:22.299167  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.302832  4986 raft_consensus.cc:2393] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 14: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:22.303156  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.305600  4325 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:22.227403  9492 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.297765  9559 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.309808  9500 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.310513  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.240190  9558 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.311573  9453 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.311407  9567 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:22.343570  9552 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:22:22.312224  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.344151  4403 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:22.345129  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.346372  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.311772  9205 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:22.315408  9526 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.301093  9134 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:22.352710  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.316838  9444 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.317677  9530 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.320104  9440 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.325392  9177 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.327028  9507 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.269850  9465 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:22.329921  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.568435  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:22.568794  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.330446  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:22.331131  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 230227us
I20260709 12:22:22.334924  4404 raft_consensus.cc:2468] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:22.335839  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:22.338515  4988 raft_consensus.cc:2410] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:22.343179  9453 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.313850  9154 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.353370  4329 raft_consensus.cc:2468] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:22.364476  9559 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.302368  9388 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:22.366978  4296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.597630  4957 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.597748  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.375775  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:22.598625  4249 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:22.598819  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.422320  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:22.533198  9533 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.348539  9500 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.590214  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.591210  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:22.592984  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.593303  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.599923  4333 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.628446  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:22.565742  9276 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.364423  4328 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:22:22.634991  4328 pending_rounds.cc:85] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 12
I20260709 12:22:22.625118  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.571110  9541 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.629143  4408 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:22.571556  9431 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.363741  9205 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.633172  4325 raft_consensus.cc:2410] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:22:22.589236  9532 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.635339  4328 pending_rounds.cc:107] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:22:22.373664  9526 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.638746  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.599429  9388 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:22.644289  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.644963  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.652701  4328 raft_consensus.cc:2889] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:22.638687  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.601145  9440 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:22.643533  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 344924us
I20260709 12:22:22.668416  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:22.669085  4404 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:22.674013  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.681568  4249 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:22.641345  9420 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.689266  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.694226  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.649483  9276 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:22.648283  9541 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.700736  4333 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
I20260709 12:22:22.602802  9559 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.699129  9420 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.699265  9154 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.697997  4249 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:22.703797  9154 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.704725  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.705891  9154 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.705892  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.706482  9154 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:22.706862  4249 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:22.699160  9566 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.707711  4254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 1105) took 2125 ms. Trace:
I20260709 12:22:21.878305  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:22.707962  9566 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.708081  4254 rpcz_store.cc:276] 0709 12:22:20.581998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.584968 (+  2970us) service_pool.cc:224] Handling call
0709 12:22:21.042885 (+457917us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800003698. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadc59b71 00007fdbadc59eee 000000000036eb39 00007fdbb5ccd1e0 00007fdbb5d960c4 00007fdbb5d96131 00007fdbb5d57fc0 00007fdbb5d42929 00007fdbb5d423d2 00007fdbaf2b9bd4
0709 12:22:21.043111 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.043563 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.043602 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.049128 (+  5526us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.150702 (+1101574us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b18003bc380. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc73e07 00007fdbb6ace9a9 00007fdbadc9069b 00007fdbadc8e93f 00007fdbadc90c02 00007fdbb091820b 00007fdbb091dd23 00007fdbb091e0d1 00007fdbb0d39a0f
0709 12:22:22.572182 (+421480us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:22:22.595149 (+ 22967us) log.cc:844] Serialized 14 byte log entry
0709 12:22:22.595441 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.595505 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.707505 (+112000us) raft_consensus.cc:1685] finished
0709 12:22:22.707525 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.707654 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22816,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":7121,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":32488,"spinlock_wait_cycles":92527744,"thread_start_us":420073,"threads_started":1,"wal-append.queue_time_us":1652710}
I20260709 12:22:22.709895  9558 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.710078  9566 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.710711  9561 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.711238  9561 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.713052  9568 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.713655  4249 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:22:22.713646  9568 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.715018  9562 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.715620  9562 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.716809  9420 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.717397  9420 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:22.717716  9562 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.726567  9559 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.727609  9536 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.729086  9205 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.731580  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:22.732353  4990 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 15: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:22.732410  9500 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.735384  9541 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.737020  9526 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.737510  9541 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.700843  9276 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.737959  9154 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:22.738448  9276 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:22.738476  9154 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:22.727730  9573 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:22:22.739794  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.740378  4250 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:22.730619  9464 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.736931  9388 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.630843  9533 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:22.770216  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 101895us
I20260709 12:22:22.652899  9431 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.772969  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.737879  9507 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:22.783210  4988 raft_consensus.cc:2393] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 11: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:22.692139  9440 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.664098  9532 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:22.792914  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 122790us
I20260709 12:22:22.793485  4956 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:22.781535  9507 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.798700  9507 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:22.798887  9431 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.800029  9532 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.796895  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.797428  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.798171  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.801678  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.802441  4327 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:22.804916  4408 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
I20260709 12:22:22.804936  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.747753  9154 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.810887  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.809403  4218 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:22.814679  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:22.810701  9519 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:22.816540  9154 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:22.805202  9536 raft_consensus.cc:2804] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:22.817453  9559 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:22.818008  9559 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.818446  9559 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:22.817279  9558 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:22.830112  4987 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:22.847497  9558 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:22.848538  9558 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:22.860410  4250 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:22:22.862064  9534 consensus_meta.cc:287] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.006s
I20260709 12:22:22.862690  9453 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.862530  9534 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.863260  9586 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:22:22.863854  4332 raft_consensus.cc:2410] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:22:22.865406  9534 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.870607  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:22.873987  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 69114.5us
I20260709 12:22:22.874238  9536 raft_consensus.cc:697] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:22.876101  9337 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.876008  9507 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.876878  9527 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:22.882758  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 61307.8us
I20260709 12:22:22.884374  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.886174  4955 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:22.871747  9568 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.862107  9440 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.889008  9507 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.892670  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.893424  4405 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 15: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:22.898447  9536 consensus_queue.cc:237] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.900130  9561 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.902158  4988 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
W20260709 12:22:22.903759  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 306082us
I20260709 12:22:22.902036  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.906253  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.906594  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.906502  4219 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:22.907333  4956 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:22.908561  4955 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:22.911393  4257 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:22.913844  4296 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.912918  4219 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:22.919047  4987 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:22.919404  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.920271  4219 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:22.921324  4991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52862 (request call id 1140) took 1503 ms. Trace:
I20260709 12:22:22.923125  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8081e75d074f30b97f8a1542e86cec" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:22.927417  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.927394  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.926774  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:22.921689  4991 rpcz_store.cc:276] 0709 12:22:21.410776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.410933 (+   157us) service_pool.cc:224] Handling call
0709 12:22:21.421687 (+ 10754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.962428 (+540741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.914337 (+951909us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54004d6a54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:22.914496 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523077888}
I20260709 12:22:22.930734  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:22.928699  4984 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 9.
I20260709 12:22:22.932503  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:22.933459  9587 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:22.933964  9587 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.934242  9154 raft_consensus.cc:2804] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:22.934315  9587 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:22.934867  9154 raft_consensus.cc:697] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:22.935323  9504 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:22.935818  9154 consensus_queue.cc:237] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.904863  9565 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:22.939465  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 1505) took 1038 ms. Trace:
I20260709 12:22:22.916177  9588 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.940255  4326 rpcz_store.cc:276] 0709 12:22:21.901507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.914652 (+ 13145us) service_pool.cc:224] Handling call
0709 12:22:21.954029 (+ 39377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.241826 (+287797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.241855 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.241893 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:22.241923 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.939210 (+697287us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400307fd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:22.939261 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.939410 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661401472}
I20260709 12:22:22.940104  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:22.944185  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:22.958973  9558 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:22.911442  9563 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:22.911708  9388 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.959757  9558 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:22.913475  9440 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:22.960170  9558 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:22.922488  9134 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:22.960258  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.932879  9507 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.917725  9519 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.918360  9556 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.959997  9563 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.956740  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:22.939910  9487 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:22.965627  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:22.977056  4328 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:22.980894  4955 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.982353  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:22.968477  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.941440  9464 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:22.971576  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcac1f47834987ac3889edd37f61a3" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.991652  9467 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:22.991803  9009 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.992563  9009 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.935822  9504 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:22.997418  9504 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.997565  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:22.998652  4407 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 15: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:22.956169  9588 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.000967  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.001392  9588 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.976763  9507 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.004415  9507 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:22.972335  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:22.973333  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.005602  4987 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:22.984117  9431 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:22:22.983915  9519 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.011179  9519 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:22.984396  9568 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.012248  9568 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.013399  4988 raft_consensus.cc:1275] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:22.962457  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.014271  9568 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.017113  9586 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:22.974751  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:22.975510  9532 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:22.942349  9565 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:22.983196  4328 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:23.018285  4983 raft_consensus.cc:1275] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:23.026947  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.027817  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.028856  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:23.029435  4406 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:23.030372  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48148us
I20260709 12:22:23.031246  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.032155  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.033677  4255 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:23.034618  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.035094  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.035944  4255 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
W20260709 12:22:23.037096  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 59352us
I20260709 12:22:23.030391  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:23.038228  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:23.039325  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:22.963757  9558 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:23.040195  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:23.040665  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 120436us
I20260709 12:22:23.041213  4332 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:23.041414  4219 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.043342  4219 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.044715  4296 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:22.992250  9467 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:23.053639  4219 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.059207  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.047886  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.028017  9565 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.091166  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.091858  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.110702  4325 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:23.092694  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.111966  4328 raft_consensus.cc:2393] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 15: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:22:23.054477  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.090771  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.094605  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.115350  4372 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:23.098652  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 166208us
I20260709 12:22:23.031515  9009 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.118850  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.155001  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.155426  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.121027  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:23.129881  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.156283  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.034597  9532 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:22:23.134086  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 80598.5us
I20260709 12:22:23.135938  4326 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:23.156086  4327 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:23.157701  4326 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:23.156814  4400 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:23.053921  9431 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.041980  9525 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.040066  9533 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.084466  9556 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:23.165750  4219 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.165949  9556 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.166213  9009 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:23.166518  9556 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.166980  4219 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.168220  4219 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.168641  9556 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.169198  9556 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.169595  9134 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.044528  9588 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:23.170255  9134 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.170411  9588 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:23.114995  9457 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:23.171757  9588 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.177736  9492 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.179694  9449 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.180122  9563 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.150269  9596 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.162165  9469 consensus_queue.cc:1048] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:22:23.183792  9532 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.163415  9377 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:23.185714  9377 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.186085  9377 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.160521  9504 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:23.187358  9574 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:23.187847  9574 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.188299  9574 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.189447  9559 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.191569  4255 raft_consensus.cc:1240] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:23.152922  8824 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.195704  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.195624  8824 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.196499  9525 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:23.196893  9525 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:23.196935  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.197883  8824 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.198248  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.198724  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.199527  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.204957  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.205984  9404 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.146076  4296 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.087595  9495 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:23.087682  9467 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.109892  9555 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:22:23.153296  4372 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.042114  9541 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.199549  4408 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
I20260709 12:22:23.041514  9276 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.132401  9464 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:23.162281  4330 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:23.162575  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.046212  9519 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.160192  4326 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.035490  9587 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.163568  9507 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.207932  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:23.218030  4326 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.218775  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:23.217552  4331 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:23.208886  4218 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.151013  9473 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:23.209368  4406 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
W20260709 12:22:23.214728  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62178.4us
I20260709 12:22:23.164218  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.221238  4372 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.227895  4325 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:23.231796  4372 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:23.246738  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 143184us
I20260709 12:22:23.234745  4255 raft_consensus.cc:1275] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:22:23.212114  9431 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.253300  9582 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:23.244329  9567 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:23.253547  9558 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.231709  9337 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:23.248433  9470 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.255890  9565 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.250366  9568 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.248643  9500 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:23.231098  9597 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.249845  9559 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.262952  9574 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.271054  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.272117  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.273854  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.274068  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.274159  4326 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:23.275883  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.277941  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.314543  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.315266  4252 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:23.316125  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.269579  4296 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.277786  4372 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.197921  9525 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.225445  9527 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.282274  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.283432  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.288375  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.299639  4255 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:23.320955  4254 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:23.320863  4248 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 8.
I20260709 12:22:23.214174  9495 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:23.324227  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 156077us
I20260709 12:22:23.320863  4249 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:23.289151  9500 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:23.317606  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48096.6us
I20260709 12:22:23.281733  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.327090  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.283903  4218 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:23.334412  4256 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:23.336761  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.339409  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.340245  4325 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 15.
I20260709 12:22:23.342417  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.294827  9587 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.294382  9337 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:23.350562  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.345685  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:23.351982  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 68176.1us
W20260709 12:22:23.353645  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 102788us
I20260709 12:22:23.354316  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.356662  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.353760  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.357458  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.355981  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.359473  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.360273  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.359553  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.323482  9431 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:23.327937  9470 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:23.364946  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:23.358059  4334 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:23.365495  4249 raft_consensus.cc:606] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.365885  4249 raft_consensus.cc:614] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:23.365957  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.366804  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:23.367758  9205 consensus_queue.cc:1048] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:23.344774  9500 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.368259  9337 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.370204  9574 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.371233  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.362324  4219 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.371722  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.363747  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.293239  9568 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.375563  4986 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:23.378041  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.378576  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:23.360955  9559 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:23.398810  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.399508  9559 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.400058  9559 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.401886  9582 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:23.402318  9582 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.402681  9582 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.402601  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:23.403769  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.404060  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.404568  4256 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:23.405417  4986 raft_consensus.cc:2368] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:23.406018  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.406047  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.408268  4256 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:23.410020  9473 consensus_queue.cc:1059] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:23.415203  9509 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:23.412309  4985 raft_consensus.cc:1240] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:23.420255  9469 raft_consensus.cc:3055] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:23.420684  9469 raft_consensus.cc:740] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:23.364722  9470 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.373355  9404 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:23.442425  9453 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.442210  9404 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.444511  9404 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:23.425256  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 61622.6us
I20260709 12:22:23.346571  9585 consensus_queue.cc:1059] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:22:23.445931  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.446197  9585 raft_consensus.cc:3055] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:23.445960  9559 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.446650  9585 raft_consensus.cc:740] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:23.446780  9453 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:23.447378  9453 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.447849  9453 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.447504  9585 consensus_queue.cc:260] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.448241  9559 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.448390  9558 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.448794  9585 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.450098  9538 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:22:23.364455  9431 raft_consensus.cc:493] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:23.451540  9431 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:23.455675  9555 consensus_queue.cc:1175] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "899897e6794541b5ab538af361fc9e6c" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 9 } }
I20260709 12:22:23.459045  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.459384  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c970994e11f4080b5624db5219101b4"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:23.457604  9453 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.460216  4249 raft_consensus.cc:606] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.460702  4249 raft_consensus.cc:614] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:23.461930  9453 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.425346  4991 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 15: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:23.423588  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.377584  9563 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:23.424299  4296 leader_election.cc:400] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:23.466022  4296 leader_election.cc:403] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:22:23.466641  9532 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:23.423105  9497 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:22:23.363992  9541 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:23.462726  9575 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:23.468811  9575 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.469264  9575 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:23.464150  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:23.471709  4249 raft_consensus.cc:606] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.472143  4249 raft_consensus.cc:614] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:23.474594  9532 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
W20260709 12:22:23.475485  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51363.9us
I20260709 12:22:23.476102  9558 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:23.477023  9558 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.477388  9558 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:23.476485  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 53569.6us
I20260709 12:22:23.480666  9509 consensus_queue.cc:1059] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:23.481745  9509 raft_consensus.cc:3055] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:23.481853  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:23.482707  4249 raft_consensus.cc:606] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.483130  4249 raft_consensus.cc:614] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:23.482131  9509 raft_consensus.cc:740] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:23.483980  9565 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.484766  9509 consensus_queue.cc:260] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.486500  9509 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:23.486869  9495 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.464745  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.488407  4249 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.490221  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.490530  4254 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:23.490974  4325 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:23.492528  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.495389  4296 leader_election.cc:304] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.497040  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:23.501150  4325 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:23.505736  4219 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:23.506110  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 188068us
W20260709 12:22:23.510682  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 46021.4us
I20260709 12:22:23.488612  9470 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.503849  9597 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:23.565179  9598 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:22:23.523213  9596 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:23.610599  9596 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:23.611876  9596 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.526422  9276 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.528107  9556 raft_consensus.cc:2749] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:23.618583  4252 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
W20260709 12:22:23.621022  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.625653  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.626528  9556 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:23.633942  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.634627  9507 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.635596  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:23.635380  9507 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.636317  4983 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:23.638373  9507 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.640007  4983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:23.580933  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.581305  9469 consensus_queue.cc:260] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.522253  9530 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:22:23.582880  9467 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.583518  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:23.523406  9534 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:23.585018  9568 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.585225  9575 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.586166  9377 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.589654  4249 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:23.589741  9582 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.505357  9562 raft_consensus.cc:2749] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.505973  9532 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.373286  9535 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.115s
W20260709 12:22:23.599633  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 200850us
W20260709 12:22:23.600610  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 78463.1us
I20260709 12:22:23.602550  4325 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:22:23.606582  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 109642us
I20260709 12:22:23.666106  4372 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.603611  9565 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.604822  9497 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:22:23.651816  4254 raft_consensus.cc:606] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:23.651362  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 128246us
I20260709 12:22:23.680950  9467 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.682340  9582 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.661077  9608 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.683076  9377 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.683246  9608 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.666288  9469 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:23.685631  9608 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.687323  9575 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.681028  9611 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:23.689661  9470 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.653703  9586 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.692106  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.692878  4254 raft_consensus.cc:614] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:23.692478  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.667060  4984 raft_consensus.cc:1240] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:23.710569  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:23.671157  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.714082  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:23.714910  9609 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:22:23.715397  9618 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:23.715838  9618 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.716151  9618 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.717747  9558 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.711687  9556 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:22:23.719980  9558 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.721230  9470 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:23.607347  9431 raft_consensus.cc:515] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:23.671703  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.730047  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.734566  9586 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:23.734715  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:22:23.736063  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 44039.3us
I20260709 12:22:23.737217  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.738147  4325 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:23.739616  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.740794  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.741575  4248 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:23.744061  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.744783  4255 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.750010  4257 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:23.752978  4248 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:23.756485  4988 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:23.758662  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.759547  4329 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 14.
I20260709 12:22:23.661962  9500 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.761989  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.761957  9555 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:23.736197  9534 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:23.768471  9534 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.768882  9534 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.769300  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:23.774950  4985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:23.775652  4985 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:23.754813  9586 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:23.748790  9563 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.779635  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:23.779800  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:23.782392  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:23.782322  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.782696  4988 raft_consensus.cc:2393] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:23.748615  9575 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:23.790776  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.782982  4257 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.791949  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.792708  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.793251  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:23.794215  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:23.795361  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.802865  4405 raft_consensus.cc:2368] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:23.826020  4255 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:23.829136  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.829777  4327 raft_consensus.cc:3060] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.830562  4985 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 17.
I20260709 12:22:23.832710  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.834151  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.775576  9559 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:23.776176  9597 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:23.834939  4409 raft_consensus.cc:2393] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 15: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:23.835311  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:23.838745  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:23.840478  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.842399  4991 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:23.848029  9500 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.849886  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.850531  4334 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 9.
I20260709 12:22:23.789983  9586 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.851462  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.855005  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.855650  4255 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:23.856529  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:23.856746  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:23.856887  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:23.860344  4408 raft_consensus.cc:2393] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:23.864230  4409 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:22:23.868397  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:23.834148  9558 raft_consensus.cc:2764] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:22:23.871556  4255 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:23.900643  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.902555  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.899262  4405 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:23.862267  9586 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.906526  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:23.861846  9338 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.862126  9487 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.910521  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.916110  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.922966  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:23.920321  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.920583  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:23.929631  4218 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:23.894932  9587 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:23.954468  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.960825  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:23.961184  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.961604  4253 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:23.918973  9585 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:23.924510  9559 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:23.962677  9470 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:23.952618  9556 raft_consensus.cc:3060] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:23.938210  9431 leader_election.cc:290] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:23.949791  4257 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
W20260709 12:22:23.988766  9614 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:22:23.924814  9535 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.990157  9535 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.992744  9535 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.943627  9472 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:23.938515  9338 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:23.993408  9472 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:23.993855  9472 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:23.994941  9338 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:23.959443  9449 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:23.952174  9563 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:22:23.909116  9500 consensus_queue.cc:1048] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:22:23.972895  4371 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:23.983672  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.986680  9615 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 12:22:23.987572  9619 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:22:24.000087  4250 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:22:24.002243  9605 log.cc:927] Time spent T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.522s	user 0.001s	sys 0.003s
I20260709 12:22:24.005137  4153 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 13 to 14, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:23.993091  4253 raft_consensus.cc:2468] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:24.008016  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:23.952626  9587 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.007841  4153 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 15 to 16, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:24.017892  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 185737us
I20260709 12:22:24.018636  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:24.019831  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:24.007872  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:24.022086  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:24.022831  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.025408  4333 raft_consensus.cc:2393] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 13: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:24.027470  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:23.938454  9487 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.030468  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:24.046427  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:24.047755  4296 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.048401  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:24.021356  9587 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:24.072571  9338 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:23.970896  9465 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:22:24.026114  9205 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:22:24.082216  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.048996  9472 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.083127  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.085302  4333 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:23.977847  9585 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.073904  9563 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:24.083243  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 110466us
I20260709 12:22:24.089982  4371 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:24.043222  9464 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:24.073453  9575 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:24.094246  4334 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:24.032857  9555 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:22:24.081105  9574 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:24.073128  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.100152  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.102944  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.103578  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:24.104871  4249 raft_consensus.cc:2368] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15.
I20260709 12:22:24.106720  4296 leader_election.cc:400] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11.
I20260709 12:22:24.108006  4333 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
I20260709 12:22:24.109098  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.092020  9464 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.118614  4296 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:24.120821  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 72590.4us
I20260709 12:22:24.124399  9541 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:24.124693  4956 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:24.095753  9611 raft_consensus.cc:2804] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:24.133000  4296 leader_election.cc:400] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15.
I20260709 12:22:24.136966  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:24.146502  4296 leader_election.cc:403] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:22:24.142701  4327 raft_consensus.cc:2468] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:24.099802  9535 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:24.093114  9563 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:24.164623  9563 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:24.165640  9623 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:22:24.111207  9338 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:24.157900  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:24.137115  9337 raft_consensus.cc:2804] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:24.131975  9628 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:24.159837  9620 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 12:22:24.161512  9624 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:22:24.162339  9585 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.110229  9449 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:24.127208  9470 raft_consensus.cc:493] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:24.128010  9464 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:24.199803  9604 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.712s	user 0.005s	sys 0.000s
I20260709 12:22:24.115676  9575 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:24.204487  9575 raft_consensus.cc:493] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.205093  9575 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.208992  4332 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:24.169214  9611 raft_consensus.cc:697] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:24.179255  9276 raft_consensus.cc:3060] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.182749  9337 raft_consensus.cc:697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:24.213563  9563 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:24.232069  9563 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.234418  9563 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.235759  9637 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:24.236403  9637 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:24.239840  9629 log.cc:927] Time spent T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:22:24.243314  4402 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:24.214668  9492 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:24.235116  4247 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:22:24.260056  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 130257us
I20260709 12:22:24.262225  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.264782  4332 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:24.266242  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 129380us
I20260709 12:22:24.172235  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:24.175283  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 144897us
I20260709 12:22:24.127674  9457 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:24.178704  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:24.268752  4408 raft_consensus.cc:3060] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:24.184221  4400 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:22:24.222044  9205 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:24.186347  9449 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.187565  9470 raft_consensus.cc:515] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.277825  4257 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:24.159866  9472 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.181941  9534 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.281651  9487 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.282550  9534 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.270447  9536 raft_consensus.cc:2804] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:24.283799  9536 raft_consensus.cc:697] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:24.284816  9536 consensus_queue.cc:237] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.287569  9640 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:24.275523  9457 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.290863  9457 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.290622  9337 consensus_queue.cc:237] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:24.275669  9530 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:22:24.272467  9609 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:24.274153  4372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.280282  9470 leader_election.cc:290] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.216470  9596 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:24.264974  9618 consensus_meta.cc:287] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.006s
I20260709 12:22:24.323583  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:24.304826  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:24.239176  9637 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.295660  4326 raft_consensus.cc:1240] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:24.264587  9453 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:24.321113  4408 raft_consensus.cc:2468] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:24.325548  4955 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:24.326309  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 58519.7us
I20260709 12:22:24.333871  9640 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:24.334318  9640 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:24.334838  9640 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:24.331501  9611 consensus_queue.cc:237] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:24.338914  9638 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:22:24.339498  9587 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.339635  9453 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.339100  9556 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:24.271190  9492 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.352488  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:24.320281  9609 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:24.331504  9618 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:24.359136  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:24.265491  9586 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.379235  4330 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 16: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
W20260709 12:22:24.406854  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 57631.3us
I20260709 12:22:24.407016  4247 raft_consensus.cc:1275] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:22:24.421857  9642 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:24.426859  4332 raft_consensus.cc:2468] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 10.
I20260709 12:22:24.428575  4987 raft_consensus.cc:1240] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:22:24.407090  9641 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.073s	user 0.001s	sys 0.002s
I20260709 12:22:24.430739  4372 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:24.328706  9596 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:24.422364  9636 log.cc:927] Time spent T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
W20260709 12:22:24.442076  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 109295us
I20260709 12:22:24.438145  9472 raft_consensus.cc:2804] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:24.457058  4329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55272 (request call id 3084) took 1100 ms. Trace:
I20260709 12:22:24.457589  4329 rpcz_store.cc:276] 0709 12:22:23.353279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.354097 (+   818us) service_pool.cc:224] Handling call
0709 12:22:24.453595 (+1099498us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540013db54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:24.453696 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925946112}
I20260709 12:22:24.461174  4219 leader_election.cc:304] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.462903  9449 raft_consensus.cc:2764] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:22:24.464109  9453 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:24.464128  4254 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:24.475876  9472 raft_consensus.cc:697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:24.477310  9472 consensus_queue.cc:237] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:24.495642  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 52631.1us
I20260709 12:22:24.499642  4986 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:24.499576  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.425612  9205 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:24.510140  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 86748.4us
I20260709 12:22:24.530308  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.531033  4990 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:24.543756  4328 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:24.547045  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:24.563884  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:24.556967  9558 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:22:24.565788  9635 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 12:22:24.559815  9618 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:24.582484  4330 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:22:24.593313  9645 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:22:24.594187  9582 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:24.595494  9600 log.cc:927] Time spent T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 1.144s	user 0.001s	sys 0.005s
I20260709 12:22:24.600466  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:24.597203  9647 log.cc:927] Time spent T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:22:24.596684  9660 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:22:24.610013  9596 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.586045  9587 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:24.611121  9276 raft_consensus.cc:2749] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061) with higher term. Message: Invalid argument: T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 14. Current term is 15.
I20260709 12:22:24.577450  9609 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:24.616291  9464 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.619387  9586 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:24.619148  9575 raft_consensus.cc:515] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.620357  9596 raft_consensus.cc:493] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:24.620877  9596 raft_consensus.cc:515] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:24.621564  9575 leader_election.cc:290] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:24.625269  9596 leader_election.cc:290] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:24.627673  9492 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.568186  9640 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.630160  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:24.631441  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.632414  4990 raft_consensus.cc:2368] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:24.634708  9464 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:24.635673  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.634899  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:24.631510  9640 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:24.645788  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:24.646651  4257 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:24.648149  9650 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 12:22:24.650935  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:24.661895  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:24.651482  9533 consensus_queue.cc:1059] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:24.655115  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:24.634867  9525 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:24.671959  9533 raft_consensus.cc:493] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:24.672463  4325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55256 (request call id 2777) took 1003 ms. Trace:
I20260709 12:22:24.672577  9533 raft_consensus.cc:515] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.672941  4325 rpcz_store.cc:276] 0709 12:22:23.669404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.671357 (+  1953us) service_pool.cc:224] Handling call
0709 12:22:24.672300 (+1000943us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400203ad4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:24.672407 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30623488}
I20260709 12:22:24.676955  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.663170  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:24.704698  9420 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:24.724043  4257 raft_consensus.cc:2468] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:24.701773  9009 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:24.739109  4987 raft_consensus.cc:1240] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:24.735833  9642 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:24.739629  4992 raft_consensus.cc:1240] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
I20260709 12:22:24.741271  4990 raft_consensus.cc:1240] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:24.741638  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.742908  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.745841  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.748170  4990 raft_consensus.cc:1240] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:22:24.749945  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:24.751709  4991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:24.753137  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:24.761703  4407 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:24.763911  9009 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:24.764168  9660 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:24.740494  9642 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.766820  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.770802  9586 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:24.770321  9533 leader_election.cc:290] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:24.773231  4409 raft_consensus.cc:1240] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:24.776463  9009 consensus_queue.cc:1059] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:24.777626  9656 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:24.778095  9656 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:24.779125  9656 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.780800  9656 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:24.721549  9420 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.830678  4405 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:24.846151  4408 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:24.849820  8824 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:24.851029  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:24.854024  4407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60136 (request call id 2067) took 1061 ms. Trace:
I20260709 12:22:24.854396  4407 rpcz_store.cc:276] 0709 12:22:23.792794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.793017 (+   223us) service_pool.cc:224] Handling call
0709 12:22:24.853852 (+1060835us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400234bd4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d822fa 00007fdbb5d43b17 00007fdbaf2be6d4 00007fdbaf2be662 00007fdbaf2be591 00007fdbaf2be50c 00007fdbaf2bd7c2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:24.853945 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195598080}
W20260709 12:22:24.856415  9612 log.cc:927] Time spent T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 1.097s	user 0.002s	sys 0.000s
I20260709 12:22:24.850024  9420 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:24.866102  9646 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
W20260709 12:22:24.874691  9651 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.403s	user 0.001s	sys 0.001s
I20260709 12:22:24.878259  4249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 2252) took 1127 ms. Trace:
I20260709 12:22:24.878639  4249 rpcz_store.cc:276] 0709 12:22:23.750995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.126112 (+375117us) service_pool.cc:224] Handling call
0709 12:22:24.126501 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.126857 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.126896 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.149084 (+ 22188us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.277790 (+128706us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:24.277851 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.277944 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:24.865571 (+587627us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:24.867114 (+  1543us) raft_consensus.cc:1685] finished
0709 12:22:24.867136 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.878191 (+ 11055us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33487,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":4261632,"thread_start_us":123403,"threads_started":1,"wal-append.queue_time_us":193928}
I20260709 12:22:24.901455  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 1136) took 1123 ms. Trace:
I20260709 12:22:24.901932  4253 rpcz_store.cc:276] 0709 12:22:23.777909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.247286 (+469377us) service_pool.cc:224] Handling call
0709 12:22:24.247593 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.269661 (+ 22068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.269703 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.270268 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.320226 (+ 49958us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:24.320268 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.320333 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:24.874131 (+553798us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:24.901137 (+ 27006us) raft_consensus.cc:1685] finished
0709 12:22:24.901158 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.901387 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7841,"raft.queue_time_us":26122,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":16954,"spinlock_wait_cycles":46374656,"thread_start_us":38284,"threads_started":1,"wal-append.queue_time_us":149121}
I20260709 12:22:24.919552  9376 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:24.920035  9376 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:24.921000  9376 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:24.922036  9376 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:24.928249  4989 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:24.918952  4955 leader_election.cc:304] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:24.934918  4989 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:24.949847  9467 raft_consensus.cc:2804] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:22:24.951283  9507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.011s	sys 0.018s
I20260709 12:22:24.950011  9642 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:24.961932  9642 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:24.972553  9649 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.493s	user 0.001s	sys 0.001s
I20260709 12:22:24.974865  4247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 1142) took 1192 ms. Trace:
W20260709 12:22:24.964161  9507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.012s	sys 0.018s
I20260709 12:22:24.975288  4247 rpcz_store.cc:276] 0709 12:22:23.782881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.257980 (+475099us) service_pool.cc:224] Handling call
0709 12:22:24.258323 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.426196 (+167873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.974538 (+548342us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54002b52d4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:24.974800 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341157632}
I20260709 12:22:24.975494  9467 raft_consensus.cc:697] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:24.982436  9642 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:24.986114  4330 raft_consensus.cc:1275] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:22:24.987661  9467 consensus_queue.cc:237] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:24.991698  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.992153  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.993129  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac26358ed7f4644aa3f5b040afcdca4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.990497  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:24.994362  4218 leader_election.cc:400] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:24.994609  4218 leader_election.cc:403] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:24.995280  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.996238  9597 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:24.997718  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:24.998710  4330 raft_consensus.cc:1240] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:25.006089  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:25.006893  4255 raft_consensus.cc:2393] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 10: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:25.007190  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:24.996641  9597 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.011521  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.001653  9492 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:22:25.015116  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:24.996824  9559 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:22:25.003084  9404 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 12:22:25.022895  9652 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.557s	user 0.000s	sys 0.002s
I20260709 12:22:25.010648  9597 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:25.020618  4956 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.020859  4327 raft_consensus.cc:1275] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:25.002106  9205 consensus_queue.cc:1048] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:22:25.027340  9420 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.028028  4956 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.029515  9504 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:25.029663  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.030869  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c52d75f63d54dbeba6b3c868117e4c4" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:25.031102  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.031878  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.032722  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.033524  4402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.034507  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.017520  9507 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:25.035744  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.037631  4250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 2245) took 1631 ms. Trace:
I20260709 12:22:25.037859  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ae0ae4c14d4870b094e2733b40e647" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.038017  4250 rpcz_store.cc:276] 0709 12:22:23.406643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.408937 (+  2294us) service_pool.cc:224] Handling call
0709 12:22:23.999759 (+590822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.000508 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.037417 (+1036909us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54000852d0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7d8ad 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6 00007fdbaf0b826f
0709 12:22:25.037557 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358127360}
I20260709 12:22:25.039260  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:25.041841  4250 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:25.042750  4407 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:25.044694  4326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 1532) took 1147 ms. Trace:
I20260709 12:22:25.045089  4326 rpcz_store.cc:276] 0709 12:22:23.897331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.043000 (+145669us) service_pool.cc:224] Handling call
0709 12:22:24.043829 (+   829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.328054 (+284225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.044463 (+716409us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001d6ad4. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:25.044634 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578694400}
I20260709 12:22:25.046800  4334 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:22:25.050568  9492 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:24.029029  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.054765  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:25.056017  4372 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:25.055781  4153 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 12 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:25.067970  4330 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:25.069790  4153 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 4 to 6, term changed from 9 to 10, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to <none>, 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129), VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130), VOTER 899897e6794541b5ab538af361fc9e6c (127.3.7.131), VOTER 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:25.078374  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.079042  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68963fca87f1465babfafe629c276422" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.079892  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.081316  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.084481  9533 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:25.084934  9533 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.085358  9533 raft_consensus.cc:3060] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:25.086601  4255 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:22:25.084498  9568 consensus_queue.cc:1059] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:22:25.090171  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:25.090548  9568 consensus_queue.cc:1243] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer 899897e6794541b5ab538af361fc9e6c log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:22:25.091053  9565 raft_consensus.cc:3055] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:25.091490  9565 raft_consensus.cc:740] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:25.091715  9683 log.cc:927] Time spent T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:22:25.092378  9565 consensus_queue.cc:260] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.096256  4255 raft_consensus.cc:1275] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:25.017822  9642 consensus_queue.cc:1048] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:22:25.104454  4218 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.106940  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aa28105446e4c7c9261f9a99c5dc017" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.108009  4403 raft_consensus.cc:2368] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:25.108836  9565 raft_consensus.cc:3060] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:25.109165  9563 raft_consensus.cc:493] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.036368  4956 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.159704  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:22:25.160439  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 124224us
I20260709 12:22:25.163563  9609 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:25.163372  9563 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:25.167155  4327 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:25.168103  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.169762  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:25.164110  9609 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:25.156833  9596 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:25.170468  9559 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.159129  9453 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.225840  4956 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.169363  9377 consensus_queue.cc:1059] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:22:25.236467  4331 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:25.238641  9628 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.247710  9609 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.248440  9628 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.250633  9628 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.239621  9404 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.179556  9669 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.240468  9492 raft_consensus.cc:493] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.244055  9453 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:25.244274  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 61119.7us
I20260709 12:22:25.247876  9376 raft_consensus.cc:3055] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:25.183138  9559 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:25.233382  9527 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:22:25.251380  9404 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.273471  9376 raft_consensus.cc:740] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:25.269196  9525 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:22:25.265331  9492 raft_consensus.cc:515] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.279366  9009 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.294943  9527 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.295151  9446 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:25.335768  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.336740  4325 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:22:25.296511  9533 raft_consensus.cc:515] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:25.370959  9662 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.704s	user 0.003s	sys 0.000s
I20260709 12:22:25.372305  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 2257) took 1340 ms. Trace:
I20260709 12:22:25.372808  4256 rpcz_store.cc:276] 0709 12:22:24.031504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.423749 (+392245us) service_pool.cc:224] Handling call
0709 12:22:24.424090 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.425929 (+  1839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.425958 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.430396 (+  4438us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.576505 (+146109us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:24.576557 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.576654 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.370391 (+793737us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:25.371888 (+  1497us) raft_consensus.cc:1685] finished
0709 12:22:25.371918 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.372225 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23206784,"thread_start_us":124284,"threads_started":1,"wal-append.queue_time_us":218462}
I20260709 12:22:25.381222  4325 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:22:25.383450  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 109382us
I20260709 12:22:25.351778  9669 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.348639  9563 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.364750  9507 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:25.408656  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.409669  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.317674  9009 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.327739  9467 consensus_queue.cc:1048] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:22:25.329888  9527 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:25.390110  9588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.015s	sys 0.021s
I20260709 12:22:25.416898  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.347371  9660 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:22:25.346503  8824 consensus_queue.cc:1059] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:22:25.424276  4986 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:25.417629  4325 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 12:22:25.420346  9588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.015s	sys 0.021s
I20260709 12:22:25.332952  9376 consensus_queue.cc:260] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.389899  9642 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:22:25.428947  4990 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:25.415617  9404 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.418776  9563 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.500738  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:25.429646  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 259997us
W20260709 12:22:25.432184  4374 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.420549  9561 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 12:22:25.475260  9693 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:22:25.508733  4401 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:22:25.483610  9504 raft_consensus.cc:3055] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:25.427001  9669 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.499694  9404 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.502204  9376 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:25.501894  9563 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.488596  9009 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.493407  9559 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.530241  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.520486  9504 raft_consensus.cc:740] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:25.535508  9559 raft_consensus.cc:493] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.536621  9669 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.484962  9597 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.539436  9597 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.540218  9597 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.540714  9597 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:25.541848  4255 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:25.545279  9563 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.547376  9563 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.547866  9533 leader_election.cc:290] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:25.535166  9154 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.563233  9154 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.566000  9154 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.563252  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.567560  4328 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:25.569641  9527 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:25.572049  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.572724  4404 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 9.
I20260709 12:22:25.549829  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.536171  9559 raft_consensus.cc:515] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:25.554492  9656 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:25.559504  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:22:25.560467  9689 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.396s	user 0.003s	sys 0.000s
I20260709 12:22:25.575924  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.558981  9597 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.580439  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90175b58ea034e69b889717ca0ad0333" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.576948  4956 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:25.575698  4371 leader_election.cc:304] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.591939  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.591084  9377 raft_consensus.cc:2749] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:25.595666  9642 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:25.600250  9642 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.600613  9642 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:25.602393  4988 raft_consensus.cc:1275] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:25.603678  9611 consensus_queue.cc:1059] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:25.611899  4326 raft_consensus.cc:2468] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:25.583630  9699 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:25.621480  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 212027us
I20260709 12:22:25.625965  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:25.640300  4247 raft_consensus.cc:2393] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 16: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:25.527789  9404 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.645399  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:25.646142  4249 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:25.649799  4249 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:22:25.649716  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 63373.8us
I20260709 12:22:25.650979  4955 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.655251  4955 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.656494  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.671344  9565 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:25.671985  9525 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:25.672331  4371 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:25.674099  4218 leader_election.cc:304] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.674777  9559 leader_election.cc:290] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.675364  9559 raft_consensus.cc:2749] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:25.676097  4218 leader_election.cc:304] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:25.676285  9154 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:25.676388  9174 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:25.677138  9174 consensus_queue.cc:1048] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:25.677552  4218 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:25.642902  9504 consensus_queue.cc:260] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.679234  9559 raft_consensus.cc:2749] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:25.679569  4250 raft_consensus.cc:1275] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:25.679908  9559 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:25.681318  9559 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.674067  9525 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:25.682452  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:25.678786  4218 leader_election.cc:400] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:25.683270  4250 raft_consensus.cc:2393] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:25.562326  9563 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.679550  9504 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:25.620711  9597 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.702268  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.720224  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5f00fff96847178a1970711feff2f0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.720649  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.721154  4408 raft_consensus.cc:2410] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:22:25.721047  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:25.724104  4218 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.723248  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.724649  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.726094  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.724941  4408 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:25.730650  4403 raft_consensus.cc:2410] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:22:25.733935  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:25.736122  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.739476  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.748076  9702 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:25.776927  9563 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.778369  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.778926  9404 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.781141  9404 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.781841  9404 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.738471  9611 consensus_queue.cc:1048] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:25.783717  9507 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:25.784438  9507 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.788383  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:25.790283  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6675e0fefdad403abd03803e0c2bf3dd" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.741221  9559 raft_consensus.cc:2749] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:25.792183  9507 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:25.795123  9492 leader_election.cc:290] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.803555  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.798641  4257 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:22:25.804680  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:25.800551  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.801519  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:25.698040  9597 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.804195  4400 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:25.808329  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.810105  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:25.814349  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.817118  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:25.821331  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.821810  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77d531cd9f54dcbb332d1ff622d8443" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.822539  4218 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.824008  4987 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:25.803858  9696 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:25.824952  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 172295us
I20260709 12:22:25.824055  9154 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:25.850031  4372 leader_election.cc:304] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:25.862088  9377 raft_consensus.cc:2804] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:25.862746  9377 raft_consensus.cc:697] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:25.820382  9568 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:22:25.825374  9453 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:22:25.857457  9708 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:25.857764  9492 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.849320  9696 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.908726  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:25.898097  9492 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.917778  9492 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.921291  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.922400  4987 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 16: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:25.933012  9492 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.933691  9492 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.935708  9708 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:25.936287  9708 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:25.938958  9708 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.940624  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.941289  9404 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.941610  4987 raft_consensus.cc:2393] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 9: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:25.941715  9492 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:25.944511  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.945338  4986 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:25.946874  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:25.943966  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.954910  4218 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:25.955755  9492 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:26.004197  9705 raft_consensus.cc:2749] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:26.004558  9708 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:26.024029  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:25.904845  9377 consensus_queue.cc:237] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:26.043190  9696 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.024456  9597 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.051245  9453 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.052130  9453 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.019074  9530 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:26.060096  9530 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:26.064368  9700 log.cc:927] Time spent T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:22:26.084378  9446 raft_consensus.cc:3055] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:26.085047  9446 raft_consensus.cc:740] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:26.086206  9446 consensus_queue.cc:260] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.095186  9708 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:26.096350  4296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.010s	sys 0.010s
W20260709 12:22:26.213968  4296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.010s	sys 0.010s
I20260709 12:22:26.100293  8824 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.108711  9711 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.203s	user 0.004s	sys 0.000s
I20260709 12:22:26.016928  9492 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.055034  9453 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:26.125685  9642 consensus_meta.cc:287] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.003s
I20260709 12:22:26.127506  4218 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.130533  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:26.134449  4990 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:22:26.177001  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 266187us
I20260709 12:22:26.226243  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.229197  4153 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 14 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:26.203778  4329 raft_consensus.cc:3055] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:22:26.210444  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 304347us
I20260709 12:22:26.218264  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.217695  4371 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.224115  4255 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:22:26.234368  4329 raft_consensus.cc:740] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:26.236882  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.224076  4987 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 15.
I20260709 12:22:26.242607  4153 catalog_manager.cc:5697] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 13, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:26.245236  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.244815  4153 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 8 to 15, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 15 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:26.247849  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 120524us
I20260709 12:22:26.248389  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.248912  4218 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:26.249789  4219 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.242208  4296 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:26.235287  4329 consensus_queue.cc:260] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.254786  4329 raft_consensus.cc:3060] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:26.222625  9712 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 12:22:26.257525  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.259017  9705 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:26.264591  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.240310  9492 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:26.275578  4329 raft_consensus.cc:1275] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:22:26.290015  4329 pending_rounds.cc:85] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 12
I20260709 12:22:26.290339  4329 pending_rounds.cc:107] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:22:26.290596  4329 raft_consensus.cc:2889] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:26.260851  9702 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:26.265600  9611 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:26.313262  4149 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 263) took 19597 ms (client timeout 15000 ms). Trace:
I20260709 12:22:26.266079  9696 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:26.286975  9464 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:26.265689  9404 raft_consensus.cc:493] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:26.269440  9698 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:26.240722  8824 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.246764  9642 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.269768  9470 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:22:26.340759  4330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 1562) took 1006 ms. Trace:
I20260709 12:22:26.331065  9702 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:26.337450  9642 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:26.257963  9568 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:26.348546  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.350334  9470 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:26.359748  9470 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:26.361032  9470 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.351035  8824 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:26.362990  9470 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:26.376813  9568 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.341374  4330 rpcz_store.cc:276] 0709 12:22:25.334330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.335447 (+  1117us) service_pool.cc:224] Handling call
0709 12:22:25.335725 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.804390 (+468665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.804420 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.809032 (+  4612us) log.cc:844] Serialized 26 byte log entry
0709 12:22:26.012830 (+203798us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:26.018739 (+  5909us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.018955 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.019107 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.123838 (+104731us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b1800479ec0. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb6b59ab1 00007fdbb6b66281 00007fdbadc913f3 00007fdbadc937c1 00007fdbadc93779 00007fdbadc93709 00007fdbadc936d1 00007fdbadc929cd 0000000000388634 0000000000388479 00007fdbadc7483a
0709 12:22:26.156922 (+ 33084us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b4800043458. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:22:26.340482 (+183560us) raft_consensus.cc:1685] finished
0709 12:22:26.340514 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.340686 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135852,"prepare.queue_time_us":5026,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":148541,"raft.run_cpu_time_us":3195,"raft.run_wall_time_us":130394,"spinlock_wait_cycles":11329280,"thread_start_us":498437,"threads_started":2,"wal-append.queue_time_us":434021}
I20260709 12:22:26.333294  9706 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:26.251109  4153 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:26.416357  9706 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:26.340843  9565 consensus_queue.cc:1048] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 12:22:26.417526  9706 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.392596  9702 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.335093  9404 raft_consensus.cc:515] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:26.421654  9702 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.422220  9702 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:26.422348  9404 leader_election.cc:290] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:26.422636  9702 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:26.423055  9702 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:26.333180  9464 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.260339  9446 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.429600  4153 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 10, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 10 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:26.436107  4153 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 12 to 14, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:26.437785  4153 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 13 to 14, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:26.417124  9696 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:26.324128  4149 rpcz_store.cc:269] 0709 12:22:06.698081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.698265 (+   184us) service_pool.cc:224] Handling call
0709 12:22:26.295565 (+19597300us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:19.718709 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:19.725753 (+  7044us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:19.725822 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:22:19.725840 (+    18us) tablet.cc:662] Decoding operations
0709 12:22:19.737085 (+ 11245us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:19.737213 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:19.737255 (+    42us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:22:19.739026 (+  1771us) tablet.cc:701] Row locks acquired
0709 12:22:19.739082 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:22:19.739361 (+   279us) write_op.cc:270] Start()
0709 12:22:19.739548 (+   187us) write_op.cc:276] Timestamp: P: 1783599739739241 usec, L: 0
0709 12:22:19.739591 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:22:19.743880 (+  4289us) log.cc:844] Serialized 5428 byte log entry
0709 12:22:20.123600 (+379720us) op_driver.cc:464] REPLICATION: finished
0709 12:22:20.579521 (+455921us) write_op.cc:301] APPLY: starting
0709 12:22:20.619440 (+ 39919us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:21.079931 (+460491us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:21.080040 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:21.315509 (+235469us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:21.315912 (+   403us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:22:21.315984 (+    72us) write_op.cc:312] APPLY: finished
0709 12:22:21.318161 (+  2177us) log.cc:844] Serialized 129 byte log entry
0709 12:22:21.413086 (+ 94925us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.424007 (+ 10921us) write_op.cc:454] Released schema lock
0709 12:22:21.463717 (+ 39710us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:21.467956 (+  4239us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.467989 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":215289,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":319740,"apply.run_cpu_time_us":41326,"apply.run_wall_time_us":944609,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":130339,"prepare.run_cpu_time_us":21133,"prepare.run_wall_time_us":190497,"raft.queue_time_us":187079,"raft.run_cpu_time_us":10341,"raft.run_wall_time_us":232649,"replication_time_us":383827,"thread_start_us":565234,"threads_started":5,"wal-append.queue_time_us":284494,"wal-append.run_cpu_time_us":16823,"wal-append.run_wall_time_us":2092776}]]}
I20260709 12:22:26.450065  9530 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.537354  4253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57876 (request call id 1160) took 1069 ms. Trace:
I20260709 12:22:26.539775  4253 rpcz_store.cc:276] 0709 12:22:25.468361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.470519 (+  2158us) service_pool.cc:224] Handling call
0709 12:22:25.470848 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.823265 (+352417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.823321 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:25.833123 (+  9802us) log.cc:844] Serialized 26 byte log entry
0709 12:22:26.222800 (+389677us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:22:26.536654 (+313854us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.536938 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.537041 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.537096 (+    55us) raft_consensus.cc:1685] finished
0709 12:22:26.537115 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.537284 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27816,"prepare.queue_time_us":77113,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4463,"raft.queue_time_us":68957,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":79,"thread_start_us":1011085,"threads_started":3,"wal-append.queue_time_us":362824}
W20260709 12:22:26.557590  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 315468us
I20260709 12:22:26.490922  9708 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.537185  9568 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:26.538597  9716 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:26.578397  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 292021us
W20260709 12:22:26.580689  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 323227us
W20260709 12:22:26.583747  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 290796us
I20260709 12:22:26.584589  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:26.560570  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:26.588963  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:26.585866  9716 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:26.604223  4218 leader_election.cc:304] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:26.609346  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 322440us
I20260709 12:22:26.602027  9708 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:26.628608  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.629063  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:26.629912  4247 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 17.
I20260709 12:22:26.630470  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.603845  9530 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:26.633719  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.608410  9568 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:26.611456  9404 raft_consensus.cc:2749] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:26.637341  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:26.641247  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 384252us
W20260709 12:22:26.649941  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.623875  9464 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:26.681768  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.684267  4218 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.685745  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:26.635371  9530 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:26.620528  9377 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:22:26.638484  9715 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:26.693697  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 99071.1us
I20260709 12:22:26.695968  9530 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:26.646378  9568 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.704749  9404 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:26.705160  9744 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:26.713709  9640 raft_consensus.cc:493] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:26.698760  9709 consensus_queue.cc:1059] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:22:26.718994  9741 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:26.734236  9695 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.761412  9754 consensus_queue.cc:1059] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:22:26.762423  9731 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:26.709622  9715 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.753787  9736 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.759191  9709 consensus_queue.cc:1059] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 12:22:26.765349  9733 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:22:26.753715  9741 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:26.786474  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.782713  9736 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.772878  9707 raft_consensus.cc:3055] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:26.841117  9707 raft_consensus.cc:740] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:26.841993  9707 consensus_queue.cc:260] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.842815  4326 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:26.748513  9640 raft_consensus.cc:515] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.843860  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.845229  9640 leader_election.cc:290] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:26.797544  9763 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.845738  9640 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:26.845885  9763 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.846256  9640 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.769716  9695 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:26.808305  4201 auto_rebalancer.cc:629] Failed to schedule move for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32: Illegal state: Replica 0952d204644f41a88e5e463e697dcc27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:26.812872  9715 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.814018  9730 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.814111  9472 consensus_queue.cc:1048] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:26.852684  9470 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.860029  9470 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.862272  9470 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:26.851290  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:26.828351  9568 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:26.744967  9744 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.828843  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d321543daa94c458a2b9ed5e9d553a3" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.794981  9716 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:26.830199  9709 raft_consensus.cc:3055] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:26.870352  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:26.791867  9741 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:26.835672  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.872259  4407 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 12.
I20260709 12:22:26.836779  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.873773  4403 raft_consensus.cc:2393] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 15: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:26.837531  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.838652  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f50fa8d8c34c06a67470615046629f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:26.839236  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:26.840217  9705 consensus_meta.cc:287] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.003s
I20260709 12:22:26.840701  9734 raft_consensus.cc:3055] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:22:26.858199  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 158071us
W20260709 12:22:26.836858  9492 consensus_meta.cc:287] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:22:26.843147  9707 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:26.869108  4218 leader_election.cc:304] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.828436  9527 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:22:26.881150  9696 raft_consensus.cc:2749] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:26.881603  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:26.882072  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:26.882387  4989 raft_consensus.cc:2393] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:26.882825  4986 raft_consensus.cc:2393] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 16: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:26.884644  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.871098  4253 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:22:26.885288  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:26.886209  4986 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 16: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:26.886081  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:26.886643  4992 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:26.887171  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.888618  4400 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:26.853477  9597 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:26.893788  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
W20260709 12:22:26.893096  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 251005us
I20260709 12:22:26.887252  9763 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:26.893761  4218 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.897579  4218 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:26.872628  9709 raft_consensus.cc:740] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:26.892964  9527 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.878440  9734 raft_consensus.cc:740] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:26.883423  9705 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:26.887183  9588 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:26.906366  9698 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:26.960623  4298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.905838  9708 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:26.968261  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:26.969201  4247 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
W20260709 12:22:26.970664  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 86071.5us
W20260709 12:22:26.959235  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 55781.6us
I20260709 12:22:26.971480  4296 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:26.962073  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 67357.4us
I20260709 12:22:26.887508  9492 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.965535  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:26.957907  9711 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:26.864838  9730 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.989562  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:26.990396  4406 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:26.996479  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:26.903980  9597 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:26.999039  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.001464  4401 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
W20260709 12:22:26.988095  9702 consensus_meta.cc:287] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 12:22:27.020552  4256 raft_consensus.cc:1240] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 9. Current term is 11. Ops: []
I20260709 12:22:26.941278  9527 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.026811  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.017257  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.028234  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:27.038484  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 66036.1us
I20260709 12:22:27.040307  4254 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:27.041312  4247 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:27.032507  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.041970  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:26.959690  9588 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.046316  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d14a1bca614fe1af748ef119552803" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:27.047961  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 76595.7us
I20260709 12:22:27.049427  4253 raft_consensus.cc:2410] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:22:27.015370  9766 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.053862  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:27.027872  9453 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:27.058369  4406 raft_consensus.cc:2468] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 10.
I20260709 12:22:27.029125  9640 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:26.997138  9709 consensus_queue.cc:260] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.071277  9709 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.072669  9527 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.066505  9763 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:27.075763  9763 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:27.061228  9453 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.076400  9453 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:27.076205  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 101944us
I20260709 12:22:27.066847  9766 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.079787  4372 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.081100  9744 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.079034  9745 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:22:27.076220  9763 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:27.088627  9597 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.090672  9708 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.093245  9492 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.052237  9530 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.097124  4333 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
W20260709 12:22:27.097195  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48366.5us
I20260709 12:22:27.099213  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8463b2beaf488989ffd8e005249050" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.103668  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.104732  4332 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
I20260709 12:22:27.109084  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.109943  4407 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:27.074987  9640 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:27.046901  9702 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:27.124594  9698 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.096385  9695 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.099051  9574 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.016561  9734 consensus_queue.cc:260] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.109946  9764 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.056141  9773 consensus_queue.cc:1059] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:22:27.114787  9640 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.137655  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:27.147670  4296 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:27.150290  9767 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:22:27.168192  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.192924  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:27.203498  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 149696us
I20260709 12:22:27.204983  4955 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.147787  9640 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.213888  9702 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.192688  9706 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.135852  9574 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:27.210743  9718 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:27.129383  9771 consensus_queue.cc:1059] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
W20260709 12:22:27.217310  9769 log.cc:927] Time spent T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:22:27.212913  9154 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:27.230286  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 151886us
I20260709 12:22:27.231040  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:27.232503  9470 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:27.232913  9470 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.233263  9470 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.240316  9763 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.242884  9736 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.242955  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.243840  4992 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:27.224342  9770 raft_consensus.cc:3055] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:27.244915  9770 raft_consensus.cc:740] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:27.245752  9770 consensus_queue.cc:260] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.246634  9470 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.249137  9588 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.252689  9763 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.253191  9640 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.247023  9770 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:27.255475  9640 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.225025  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:27.265000  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:27.265277  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 117653us
I20260709 12:22:27.266534  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.222245  9530 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.273362  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.277460  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
I20260709 12:22:27.278858  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:27.281127  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 56186.4us
I20260709 12:22:27.281419  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.225040  9734 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.285753  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.287525  4407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.290186  9574 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.271221  9749 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:27.292636  9749 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.294901  9749 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.296586  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.277036  9453 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.298867  9453 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.286671  9504 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:27.299724  9504 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:27.300139  9504 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:27.309677  4990 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:22:27.273154  9730 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.272846  9771 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:27.313066  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:27.314116  9757 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:27.314527  9757 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.314848  9757 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.276799  9739 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:27.319607  9739 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.319994  9739 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:27.320268  4253 raft_consensus.cc:1275] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:27.323021  9766 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.280328  9772 raft_consensus.cc:3055] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:27.324151  9772 raft_consensus.cc:740] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:27.324928  9772 consensus_queue.cc:260] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.326181  9772 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.283500  9773 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.268693  9740 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:27.332137  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 50798.7us
W20260709 12:22:27.332701  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 50835.9us
I20260709 12:22:27.333987  4218 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:22:27.336732  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.275457  9716 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:27.345521  4218 leader_election.cc:304] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.342157  4247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:27.348428  4247 raft_consensus.cc:606] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.354012  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.354960  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:27.356022  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.356173  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.356848  4254 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 15.
I20260709 12:22:27.352620  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.359146  4254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.359670  4250 raft_consensus.cc:2410] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:22:27.356690  4326 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:27.329694  9611 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.367889  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.368462  4328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.369966  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.343400  9530 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:27.342079  9698 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:27.376058  4955 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.376848  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.377617  4325 raft_consensus.cc:2393] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 16: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:27.378270  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.380893  4988 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:27.382149  4992 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:27.355194  9749 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:27.387117  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.388070  4333 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 16.
I20260709 12:22:27.389186  9470 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.364084  9771 raft_consensus.cc:493] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:27.389993  9771 raft_consensus.cc:515] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.384763  9698 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:27.393702  9741 consensus_meta.cc:287] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 12:22:27.394104  9698 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.394662  9530 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:27.395856  9707 raft_consensus.cc:3055] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:27.394153  9741 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.396241  9707 raft_consensus.cc:740] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:27.396440  9730 consensus_queue.cc:1048] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:27.396709  4249 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 15.
I20260709 12:22:27.399515  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.400380  9766 raft_consensus.cc:2804] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:27.401422  9766 raft_consensus.cc:697] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:27.402155  4955 leader_election.cc:304] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.402992  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.404177  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:27.404888  4992 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:27.406404  4987 raft_consensus.cc:2393] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:27.408732  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853b8c508a614bb4b9fdc0c62fe13342" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.409817  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:27.370182  9705 raft_consensus.cc:493] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:27.422053  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:22:27.414047  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.416575  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:27.417199  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:27.424716  4984 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:27.408727  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.425688  4988 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 16.
I20260709 12:22:27.429562  4254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "899897e6794541b5ab538af361fc9e6c"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:27.431850  4992 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:27.347541  9740 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:27.435889  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.436693  4219 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:27.413079  9574 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.436893  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:27.403929  9749 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:27.438585  4403 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:27.438514  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.401971  9741 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.437459  9780 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:27.446413  9446 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.446586  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.424383  9708 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:27.447017  9559 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:22:27.439400  9777 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
W20260709 12:22:27.451525  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 66681.3us
I20260709 12:22:27.437537  9737 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.437511  9747 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.454219  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:27.453358  4218 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.474642  4218 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:27.474390  9757 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:27.449420  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 47358.2us
I20260709 12:22:27.443809  9749 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:27.466106  4988 raft_consensus.cc:1240] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:27.466868  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.437484  9743 raft_consensus.cc:2749] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:27.439389  9778 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:27.483567  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.484194  4400 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:27.454025  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.484895  4984 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:27.475247  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:27.481240  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.488837  4406 raft_consensus.cc:2368] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 15. Current term is 16.
I20260709 12:22:27.432031  9705 raft_consensus.cc:515] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.454815  9744 raft_consensus.cc:2749] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.454879  9559 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:27.446815  9780 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.505299  9559 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:27.506626  9736 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:27.507025  9736 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.507380  9736 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:27.509980  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.510885  4406 raft_consensus.cc:2393] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 13: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:27.509963  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.437547  9774 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 12:22:27.519884  9565 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.521230  4955 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.483995  9596 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:27.536454  4254 raft_consensus.cc:606] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Received request to transfer leadership to TS 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.557808  4955 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:22:27.498790  9779 log.cc:927] Time spent T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
W20260709 12:22:27.525995  9786 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:22:27.476534  9737 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.526736  9771 leader_election.cc:290] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.463713  9507 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:22:27.448516  9574 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:27.571130  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 85534us
I20260709 12:22:27.463433  9708 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.530627  4400 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:27.531908  9736 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.558183  4254 raft_consensus.cc:614] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:27.525159  9705 leader_election.cc:290] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.564429  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.570714  4992 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 15.
I20260709 12:22:27.574396  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.574136  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.535714  9565 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.581704  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.582188  9565 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.582078  9504 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.582801  9565 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:27.583451  9771 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:27.585641  9740 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.588789  9574 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.590144  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.571806  9744 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:27.590945  9737 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.592413  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.559549  9467 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:27.572819  9596 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:27.595329  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.595595  9596 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.596324  4332 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:22:27.596704  9736 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:27.504107  9778 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.600449  4331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.601087  4331 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 10.
I20260709 12:22:27.603250  9757 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.604588  9504 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:27.604843  9784 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 12:22:27.583501  9761 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.610014  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.613546  9611 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.614471  4407 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:27.536207  9766 consensus_queue.cc:237] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.504843  9741 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:27.618875  4219 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:27.592507  9708 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.620404  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.639436  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:27.656457  4327 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:27.657126  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 182558us
I20260709 12:22:27.640380  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:27.654170  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.621397  9778 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:27.624318  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:27.574111  9774 raft_consensus.cc:3055] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:22:27.624799  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:27.574486  9754 consensus_queue.cc:1059] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:22:27.627592  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:27.627954  9739 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:27.628475  9559 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.629540  9780 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:27.631743  9751 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.834s	user 0.009s	sys 0.006s
I20260709 12:22:27.632370  4256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 2345) took 1495 ms. Trace:
I20260709 12:22:27.699811  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:27.700202  4256 rpcz_store.cc:276] 0709 12:22:26.137304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.137498 (+   194us) service_pool.cc:224] Handling call
0709 12:22:26.137952 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.047266 (+909314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.632145 (+584879us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540019ad54. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce7571 00007fdbb0d7ee01 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:27.632314 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029353856}
I20260709 12:22:27.633046  4326 raft_consensus.cc:2410] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:27.633364  4328 raft_consensus.cc:2410] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:22:27.659637  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.639530  9698 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:27.662441  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.666833  4984 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:27.667971  4329 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:27.666543  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:27.662447  4955 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.669427  4252 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:22:27.726562  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 64186.6us
I20260709 12:22:27.677985  4404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b63478950f49c4a21f85e72a0a2218" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.678694  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:27.661394  4296 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.708736  4408 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:27.726017  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
W20260709 12:22:27.728904  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 67610.3us
I20260709 12:22:27.730784  4256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.730819  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2742c399a2d4e5dae60161a45cce316" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.732756  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.733875  4249 raft_consensus.cc:2410] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:27.735438  4296 leader_election.cc:304] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:27.735965  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:27.743602  4327 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 17.
I20260709 12:22:27.670217  9741 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:27.748471  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.668918  9774 raft_consensus.cc:740] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:27.753129  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:27.749750  4247 raft_consensus.cc:2410] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:22:27.794821  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:27.796134  4248 raft_consensus.cc:2410] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:22:27.796495  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:27.834544  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 88457.6us
I20260709 12:22:27.837568  4247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:27.912247  4984 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
I20260709 12:22:27.918883  4247 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:27.682621  9734 consensus_queue.cc:1059] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:22:27.669052  9377 consensus_queue.cc:1059] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 12:22:27.920873  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 87916.2us
I20260709 12:22:27.932317  4218 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.933305  4218 leader_election.cc:400] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 election: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 15. Current term is 16.
I20260709 12:22:27.933496  4218 leader_election.cc:403] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:22:27.732384  9736 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:27.736528  9698 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:27.793193  9782 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:22:27.743657  9780 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:27.639226  9596 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.749439  9773 raft_consensus.cc:2749] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:27.928467  9751 log.cc:927] Time spent T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:22:27.965106  9596 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.967618  9741 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:27.941159  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 213603us
I20260709 12:22:27.968971  4955 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:27.969769  9467 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:27.928089  9755 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:22:27.950239  9792 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
W20260709 12:22:27.950865  9791 log.cc:927] Time spent T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:22:27.951125  9706 raft_consensus.cc:3055] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:27.976585  9706 raft_consensus.cc:740] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:27.977415  9749 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.977712  9706 consensus_queue.cc:260] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.951675  4956 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:27.953333  9707 consensus_queue.cc:260] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.980185  9707 raft_consensus.cc:3060] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:27.980248  9763 raft_consensus.cc:2804] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:27.980897  9763 raft_consensus.cc:697] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 17 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:27.979050  9706 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:27.981770  9763 consensus_queue.cc:237] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.953840  9774 consensus_queue.cc:260] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.968133  9559 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:27.938783  4990 raft_consensus.cc:1240] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:22:27.937937  9740 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:22:27.985220  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 275596us
I20260709 12:22:27.943847  9698 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:27.998111  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:28.001586  9656 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:28.006961  9656 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:27.998682  9749 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.016716  9656 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:27.939054  4218 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.064837  4250 raft_consensus.cc:3060] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:28.068182  4249 raft_consensus.cc:3060] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.083722  9749 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:28.084867  9749 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:28.085439  9749 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:28.103557  4247 raft_consensus.cc:1240] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:28.125281  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 139386us
I20260709 12:22:28.134600  4252 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
I20260709 12:22:28.135589  9708 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481) with higher term. Message: Invalid argument: T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 15. Current term is 16.
I20260709 12:22:28.135769  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:28.137316  4326 raft_consensus.cc:2368] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:28.140734  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:28.148046  9707 consensus_queue.cc:1059] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:28.149956  9707 raft_consensus.cc:3055] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:28.150363  9707 raft_consensus.cc:740] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
W20260709 12:22:28.158732  4297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.170089  4371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.172935  9588 raft_consensus.cc:3055] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:28.173512  9588 raft_consensus.cc:740] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:28.181375  4219 leader_election.cc:400] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:28.181922  4219 leader_election.cc:403] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:22:28.192214  4330 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:22:28.192797  4330 pending_rounds.cc:85] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting all ops after (but not including) 7
I20260709 12:22:28.193147  4330 pending_rounds.cc:107] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:22:28.193511  4330 raft_consensus.cc:2889] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:28.194658  4250 raft_consensus.cc:2468] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:28.202617  9467 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:28.207723  9707 consensus_queue.cc:260] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:28.209784  9707 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:28.230320  9758 raft_consensus.cc:3055] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:28.218962  9743 raft_consensus.cc:993] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:28.234699  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.235102  9743 raft_consensus.cc:1081] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:28.231112  9758 raft_consensus.cc:740] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:28.236907  9742 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:22:28.238086  9787 log.cc:927] Time spent T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.857s	user 0.005s	sys 0.022s
I20260709 12:22:28.238619  9754 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.238827  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:28.240965  4334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40644 (request call id 1588) took 1433 ms. Trace:
I20260709 12:22:28.242165  4331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55272
I20260709 12:22:28.241497  4334 rpcz_store.cc:276] 0709 12:22:26.807019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.818511 (+ 11492us) service_pool.cc:224] Handling call
0709 12:22:26.818990 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.863309 (+ 44319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.863338 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.157554 (+294216us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b2c0005c2d8. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbaf677a11 00007fdbaf687372 00007fdbb0db9a01 00007fdbb0d7e43a 00007fdbb0d7d83e 00007fdbb5d42419 00007fdbaf2b9bd4 00007fdbaf2b9b62 00007fdbaf2b9a91 00007fdbaf2b9a0c 00007fdbaf2b8cc2
0709 12:22:27.157991 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.300487 (+142496us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4800043458. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb5ca7aa1 00007fdbb5c9eb37 00007fdbb5c9e9ca 00007fdbb5d9626f 00007fdbb5d95f37 00007fdbb5daa55c 00007fdbb5daa508 00007fdbb5daa488 00007fdbb5daa443 00007fdbb5da96ec 00007fdbb4cd3a96
0709 12:22:27.352868 (+ 52381us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:22:27.352921 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.352986 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.237042 (+884056us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbadb19db1 00007fdbadbb7c85 00007fdbadbb86a2 00007fdbb092a1db 00007fdbb0925aaf 00007fdbb091986e 00007fdbb0918bb6 00007fdbb09187d8 00007fdbb0922221 00007fdbb09221d9 00007fdbb0922169
0709 12:22:28.240522 (+  3480us) raft_consensus.cc:1685] finished
0709 12:22:28.240552 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.240753 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90520,"raft.queue_time_us":49129,"raft.run_cpu_time_us":3363,"raft.run_wall_time_us":427162,"spinlock_wait_cycles":26935680,"thread_start_us":194556,"threads_started":1,"wal-append.queue_time_us":222657}
I20260709 12:22:28.238322  9758 consensus_queue.cc:260] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.241511  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:28.243127  4331 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.258829  4331 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.262209  4249 raft_consensus.cc:2468] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 17.
I20260709 12:22:28.262226  4325 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:28.239411  9754 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.269109  9597 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 16. Current term is 17.
I20260709 12:22:28.277870  9699 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:28.278748  9699 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:28.280290  9699 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.283416  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:28.284307  4253 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.287480  4219 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.292019  9763 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:22:28.292371  9708 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:28.293129  9708 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:28.294812  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.295802  9708 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.299767  4330 raft_consensus.cc:1240] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:28.275892  9758 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:28.311187  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:28.312244  4252 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:28.314746  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.315809  9530 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:28.316294  9530 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.316653  9530 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:28.287243  9588 consensus_queue.cc:260] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.323901  9742 consensus_queue.cc:1059] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:28.333014  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.333851  4992 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:28.331312  9754 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.340936  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.345322  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.346704  4992 raft_consensus.cc:2393] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:28.348083  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.348976  4990 raft_consensus.cc:2368] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13.
I20260709 12:22:28.349452  9492 raft_consensus.cc:493] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:28.350069  9492 raft_consensus.cc:515] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.351574  4331 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:28.352818  9492 leader_election.cc:290] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.353763  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:28.356468  4956 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.357841  9742 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:28.359161  9739 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:28.360668  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:28.362982  4334 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.368789  9698 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.369897  4990 raft_consensus.cc:1240] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:22:28.370354  4256 raft_consensus.cc:2393] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 11: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:28.373282  9698 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.379380  4325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
W20260709 12:22:28.379573  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 141015us
I20260709 12:22:28.379067  4334 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 17.
I20260709 12:22:28.389040  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.389803  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:28.390661  9738 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:28.390893  9205 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:28.391381  9738 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:28.392824  9588 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.392599  9738 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:28.395010  4955 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.400439  9749 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.402619  9763 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:28.403527  4248 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:28.406106  4407 raft_consensus.cc:1275] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:22:28.412210  4955 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.413352  9205 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:28.415653  9709 consensus_queue.cc:1059] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:28.416440  4218 leader_election.cc:304] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:28.417109  9797 consensus_queue.cc:1059] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:28.418130  4218 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.418526  9797 raft_consensus.cc:3055] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:28.419165  4253 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 17.
I20260709 12:22:28.401765  9530 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.420329  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.419024  9797 raft_consensus.cc:740] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:28.427677  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:28.431592  4331 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:28.431805  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:28.434939  4253 raft_consensus.cc:3055] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:28.435375  4253 raft_consensus.cc:740] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:28.449653  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.450697  9774 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:28.460516  9507 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:28.462565  9734 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:28.438140  9492 raft_consensus.cc:2749] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:28.440599  9698 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:28.473636  9797 consensus_queue.cc:260] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.478376  4249 raft_consensus.cc:1240] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:28.482832  4990 raft_consensus.cc:1240] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 15. Current term is 16. Ops: []
I20260709 12:22:28.478873  9797 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:28.484259  4299 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.487936  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 69992.2us
I20260709 12:22:28.489287  9749 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.494900  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:28.495586  4249 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:28.500542  9734 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:22:28.503410  9706 consensus_queue.cc:1175] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0952d204644f41a88e5e463e697dcc27" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 10 index: 9 } }
I20260709 12:22:28.506953  4249 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:28.518714  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8c0670d52b4df8ad46e1549814b7a8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.520224  4992 raft_consensus.cc:3060] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:28.521499  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.525496  4989 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:28.513375  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.526875  9706 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.528096  4371 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:28.527500  9706 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.529158  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:28.529834  4249 raft_consensus.cc:606] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.530180  4249 raft_consensus.cc:614] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:28.530575  9706 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.531404  9706 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.532027  9706 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.534615  9811 raft_consensus.cc:2804] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:28.535228  9811 raft_consensus.cc:697] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:28.536284  9811 consensus_queue.cc:237] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.543265  4218 leader_election.cc:400] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13.
I20260709 12:22:28.512423  9530 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.543854  4218 leader_election.cc:403] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:22:28.544896  9492 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853) with higher term. Message: Invalid argument: T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13.
I20260709 12:22:28.515566  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
W20260709 12:22:28.493701  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 78475.4us
I20260709 12:22:28.519598  4296 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.543257  9706 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.512735  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:28.547364  9706 raft_consensus.cc:2804] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:28.547891  9706 raft_consensus.cc:697] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:28.548153  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:28.548971  4249 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 16.
I20260709 12:22:28.549005  9706 consensus_queue.cc:237] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.551172  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:28.551821  4249 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:28.553241  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.554039  4990 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 9.
I20260709 12:22:28.556236  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.556957  4984 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 16.
I20260709 12:22:28.557876  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.558681  4327 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:22:28.558940  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.559517  9530 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:28.559784  9734 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:28.559959  9530 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.560206  9734 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.560369  9530 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.560580  9734 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.564745  9507 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:28.511226  4253 consensus_queue.cc:260] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:28.568125  9734 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.569223  4253 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.570420  9734 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:28.605018  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 61959.3us
I20260709 12:22:28.606895  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:28.607658  4249 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.608493  4153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49190 (request call id 389) took 8868 ms. Trace:
W20260709 12:22:28.612494  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 69883.9us
I20260709 12:22:28.614960  4249 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 17.
I20260709 12:22:28.616024  4992 raft_consensus.cc:2468] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:28.617697  4296 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.621922  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f35b6d3672d440581ae00175c31e5b7" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.622572  4984 raft_consensus.cc:3060] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:28.621491  9774 raft_consensus.cc:2804] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:28.625427  9774 raft_consensus.cc:697] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:28.637216  9738 raft_consensus.cc:493] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:28.637990  9738 raft_consensus.cc:515] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.640113  4400 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:28.641630  4330 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:28.653025  4218 leader_election.cc:304] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.617664  9530 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.626744  9774 consensus_queue.cc:237] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.657835  9743 raft_consensus.cc:2749] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:28.609042  4153 rpcz_store.cc:276] 0709 12:22:19.739764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.740547 (+   783us) service_pool.cc:224] Handling call
0709 12:22:19.992097 (+251550us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:28.608132 (+8616035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:26.765547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:26.766179 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:26.766217 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:22:26.766236 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:26.767411 (+  1175us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:26.767478 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:26.767506 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:22:26.768559 (+  1053us) tablet.cc:701] Row locks acquired
0709 12:22:26.768575 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:26.768728 (+   153us) write_op.cc:270] Start()
0709 12:22:26.768984 (+   256us) write_op.cc:276] Timestamp: P: 1783599746768676 usec, L: 0
0709 12:22:26.769009 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:22:26.783587 (+ 14578us) log.cc:844] Serialized 4338 byte log entry
0709 12:22:27.413190 (+629603us) op_driver.cc:464] REPLICATION: finished
0709 12:22:27.584269 (+171079us) write_op.cc:301] APPLY: starting
0709 12:22:27.584350 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:27.958043 (+373693us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:27.958162 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:28.083037 (+124875us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:28.124108 (+ 41071us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:22:28.124188 (+    80us) write_op.cc:312] APPLY: finished
0709 12:22:28.124889 (+   701us) log.cc:844] Serialized 105 byte log entry
0709 12:22:28.126883 (+  1994us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:28.127502 (+   619us) write_op.cc:454] Released schema lock
0709 12:22:28.127582 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:28.128412 (+   830us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:28.128438 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2583847,"reported_tablets":28,"spinlock_wait_cycles":336382208,"child_traces":[["op",{"apply.queue_time_us":159945,"apply.run_cpu_time_us":18636,"apply.run_wall_time_us":543956,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":190924,"prepare.run_cpu_time_us":25612,"prepare.run_wall_time_us":194281,"raft.queue_time_us":122490,"raft.run_cpu_time_us":9225,"raft.run_wall_time_us":162194,"replication_time_us":604525,"thread_start_us":394117,"threads_started":4,"wal-append.queue_time_us":245021}]]}
I20260709 12:22:28.657130  4218 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.670028  9749 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:22:28.653823  9708 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:22:28.676846  4247 raft_consensus.cc:1275] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:22:28.677721  4253 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:28.678880  4296 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.679809  9797 raft_consensus.cc:2804] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:28.680338  9797 raft_consensus.cc:697] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:28.683713  4253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b22e067af7004ed88fb3125c7ac731ad"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:28.685369  4253 raft_consensus.cc:606] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.685938  4253 raft_consensus.cc:614] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:28.698194  4219 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:28.701519  4984 raft_consensus.cc:2468] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 17.
I20260709 12:22:28.693037  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d57b9080cd745529aba05aa6b7a640e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:28.718112  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:28.703550  9749 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:28.703574  9699 raft_consensus.cc:493] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.716243  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb68505c01944fb98aa2334aa5c28e9" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:28.711943  9738 leader_election.cc:290] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.725595  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18183fd904d43f68b0e600ddb8ae249" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.729254  4400 raft_consensus.cc:3060] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:28.708351  4152 catalog_manager.cc:5697] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 10 to 13, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:28.724134  9743 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.739167  9743 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.741420  9743 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.727258  9797 consensus_queue.cc:237] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:28.727478  9749 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:28.751543  9749 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.731915  9699 raft_consensus.cc:515] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.757252  9699 leader_election.cc:290] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.758060  9761 consensus_queue.cc:1048] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:22:28.768245  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:28.768894  4249 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.781652  4404 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:28.785914  4330 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:28.767263  4152 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 9 to 11, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:28.791325  4371 leader_election.cc:304] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.809093  9565 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:28.786581  9530 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:28.816198  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 95046.2us
I20260709 12:22:28.806849  4152 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 15 to 16, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:28.819561  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631cc1317abe4f99b307dee5289f9258" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:28.820258  4984 raft_consensus.cc:3060] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:28.830732  9725 raft_consensus.cc:2749] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:22:28.828281  9698 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:22:28.834822  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:28.835355  9588 consensus_queue.cc:1048] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:28.835508  4408 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 11.
I20260709 12:22:28.839453  9525 raft_consensus.cc:493] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:28.839480  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:28.829269  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e006bba424d8b9ae7dfa589237877" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.835575  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:28.849879  4400 raft_consensus.cc:2468] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:28.853804  4256 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:22:28.827224  4201 auto_rebalancer.cc:629] Failed to schedule move for tablet 66d0cf9ce16c45e399c41f8f0bfb5e32: Illegal state: Replica 0952d204644f41a88e5e463e697dcc27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:28.864997  4984 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
I20260709 12:22:28.829926  9743 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.873576  9743 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.875470  4403 raft_consensus.cc:1240] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Rejecting Update request from peer 0aa405b398df42edbf74ee643aeb18dc for earlier term 11. Current term is 12. Ops: []
I20260709 12:22:28.826108  9734 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.876114  9734 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.884929  4296 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.904304  4333 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:28.910331  4992 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:28.906049  4371 leader_election.cc:304] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:28.919799  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:28.920723  4330 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 16.
I20260709 12:22:28.924053  4250 raft_consensus.cc:1240] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:28.922297  4219 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:28.840131  9525 raft_consensus.cc:515] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.933454  9525 leader_election.cc:290] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:28.934185  9525 raft_consensus.cc:2749] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:28.943985  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:28.964907  4152 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:28.960989  9820 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:28.982800  9772 raft_consensus.cc:2804] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:28.983458  9772 raft_consensus.cc:697] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:28.984476  9772 consensus_queue.cc:237] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:28.991353  4256 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:22:28.991668  4249 raft_consensus.cc:2468] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 10.
W20260709 12:22:28.998009  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 93880.8us
I20260709 12:22:28.973618  9820 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.967727  4152 catalog_manager.cc:5697] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 7 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 14 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.003130  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.004662  4330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5e08eda6fd4363b1af431c73621515" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:29.012069  4248 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:29.012723  9778 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:22:29.012971  9708 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:29.013864  9205 raft_consensus.cc:3055] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:29.014179  4334 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:29.014328  9205 raft_consensus.cc:740] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:29.014096  9823 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:22:29.004988  9820 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.028255  4249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3c4a4b844fc4fd39fac73554dc3d8d8"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40176
I20260709 12:22:29.003671  9743 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.031498  4249 raft_consensus.cc:606] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:29.031925  4249 raft_consensus.cc:614] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:29.034832  9446 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:22:29.036145  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:29.024268  9734 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.042702  4990 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:29.069882  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.076588  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.076437  4992 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 16.
I20260709 12:22:29.057266  4152 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:29.084820  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 60625.5us
I20260709 12:22:29.086373  4152 catalog_manager.cc:5697] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 10 to 12, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 12 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:29.043689  9597 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:29.099974  4248 raft_consensus.cc:1275] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:29.105434  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:29.102216  9821 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.142s	user 0.000s	sys 0.003s
I20260709 12:22:29.043231  9725 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:22:29.104597  4152 catalog_manager.cc:5697] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 11 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:29.102233  9817 log.cc:927] Time spent T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:22:29.101239  9597 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.112146  9797 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:29.130191  9420 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:22:29.131645  9715 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:22:29.132130  9749 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:29.132741  9749 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.122112  9597 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:29.044148  9205 consensus_queue.cc:260] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.129252  9797 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.109372  9774 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:22:29.148336  9530 consensus_queue.cc:1048] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:22:29.151717  9819 log.cc:927] Time spent T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 12:22:29.145180  9797 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.147173  4152 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 14 to 15, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 15 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.157275  9706 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.157868  9706 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:29.159722  9822 log.cc:927] Time spent T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 12:22:29.160367  9706 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.165139  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.166061  4992 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:29.167589  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
W20260709 12:22:29.178284  9824 log.cc:927] Time spent T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:22:29.183877  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:29.188055  4371 leader_election.cc:304] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:29.188783  4984 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:29.188140  9749 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.189644  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:29.194268  9527 raft_consensus.cc:2749] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:29.143926  9763 consensus_queue.cc:1059] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:22:29.200801  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.201464  4984 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 18: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:29.207316  9698 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:29.190805  9820 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.213075  9820 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.213251  4256 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:29.214414  4253 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 17: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:29.216800  9745 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:29.222649  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.226465  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.192126  9706 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:29.237039  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:29.240020  9205 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:29.246191  4990 raft_consensus.cc:1275] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:29.242079  4408 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 18.
I20260709 12:22:29.229112  9734 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:29.284855  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:29.285776  4989 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.245667  9706 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:29.289407  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55658.2us
I20260709 12:22:29.289765  4152 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 9 to 10, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 10 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.307386  4256 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:29.288051  9706 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.313321  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:29.312841  4152 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 10 to 11, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 11 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.324286  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:29.292110  9734 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.338498  4334 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:29.342178  9708 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:29.309661  9739 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:22:29.298245  9797 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.317688  9774 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:22:29.337421  9492 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:29.375700  4333 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 17: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:29.355454  4152 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 10 to 9, leader changed from <none> to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 9 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.367712  9530 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.366240  9492 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
W20260709 12:22:29.413820  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 106061us
I20260709 12:22:29.425102  4152 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 9 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 13 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.428519  4986 raft_consensus.cc:1275] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:29.434113  4256 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:29.412207  9492 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:29.411578  9838 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.431881  9839 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:29.476784  4152 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 8 to 11, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 11 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.412194  9530 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:29.510769  9833 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:22:29.431813  9730 consensus_queue.cc:1048] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:22:29.514072  4152 catalog_manager.cc:5697] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 6 to 9, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 9 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
W20260709 12:22:29.540052  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 71626.4us
I20260709 12:22:29.463050  9772 consensus_queue.cc:1048] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:22:29.475944  9840 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:22:29.552968  9530 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:29.493819  9838 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.555666  9838 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:29.555931  9847 log.cc:927] Time spent T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:29.560428  4992 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:29.564275  9706 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:29.583624  9834 log.cc:927] Time spent T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 12:22:29.585238  9852 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.586585  9846 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.591564  9820 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:29.592267  9820 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.594481  9820 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.585806  9852 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.570143  9734 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.600467  9706 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.601477  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:29.601642  9597 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.602353  4333 raft_consensus.cc:2368] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13.
I20260709 12:22:29.602843  4247 raft_consensus.cc:1240] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Rejecting Update request from peer 0952d204644f41a88e5e463e697dcc27 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:22:29.603879  4219 leader_election.cc:400] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13.
I20260709 12:22:29.587231  9846 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.604234  4219 leader_election.cc:403] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:29.605581  9851 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.605995  9846 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.606771  9852 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:29.623088  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 105516us
I20260709 12:22:29.632170  4984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.632993  4984 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
I20260709 12:22:29.632349  4989 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 17.
I20260709 12:22:29.641132  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:29.642165  4252 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 17: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:29.654022  4992 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:22:29.658300  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.659262  4989 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 16.
I20260709 12:22:29.656535  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:29.668452  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:29.723935  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 209594us
W20260709 12:22:29.729130  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 72696.2us
W20260709 12:22:29.735898  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 158209us
I20260709 12:22:29.737010  4990 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:29.743253  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.744029  4990 raft_consensus.cc:2393] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:29.757395  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:29.761193  4990 raft_consensus.cc:3060] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.758318  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987201f60eb64f869c89f0703e622738" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:29.747079  4253 raft_consensus.cc:1275] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:29.764271  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:29.769752  4327 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 16.
I20260709 12:22:29.786238  4257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:29.787050  4257 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
W20260709 12:22:29.791399  9818 log.cc:927] Time spent T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:29.791947  9861 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:22:29.792446  9861 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.792805  9861 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.796185  9597 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:29.798825  9205 consensus_meta.cc:287] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: Time spent flushing consensus metadata: real 0.525s	user 0.001s	sys 0.010s
I20260709 12:22:29.802812  9492 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.806223  9492 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 18 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:29.826660  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 259258us
I20260709 12:22:29.828142  9797 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.832877  9825 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:29.827050  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 90185.3us
I20260709 12:22:29.854797  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:29.855715  4988 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:29.856392  9825 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:29.858784  9825 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:29.862056  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:29.897262  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:29.899453  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 156154us
I20260709 12:22:29.913429  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:29.879652  9772 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:22:29.922950  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 181868us
I20260709 12:22:29.926278  4990 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:29.927623  4988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:29.928404  4988 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 17: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:29.929908  4218 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:29.916298  9772 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.915235  9851 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for earlier term 12. Current term is 13.
I20260709 12:22:29.950495  9862 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:29.951005  9862 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.951344  9743 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:29.951941  9743 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:29.952924  9743 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.954797  9698 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:29.951344  9856 consensus_queue.cc:1059] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:22:29.951388  9862 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:29.957571  9864 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:22:29.948340  9772 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:29.969058  9772 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:29.971117  9772 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:29.984704  4252 raft_consensus.cc:2468] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
W20260709 12:22:29.992964  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 48832.9us
I20260709 12:22:29.995275  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:29.999689  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:30.007284  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:30.008073  4400 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:30.005626  9530 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:30.008695  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:30.008975  9530 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.009351  9530 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:29.999581  9772 consensus_queue.cc:1048] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:22:30.017104  4296 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:30.018308  9840 raft_consensus.cc:2804] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:30.018848  9840 raft_consensus.cc:697] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:30.028707  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:30.006978  9864 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.032150  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:30.033411  4400 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
W20260709 12:22:30.037971  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50671.8us
I20260709 12:22:30.038667  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:30.032793  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:30.045935  4408 raft_consensus.cc:1275] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:22:30.045938  9867 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.047489  9867 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.047866  9844 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:30.048261  9844 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:30.047560  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:30.049410  4989 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:30.049085  9844 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.050442  9844 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.059504  4253 raft_consensus.cc:2393] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:30.067651  4989 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 17.
I20260709 12:22:30.074071  4296 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:30.079799  9861 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.084175  9797 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:30.085160  4406 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 17: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:30.087896  9867 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:30.097239  9530 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:30.058966  9864 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.019793  9840 consensus_queue.cc:237] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.103214  4253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:30.104151  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:30.066393  9862 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.121358  9862 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:30.113797  4296 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:30.130735  9774 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:30.131271  9774 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:30.132184  9774 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.136505  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:30.137306  4327 raft_consensus.cc:2368] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14.
I20260709 12:22:30.137578  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:30.138113  4250 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.101536  9864 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.143600  9530 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:30.145416  9864 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:30.165421  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:30.166065  4252 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:30.173049  4408 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 18.
I20260709 12:22:30.173393  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:30.174152  4992 raft_consensus.cc:2393] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc in current term 18: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:30.185395  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:30.186499  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa0b9753bf4f05871dfa6b329de33a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:30.187139  4403 raft_consensus.cc:3060] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:22:30.195793  4372 leader_election.cc:400] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14.
I20260709 12:22:30.196162  4372 leader_election.cc:403] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:30.197811  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 55891.4us
I20260709 12:22:30.201040  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:30.201651  4406 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.218009  4406 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:30.195017  4403 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:30.221122  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:30.229398  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:30.230016  4990 raft_consensus.cc:3060] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:30.241310  4250 raft_consensus.cc:2468] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:30.242789  4296 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:30.239182  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:30.243793  4986 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:30.219597  9846 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725) with higher term. Message: Invalid argument: T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14.
I20260709 12:22:30.219753  9864 consensus_queue.cc:1048] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:22:30.237516  9852 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:30.259492  4990 raft_consensus.cc:2468] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:30.260732  4296 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:30.249326  9706 raft_consensus.cc:2804] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:30.269254  4201 placement_policy_util.cc:248] tablet 374e8fa3690a41af9874f32b270bf3e1: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 12:22:30.273168  9885 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:30.274226  9861 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:30.278419  4332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:30.280059  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:30.280772  9706 raft_consensus.cc:697] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:30.281749  9706 consensus_queue.cc:237] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:30.261543  9866 raft_consensus.cc:2804] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:30.288056  9866 raft_consensus.cc:697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:30.289213  9866 consensus_queue.cc:237] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.255290  9852 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.294627  9852 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.318449  4218 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27
W20260709 12:22:30.322440  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 69089.8us
I20260709 12:22:30.324859  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:30.331269  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:30.335335  4986 raft_consensus.cc:2393] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 17: Already voted for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in this term.
I20260709 12:22:30.340636  9851 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:30.341603  9851 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 18 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:30.339288  4201 auto_rebalancer.cc:629] Failed to schedule move for tablet 8afcac1f47834987ac3889edd37f61a3: Illegal state: Replica 0952d204644f41a88e5e463e697dcc27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.349148  9507 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:30.355561  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:30.342564  9851 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.359887  9725 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:22:30.421582  4326 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:30.448839  9857 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.449548  9857 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.448877  9743 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:22:30.495090  9895 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:22:30.496198  9894 log.cc:927] Time spent T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:30.496496  4987 raft_consensus.cc:2410] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa405b398df42edbf74ee643aeb18dc for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:22:30.504709  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:30.512359  9597 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:22:30.505667  9852 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.575875  9852 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:30.577196  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:30.577870  4255 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:30.583969  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18524a049aa4e8687009c73a015e710" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:30.584632  4986 raft_consensus.cc:3060] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:30.589044  9897 log.cc:927] Time spent T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
I20260709 12:22:30.602236  9857 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:30.608062  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:30.610293  4986 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:30.611234  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:30.614230  4255 raft_consensus.cc:2468] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:30.618716  4408 raft_consensus.cc:2410] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:22:30.618867  4296 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:30.620237  9530 raft_consensus.cc:2804] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:30.620878  9530 raft_consensus.cc:697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:30.625326  9530 consensus_queue.cc:237] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:30.637804  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:30.641783  9857 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:30.654979  4988 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:30.656874  9698 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:22:30.685927  4255 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:30.687448  9852 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:22:30.729043  4152 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 372) took 11801 ms (client timeout 15000 ms). Trace:
I20260709 12:22:30.733142  4989 raft_consensus.cc:1275] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:30.734754  4153 catalog_manager.cc:5697] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 15, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.737715  9852 consensus_queue.cc:1048] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:30.742775  4408 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:30.744590  9852 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:30.745779  4153 catalog_manager.cc:5697] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 13 to 15, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.747200  4153 catalog_manager.cc:5697] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 13 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.748898  4153 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 13 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.751979  4153 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 13 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:30.736692  4152 rpcz_store.cc:269] 0709 12:22:18.927441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.927770 (+   329us) service_pool.cc:224] Handling call
0709 12:22:30.728959 (+11801189us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:29.807390 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:29.808239 (+   849us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:29.808310 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:22:29.808337 (+    27us) tablet.cc:662] Decoding operations
0709 12:22:29.837575 (+ 29238us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:29.873950 (+ 36375us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:29.877060 (+  3110us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:22:29.884942 (+  7882us) tablet.cc:701] Row locks acquired
0709 12:22:29.884997 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:22:29.885167 (+   170us) write_op.cc:270] Start()
0709 12:22:29.885322 (+   155us) write_op.cc:276] Timestamp: P: 1783599749885107 usec, L: 0
0709 12:22:29.885345 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:22:29.886049 (+   704us) log.cc:844] Serialized 5890 byte log entry
0709 12:22:30.498275 (+612226us) op_driver.cc:464] REPLICATION: finished
0709 12:22:30.567139 (+ 68864us) write_op.cc:301] APPLY: starting
0709 12:22:30.615249 (+ 48110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:30.670544 (+ 55295us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:30.671162 (+   618us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:30.693145 (+ 21983us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:30.693535 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:22:30.693592 (+    57us) write_op.cc:312] APPLY: finished
0709 12:22:30.693937 (+   345us) log.cc:844] Serialized 139 byte log entry
0709 12:22:30.694104 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.694268 (+   164us) write_op.cc:454] Released schema lock
0709 12:22:30.694319 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:30.694732 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.694760 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":63139,"apply.run_cpu_time_us":20498,"apply.run_wall_time_us":132980,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":205728,"prepare.run_cpu_time_us":18349,"prepare.run_wall_time_us":198585,"raft.queue_time_us":164042,"raft.run_cpu_time_us":13996,"raft.run_wall_time_us":92851,"replication_time_us":603691,"thread_start_us":288994,"threads_started":4,"wal-append.queue_time_us":172275}]]}
I20260709 12:22:30.758335  4153 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 14 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.761622  4153 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 10, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.763635  4153 catalog_manager.cc:5697] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 17, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 17 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.765034  4153 catalog_manager.cc:5697] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 13, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.766462  4153 catalog_manager.cc:5697] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.768142  4153 catalog_manager.cc:5697] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 15, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 15 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.769603  4153 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 12, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 12 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.771003  4153 catalog_manager.cc:5697] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 12 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.772543  4153 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 16, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 16 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.774035  4153 catalog_manager.cc:5697] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.775609  4153 catalog_manager.cc:5697] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 13, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.780479  4153 catalog_manager.cc:5697] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 15, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.785852  4988 raft_consensus.cc:1275] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:22:30.786653  4153 catalog_manager.cc:5697] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.787837  9530 consensus_queue.cc:1048] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:30.788079  4153 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.795536  4989 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:30.789465  4153 catalog_manager.cc:5697] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.801792  9530 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:30.812466  4153 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 6 to 11, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 11 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:30.814369  4153 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 11, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.816725  4153 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.818442  4153 catalog_manager.cc:5697] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 15 to 16, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:30.820538  4153 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 9 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 11 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.862972  4255 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:30.868031  9852 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:22:30.873545  4400 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:30.875171  9698 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:30.908013  4406 raft_consensus.cc:1275] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:22:30.912711  9530 consensus_queue.cc:1048] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:22:30.982239  4400 raft_consensus.cc:1275] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:22:30.984824  9864 consensus_queue.cc:1048] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:30.985260  4986 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:22:30.986858  9874 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:31.080068  4988 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:31.082234  9864 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:31.172888  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:31.210700  4249 raft_consensus.cc:1275] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:22:31.212687  9864 consensus_queue.cc:1048] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:31.318512  4153 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 17, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 17 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.320482  4153 catalog_manager.cc:5697] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:31.344395  4148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 392) took 23050 ms (client timeout 15000 ms). Trace:
W20260709 12:22:31.345273  4148 rpcz_store.cc:269] 0709 12:22:08.340397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.394991 (+ 54594us) service_pool.cc:224] Handling call
0709 12:22:31.344177 (+22949186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5536,"reported_tablets":45}
I20260709 12:22:31.346287  4986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:31.346992  4986 raft_consensus.cc:606] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:31.323691  4153 catalog_manager.cc:5697] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 7 to 10, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 10 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.355759  4153 catalog_manager.cc:5697] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 13, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.357539  4153 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 15 to 18, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 18 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.359282  4153 catalog_manager.cc:5697] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 14 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:31.361019  4153 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 17, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 17 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:31.362680  4153 catalog_manager.cc:5697] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 11 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } }
I20260709 12:22:31.364389  9868 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:31.365041  9868 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.368306  9868 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:31.382263  4255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:31.383210  4255 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:31.389384  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:31.390142  4989 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:31.392122  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:31.394618  9876 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:31.395097  9876 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:31.395555  9876 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.396538  4986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:31.397203  4986 raft_consensus.cc:606] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:31.412544  4986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66d0cf9ce16c45e399c41f8f0bfb5e32"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:31.413153  4986 raft_consensus.cc:606] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:31.413554  4986 raft_consensus.cc:614] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:31.443665  9876 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.446267  9876 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:31.450344  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:31.451830  4249 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 12: Already voted for candidate 0aa405b398df42edbf74ee643aeb18dc in this term.
I20260709 12:22:31.453961  4989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:31.454608  4989 raft_consensus.cc:606] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:31.461438  4406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e070006215b747e39d88b78e59a78364"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:31.462066  4406 raft_consensus.cc:606] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:31.463742  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:31.466195  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:31.467185  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:31.480603  9857 raft_consensus.cc:993] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:31.481182  9857 raft_consensus.cc:1081] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:31.483366  4327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:22:31.483983  4327 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:31.484427  4327 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.487644  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:31.495244  4989 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:22:31.496282  4327 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.514196  9205 raft_consensus.cc:993] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:31.514855  9205 raft_consensus.cc:1081] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:31.526330  4327 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:31.530821  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:31.531467  4406 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:31.531430  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:31.532570  4334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:22:31.533159  4334 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:31.533532  4334 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:31.540195  4406 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 17.
I20260709 12:22:31.543731  9695 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:31.544354  9695 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:31.545331  9695 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.547758  4296 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:31.548723  9864 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:31.549121  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:31.549690  9864 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:31.550067  4989 raft_consensus.cc:3055] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:31.550699  4989 raft_consensus.cc:740] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:31.550814  9864 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.552040  4989 consensus_queue.cc:260] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.553745  4989 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:22:31.561463  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 50768.7us
I20260709 12:22:31.580464  4334 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.590728  4989 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 17.
I20260709 12:22:31.585198  4152 catalog_manager.cc:5697] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.600795  4152 catalog_manager.cc:5697] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 8 to 12, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.604264  4152 catalog_manager.cc:5697] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 13 to 14, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.605711  4152 catalog_manager.cc:5697] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 13 to 15, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 15 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.607077  4152 catalog_manager.cc:5697] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.611333  4334 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:31.613489  4989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:31.614064  4989 raft_consensus.cc:3055] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:31.614339  4989 raft_consensus.cc:740] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:31.616598  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:31.617244  4406 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:31.618414  4989 consensus_queue.cc:260] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.638264  4406 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:31.640033  4296 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:31.644925  9866 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:31.645591  9866 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:31.646519  9866 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.656713  4989 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:31.675333  4989 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 11.
I20260709 12:22:31.640564  4152 catalog_manager.cc:5697] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 8 to 10, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 10 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.686411  4152 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.688488  4152 catalog_manager.cc:5697] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 9 to 10, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:31.729094  9205 raft_consensus.cc:993] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:31.729755  9205 raft_consensus.cc:1081] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:31.739365  4332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:22:31.740226  4332 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:31.740643  4332 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.762710  9699 raft_consensus.cc:993] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:31.775997  9699 raft_consensus.cc:1081] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
W20260709 12:22:31.794476  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 52614.9us
I20260709 12:22:31.797099  4332 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.808995  4252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e070006215b747e39d88b78e59a78364"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:22:31.819392  4252 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:31.820742  4252 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:31.843449  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 162382us
I20260709 12:22:31.861126  4986 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } }
I20260709 12:22:31.875811  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:31.876482  4403 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.879439  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:31.880183  4992 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:31.880472  4992 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:31.881192  4992 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:31.882378  4992 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:31.883920  4403 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:31.885071  4332 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:31.865036  4252 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:31.892030  4296 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:31.895912  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:31.902542  4327 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:31.903092  4334 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.903553  4406 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:22:31.904253  9928 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:31.906523  9864 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:31.907022  9864 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:31.907912  9864 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:31.909694  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.910688  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:31.911324  4406 raft_consensus.cc:3055] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:31.911594  4406 raft_consensus.cc:740] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:31.912335  4406 consensus_queue.cc:260] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:31.913370  4406 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:31.916338  4334 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:31.917634  4219 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:31.918393  9597 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:31.918887  9597 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:31.919842  9597 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:31.896652  4252 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:31.889613  4992 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:31.943439  9927 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Committing config change with OpId 16.15: config changed from index 9 to 15, NON_VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } } }
I20260709 12:22:31.945307  9928 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:31.949278  4406 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:31.949415  4327 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 9 to 15, NON_VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } } }
I20260709 12:22:31.974702  4252 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:31.978943  9699 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:22:31.994283  9934 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:31.996351  4149 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 9 to 10, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.012703  4403 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 9 to 15, NON_VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } } }
I20260709 12:22:32.036386  4986 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:32.042757  4986 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:32.046522  9864 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:32.051146  9706 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:22:32.081466  4990 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:32.088888  9695 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:22:32.142366  4403 raft_consensus.cc:1275] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:22:32.144949  9706 consensus_queue.cc:1048] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:22:32.190405  4149 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 393) took 4982 ms. Trace:
I20260709 12:22:32.191468  4149 rpcz_store.cc:276] 0709 12:22:27.211082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.213328 (+  2246us) service_pool.cc:224] Handling call
0709 12:22:32.190316 (+4976988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:32.087621 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:32.088129 (+   508us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:32.088157 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:22:32.088176 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:32.089729 (+  1553us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:32.089781 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:32.089808 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:32.089987 (+   179us) tablet.cc:701] Row locks acquired
0709 12:22:32.090003 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:32.090143 (+   140us) write_op.cc:270] Start()
0709 12:22:32.096247 (+  6104us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b540018b1a8. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb713a9e1 00007fdbb713964c 00007fdbb47c9624 00007fdbb47b4286 00007fdbb47b3d58 00007fdbb47b89f1 00007fdbb47b89a9 00007fdbb47b8939 00007fdbb47b8901 00007fdbb47b7b2d 0000000000388634
0709 12:22:32.096453 (+   206us) write_op.cc:276] Timestamp: P: 1783599752090097 usec, L: 0
0709 12:22:32.096475 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:22:32.097099 (+   624us) log.cc:844] Serialized 530 byte log entry
0709 12:22:32.099526 (+  2427us) op_driver.cc:464] REPLICATION: finished
0709 12:22:32.099874 (+   348us) write_op.cc:301] APPLY: starting
0709 12:22:32.099968 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:32.100788 (+   820us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:32.100813 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:32.101537 (+   724us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:32.101703 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:22:32.101751 (+    48us) write_op.cc:312] APPLY: finished
0709 12:22:32.101936 (+   185us) log.cc:844] Serialized 25 byte log entry
0709 12:22:32.102105 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:32.102186 (+    81us) write_op.cc:454] Released schema lock
0709 12:22:32.102225 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:32.102681 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:32.102714 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":2754,"apply.run_wall_time_us":2753,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":5009,"prepare.run_wall_time_us":16129,"replication_time_us":2937,"spinlock_wait_cycles":3100032}]]}
W20260709 12:22:32.659932  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 95335.1us
I20260709 12:22:32.733111  4406 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:32.744098  9971 ts_tablet_manager.cc:933] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Initiating tablet copy from peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:32.681565  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:32.777424  4327 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:32.813221  4400 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:32.814881  9952 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:32.824699  9970 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:32.844060  4149 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 12 to 13, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 13 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.845748  4149 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:32.859066  4990 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:22:32.868196  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 62322us
W20260709 12:22:32.880165  4150 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60310 (request call id 391) took 40911 ms (client timeout 15000 ms). Trace:
W20260709 12:22:32.880745  4150 rpcz_store.cc:269] 0709 12:21:51.968783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:51.969018 (+   235us) service_pool.cc:224] Handling call
0709 12:21:52.823052 (+854034us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b540018b354. stack: 00007fdbadc5f343 00007fdbadc5f240 00007fdbad5ee1d4 00007fdbb732c304 00007fdbb732c299 00007fdbb0ce8090 00007fdbb0d86f3a 00007fdbb6b3ce9c 00007fdbb6c3b04e 00007fdbb50fc2a4 00007fdbb50fc232 00007fdbb50fc161 00007fdbb50fc0dc 00007fdbb50fb392 00007fdbaf0b948c 00007fdbaf0b88c6
0709 12:22:32.879912 (+40056860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158067,"reported_tablets":45,"spinlock_wait_cycles":107947776}
I20260709 12:22:32.927587  9971 tablet_copy_client.cc:323] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.132:43853
I20260709 12:22:32.939553  5002 tablet_copy_service.cc:140] P 0952d204644f41a88e5e463e697dcc27: Received BeginTabletCopySession request for tablet c18183fd904d43f68b0e600ddb8ae249 from peer 0aa405b398df42edbf74ee643aeb18dc ({username='slave'} at 127.0.0.1:52880)
I20260709 12:22:32.940209  5002 tablet_copy_service.cc:161] P 0952d204644f41a88e5e463e697dcc27: Beginning new tablet copy session on tablet c18183fd904d43f68b0e600ddb8ae249 from peer 0aa405b398df42edbf74ee643aeb18dc at {username='slave'} at 127.0.0.1:52880: session id = 0aa405b398df42edbf74ee643aeb18dc-c18183fd904d43f68b0e600ddb8ae249
I20260709 12:22:32.953615  5002 tablet_copy_source_session.cc:215] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:32.969731  9971 ts_tablet_manager.cc:1916] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260709 12:22:32.974820  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48513.8us
I20260709 12:22:32.989668  4406 raft_consensus.cc:1275] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:32.993003  4408 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:32.973106  9866 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:22:33.033694  9971 ts_tablet_manager.cc:1929] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 6.8
I20260709 12:22:33.035018  9971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18183fd904d43f68b0e600ddb8ae249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:33.052932  9971 tablet_copy_client.cc:806] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:33.053534  9971 tablet_copy_client.cc:670] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:33.125836  9971 tablet_copy_client.cc:538] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:22:33.145605  4151 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 371) took 34875 ms (client timeout 15000 ms). Trace:
W20260709 12:22:33.146065  4151 rpcz_store.cc:269] 0709 12:21:58.265570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.265794 (+   224us) service_pool.cc:224] Handling call
0709 12:22:33.140809 (+34875015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83023,"reported_tablets":46,"spinlock_wait_cycles":788352}
I20260709 12:22:33.172003  4408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c970994e11f4080b5624db5219101b4"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:33.172640  4408 raft_consensus.cc:606] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
W20260709 12:22:33.181347  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 76853.8us
I20260709 12:22:33.184893  4990 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:33.188198  4250 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:22:33.196946  4400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:33.198077  4400 raft_consensus.cc:606] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Received request to transfer leadership to TS b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:33.202351  9864 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:22:33.203936  4150 catalog_manager.cc:5697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 16 to 17, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 17 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:33.198596  9950 consensus_queue.cc:1048] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:22:33.215834  4150 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 9 to 15, NON_VOTER 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) added. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } } }
I20260709 12:22:33.229257  4987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:45936
I20260709 12:22:33.229997  4987 raft_consensus.cc:606] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:33.235674  9971 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap starting.
I20260709 12:22:33.242079  4403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:33.242806  4403 raft_consensus.cc:606] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:33.249547  9984 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:33.251020  4401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:33.251713  4401 raft_consensus.cc:606] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:33.257398  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:33.259447  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.259325  9725 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:33.260571  9980 raft_consensus.cc:993] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.263523  9969 raft_consensus.cc:1081] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.281950  4250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:22:33.282688  4250 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.283152  4250 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:33.281450  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.352217  4250 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:33.372211  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 53446.1us
I20260709 12:22:33.385624  4250 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:33.387569  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:33.388370  4329 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:33.410827  4147 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50716 (request call id 264) took 4684 ms. Trace:
I20260709 12:22:33.428752  4329 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 15.
I20260709 12:22:33.430176  4219 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:33.431037  9881 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:33.431641  9881 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 15 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:33.432636  9881 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.421352  4147 rpcz_store.cc:276] 0709 12:22:28.726238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.726566 (+   328us) service_pool.cc:224] Handling call
0709 12:22:33.410688 (+4684122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35949,"reported_tablets":45}
I20260709 12:22:33.445233  9993 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 7 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:33.447567  9699 raft_consensus.cc:993] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.469018  4333 raft_consensus.cc:1240] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 14. Current term is 15. Ops: []
I20260709 12:22:33.469434  9699 raft_consensus.cc:1081] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
W20260709 12:22:33.450019  9986 log.cc:927] Time spent T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
I20260709 12:22:33.453099  4152 catalog_manager.cc:5697] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 10 to 11, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 11 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.473923  9699 consensus_queue.cc:1059] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:33.474888  9699 raft_consensus.cc:3055] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:22:33.475224  9699 raft_consensus.cc:740] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:33.476078  9699 consensus_queue.cc:260] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.484427  9699 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:22:33.494319  4152 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 11 to 12, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:33.496207  4147 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 14 to 15, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 15 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:33.500459  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 57891.7us
I20260709 12:22:33.506690  9969 raft_consensus.cc:993] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: : Instructing follower b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:33.507231  9695 raft_consensus.cc:1081] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Signalling peer b3efae3bdfff46bb9bbff1ed1ea70a90 to start an election
I20260709 12:22:33.509331  4333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa"
dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
 from {username='slave'} at 127.0.0.1:55256
I20260709 12:22:33.509920  4333 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.510344  4333 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:33.542927  4333 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.560537  4250 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 7 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:33.568493  4255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c970994e11f4080b5624db5219101b4"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:22:33.569063  4255 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.569396  4255 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.564639  4990 raft_consensus.cc:2955] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 7 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:33.571686  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:33.573953  4333 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:33.573415  4249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:33.574983  4249 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:33.583941  4255 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.597466  9959 raft_consensus.cc:993] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.597991  9959 raft_consensus.cc:1081] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.598649  4255 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:33.599251  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:33.599912  4986 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.605366  4403 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.612932  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78ee025f73f248629704f4ff6eaad5a0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:33.618781  4152 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49194 (request call id 374) took 1683 ms. Trace:
I20260709 12:22:33.619251  4152 rpcz_store.cc:276] 0709 12:22:31.935570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.935867 (+   297us) service_pool.cc:224] Handling call
0709 12:22:33.618689 (+1682822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:33.497828 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:33.498357 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:33.498390 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:22:33.498418 (+    28us) tablet.cc:662] Decoding operations
0709 12:22:33.498794 (+   376us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:33.498843 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:33.498870 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:22:33.499209 (+   339us) tablet.cc:701] Row locks acquired
0709 12:22:33.499231 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:22:33.499484 (+   253us) write_op.cc:270] Start()
0709 12:22:33.499637 (+   153us) write_op.cc:276] Timestamp: P: 1783599753499429 usec, L: 0
0709 12:22:33.499662 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:22:33.500480 (+   818us) log.cc:844] Serialized 907 byte log entry
0709 12:22:33.602994 (+102514us) op_driver.cc:464] REPLICATION: finished
0709 12:22:33.605882 (+  2888us) write_op.cc:301] APPLY: starting
0709 12:22:33.605961 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:33.607179 (+  1218us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:33.607269 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:33.608517 (+  1248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:33.608685 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:22:33.608727 (+    42us) write_op.cc:312] APPLY: finished
0709 12:22:33.610251 (+  1524us) log.cc:844] Serialized 33 byte log entry
0709 12:22:33.610418 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:33.610499 (+    81us) write_op.cc:454] Released schema lock
0709 12:22:33.610538 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:33.611590 (+  1052us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:33.611617 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":112185,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":2680,"apply.run_cpu_time_us":3652,"apply.run_wall_time_us":5665,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":212,"prepare.run_cpu_time_us":2960,"prepare.run_wall_time_us":2961,"replication_time_us":103166}]]}
W20260709 12:22:33.648916  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51758.1us
I20260709 12:22:33.622679  4986 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 17.
I20260709 12:22:33.635898  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:33.651877  4400 raft_consensus.cc:3055] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:33.652300  4400 raft_consensus.cc:740] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:33.619693  4249 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:33.656159  4408 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 15.
I20260709 12:22:33.636781  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:33.657511  4401 raft_consensus.cc:3055] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:22:33.657853  4401 raft_consensus.cc:740] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:33.662858  4296 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:33.653271  4400 consensus_queue.cc:260] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.665876  4400 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.658643  4401 consensus_queue.cc:260] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.626574  9957 raft_consensus.cc:993] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.676018  4249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:57876
I20260709 12:22:33.677835  9530 raft_consensus.cc:2804] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:33.674099  4218 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:33.679361  4249 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.695470  4401 raft_consensus.cc:3060] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:33.679847  4249 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.707243  9992 raft_consensus.cc:1081] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:33.710784  9530 raft_consensus.cc:697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:33.707960  4990 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:33.686349  4400 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 17.
I20260709 12:22:33.722313  4401 raft_consensus.cc:2468] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 12.
I20260709 12:22:33.721807  4249 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.724215  9530 consensus_queue.cc:237] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.735198  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:33.735787  4333 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.747536  4250 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:22:33.748752  4250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:22:33.749293  4250 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.749616  4250 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:33.748488  9956 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:22:33.725239  9952 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:33.764155  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:33.764760  4990 raft_consensus.cc:3055] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:22:33.765043  4990 raft_consensus.cc:740] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:33.768992  9969 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:33.771903  4990 consensus_queue.cc:260] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.772464  9952 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 17 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:33.773295  4990 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:22:33.773629  9952 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.775875  4250 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.757835  4249 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:33.757953  4333 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 17.
W20260709 12:22:33.836097  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 47299.6us
I20260709 12:22:33.838514  4250 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 18 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:33.840984  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63372.5us
I20260709 12:22:33.840550  4219 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:33.859169  4219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 66733.9us
I20260709 12:22:33.860692  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:33.861343  4333 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:33.865024  4990 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 17.
I20260709 12:22:33.872839  4150 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c reported cstate change: config changed from index 7 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.881291  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:33.882007  4406 raft_consensus.cc:3055] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:22:33.882416  4406 raft_consensus.cc:740] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:33.883253  4406 consensus_queue.cc:260] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:33.869210  9970 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:22:33.890815  9970 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 17 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:33.885947  4333 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 18.
I20260709 12:22:33.907065  4326 raft_consensus.cc:1240] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 17. Current term is 18. Ops: []
I20260709 12:22:33.907222  9970 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:33.915428  4219 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:33.925532  9881 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:33.928467  9881 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 18 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
W20260709 12:22:33.986395 10009 log.cc:927] Time spent T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:22:33.988794  4406 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:34.040485 10007 log.cc:927] Time spent T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:22:34.041147  4405 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:34.041923  9957 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 6 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:34.044523 10001 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:34.045938  4406 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 18.
I20260709 12:22:34.057971  9881 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:34.069423  4329 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:22:34.061995  4151 catalog_manager.cc:5697] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 11 to 12, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 12 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.081171  4992 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 6 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:34.086221 10003 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:22:34.177048 10010 log.cc:927] Time spent T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:22:34.214777  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 78ee025f73f248629704f4ff6eaad5a0 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50060
W20260709 12:22:34.344319  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 138943us
I20260709 12:22:34.357379  4250 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:34.345049 10018 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:34.404631 10018 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:34.408136 10018 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:34.453562  9960 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:34.454149  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:34.454689  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:34.457938  4329 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:22:34.467348 10020 tablet_replica.cc:333] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:22:34.468513 10020 raft_consensus.cc:2243] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:34.469435 10020 raft_consensus.cc:2272] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:34.490377  9970 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:22:34.497221  4151 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 17 to 18, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 18 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.499893  4151 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 16 to 17, leader changed from 0952d204644f41a88e5e463e697dcc27 (127.3.7.132) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 17 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.502281 10020 ts_tablet_manager.cc:1916] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:34.501775  4151 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 16 to 17, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 17 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.505837  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 374e8fa3690a41af9874f32b270bf3e1 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:34.536331  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.568943  4151 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 6 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 10 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
I20260709 12:22:34.575140  4990 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:34.576894  4990 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:22:34.578037  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 193548us
I20260709 12:22:34.584681  4252 raft_consensus.cc:2955] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 6 to 10, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } }
W20260709 12:22:34.591329  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 66119.8us
I20260709 12:22:34.593003  4296 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:34.567137  9971 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:22:34.605824  4296 raft_consensus.cc:2686] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:22:34.612829  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 232583us
I20260709 12:22:34.617398 10001 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:22:34.623867  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 257925us
I20260709 12:22:34.643491  9970 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:34.647064  9971 tablet_bootstrap.cc:492] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Bootstrap complete.
I20260709 12:22:34.648018  9971 ts_tablet_manager.cc:1403] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Time spent bootstrapping tablet: real 1.414s	user 0.057s	sys 0.045s
I20260709 12:22:34.654801  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet 374e8fa3690a41af9874f32b270bf3e1 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50060
W20260709 12:22:34.779251  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 105223us
I20260709 12:22:34.781919 10006 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:22:34.782557 10006 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:34.785379 10006 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:34.791374  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 117565us
I20260709 12:22:34.793007  4329 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:22:34.798805 10020 ts_tablet_manager.cc:1929] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 12:22:34.814110  4250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aa405b398df42edbf74ee643aeb18dc" is_pre_election: true
I20260709 12:22:34.824976  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:34.829797  9971 raft_consensus.cc:359] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } }
I20260709 12:22:34.830776  9971 raft_consensus.cc:740] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Initialized, Role: LEARNER
I20260709 12:22:34.831463  9971 consensus_queue.cc:260] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: NON_VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: true } }
I20260709 12:22:34.832758  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:34.841732  4406 raft_consensus.cc:1275] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:22:34.849572  4406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:34.850315  4406 raft_consensus.cc:606] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:34.852257  9971 ts_tablet_manager.cc:1434] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: Time spent starting tablet: real 0.204s	user 0.007s	sys 0.008s
I20260709 12:22:34.854830  4252 raft_consensus.cc:1217] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 LEARNER]: Deduplicated request from leader. Original: 16.14->[16.15-16.15]   Dedup: 16.15->[]
I20260709 12:22:34.820375 10020 log.cc:1199] T 78ee025f73f248629704f4ff6eaad5a0 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/78ee025f73f248629704f4ff6eaad5a0
W20260709 12:22:34.867494 10039 log.cc:927] Time spent T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:22:34.870425  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:34.874118  4296 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:34.885818  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:34.887281 10029 raft_consensus.cc:993] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:22:34.906819 10030 raft_consensus.cc:1081] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:22:34.920660 10003 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:34.905344  4405 raft_consensus.cc:606] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
W20260709 12:22:34.925810  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51771.1us
I20260709 12:22:34.927796  9963 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:22:34.986927  4406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:35.005530  4406 raft_consensus.cc:606] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Received request to transfer leadership to TS 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:35.027052  4405 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:22:35.009290  5002 tablet_copy_service.cc:342] P 0952d204644f41a88e5e463e697dcc27: Request end of tablet copy session 0aa405b398df42edbf74ee643aeb18dc-c18183fd904d43f68b0e600ddb8ae249 received from {username='slave'} at 127.0.0.1:52880
I20260709 12:22:35.057153 10020 tablet_replica.cc:333] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:22:35.049772  5002 tablet_copy_service.cc:434] P 0952d204644f41a88e5e463e697dcc27: ending tablet copy session 0aa405b398df42edbf74ee643aeb18dc-c18183fd904d43f68b0e600ddb8ae249 on tablet c18183fd904d43f68b0e600ddb8ae249 with peer 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:35.073899  4403 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:22:35.125765 10002 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:22:35.185349  4990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:22:35.186162  4990 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.186620  4990 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.199252  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 78ee025f73f248629704f4ff6eaad5a0 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:22:35.163187 10006 consensus_queue.cc:1048] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:22:35.223641  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 106659us
I20260709 12:22:35.256052 10020 raft_consensus.cc:2243] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.256774 10020 raft_consensus.cc:2272] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.259987 10020 ts_tablet_manager.cc:1916] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:35.247085  4990 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.270875  4986 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:35.272357  4990 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:35.273057  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 51328.7us
W20260709 12:22:35.273083  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 147536us
I20260709 12:22:35.314827  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:35.315470  4406 raft_consensus.cc:3055] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:22:35.315819  4406 raft_consensus.cc:740] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:35.316622  4406 consensus_queue.cc:260] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.317570  4406 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:22:35.319568  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 45825.1us
I20260709 12:22:35.320832  4405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f"
dest_uuid: "899897e6794541b5ab538af361fc9e6c"
mode: GRACEFUL
new_leader_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:22:35.323154  4405 raft_consensus.cc:606] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Received request to transfer leadership to TS 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:35.341325  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:35.343321  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.344738  4406 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:35.346354  4955 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:35.347287 10031 raft_consensus.cc:2804] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:35.347890 10031 raft_consensus.cc:697] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:35.348775 10031 consensus_queue.cc:237] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.357298  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.360553  4252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:35.361235  4252 raft_consensus.cc:3060] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:35.369293  4252 raft_consensus.cc:2468] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
W20260709 12:22:35.370371  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48369.6us
I20260709 12:22:35.376803 10002 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:35.395921  4253 raft_consensus.cc:1240] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 10. Current term is 11. Ops: []
I20260709 12:22:35.421465 10028 raft_consensus.cc:1064] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: attempting to promote NON_VOTER 0aa405b398df42edbf74ee643aeb18dc to VOTER
I20260709 12:22:35.442569  9966 raft_consensus.cc:993] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:22:35.443156  9966 raft_consensus.cc:1081] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:22:35.462652  4990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:22:35.463471  4990 raft_consensus.cc:493] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.463824  4990 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.512737  4990 raft_consensus.cc:515] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.474074 10028 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 13, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } }
I20260709 12:22:35.549875  4248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
I20260709 12:22:35.550509  4248 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.551582  4990 leader_election.cc:290] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:35.569948  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ee025f73f248629704f4ff6eaad5a0" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:35.570942  4401 raft_consensus.cc:3055] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:35.571544  4401 raft_consensus.cc:740] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:35.572685  4401 consensus_queue.cc:260] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.574545  4401 raft_consensus.cc:3060] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:35.611469  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 74546.5us
I20260709 12:22:35.617460  4401 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:35.624503  4248 raft_consensus.cc:2468] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:35.626469  4955 leader_election.cc:304] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:35.629372  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 90312.4us
W20260709 12:22:35.640717  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 199874us
I20260709 12:22:35.629745 10019 raft_consensus.cc:2804] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:35.643985 10019 raft_consensus.cc:697] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:35.644958 10019 consensus_queue.cc:237] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.661437  4152 catalog_manager.cc:5697] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 10 to 11, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 11 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.711037 10046 raft_consensus.cc:993] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:22:35.711690 10046 raft_consensus.cc:1081] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Signalling peer 0952d204644f41a88e5e463e697dcc27 to start an election
I20260709 12:22:35.728843  4986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2"
dest_uuid: "0952d204644f41a88e5e463e697dcc27"
 from {username='slave'} at 127.0.0.1:52864
I20260709 12:22:35.729671  4986 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.730060  9957 raft_consensus.cc:993] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: : Instructing follower 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:35.730563  9957 raft_consensus.cc:1081] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Signalling peer 0aa405b398df42edbf74ee643aeb18dc to start an election
I20260709 12:22:35.730129  4986 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.745036  4253 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:35.762262  9953 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:35.763512  4253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f"
dest_uuid: "0aa405b398df42edbf74ee643aeb18dc"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:22:35.764135  4253 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:35.764503  4253 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.765549  4986 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.768572  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:35.769114  4329 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.773383  4986 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:35.766068 10020 ts_tablet_manager.cc:1929] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:22:35.778559  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:35.786516  4401 raft_consensus.cc:3055] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:35.786970  4401 raft_consensus.cc:740] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:35.787851  4401 consensus_queue.cc:260] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.780189  4253 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.789247  4401 raft_consensus.cc:3060] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:35.798336  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:35.798771  4401 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:35.800051  4955 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:35.799067  4405 raft_consensus.cc:3055] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:35.802002  4405 raft_consensus.cc:740] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:35.804118  4253 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Requested vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:35.788110 10020 log.cc:1199] T 374e8fa3690a41af9874f32b270bf3e1 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/374e8fa3690a41af9874f32b270bf3e1
I20260709 12:22:35.802819  4405 consensus_queue.cc:260] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.809643  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:35.809886  4405 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.810256  4987 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:35.824010  4403 raft_consensus.cc:1275] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:22:35.824739  4326 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:22:35.813969 10033 raft_consensus.cc:2804] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:35.826630 10033 raft_consensus.cc:697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:35.829078  4253 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 LEARNER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:22:35.833190 10045 consensus_queue.cc:1048] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:35.834633 10045 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:35.844558 10019 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:22:35.861956  4329 raft_consensus.cc:2468] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:35.830220  4401 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 12:22:35.871435  9810 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:22:35.874473 10020 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50060 (request call id 4) took 1220 ms. Trace:
I20260709 12:22:35.874951 10020 rpcz_store.cc:276] 0709 12:22:34.654311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.654622 (+   311us) service_pool.cc:224] Handling call
0709 12:22:35.056793 (+402171us) ts_tablet_manager.cc:1151] Deleting tablet 374e8fa3690a41af9874f32b270bf3e1
0709 12:22:35.056853 (+    60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:35.465067 (+408214us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:35.765932 (+300865us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:35.874377 (+108445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197632,"tablet-delete.queue_time_us":401340}
I20260709 12:22:35.871083 10033 consensus_queue.cc:237] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:35.876670  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet 374e8fa3690a41af9874f32b270bf3e1 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
I20260709 12:22:35.892515  4987 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:35.902737  4405 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa405b398df42edbf74ee643aeb18dc in term 13.
I20260709 12:22:35.909531  4218 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc; no voters: 
I20260709 12:22:35.914335 10001 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:35.914904 10001 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Becoming Leader. State: Replica: 0aa405b398df42edbf74ee643aeb18dc, State: Running, Role: LEADER
I20260709 12:22:35.915882 10001 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:35.960158 10067 log.cc:927] Time spent T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:22:35.988672  4252 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Committing config change with OpId 16.16: config changed from index 15 to 16, 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:35.986711 10047 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Committing config change with OpId 16.16: config changed from index 15 to 16, 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.057137  4152 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: term changed from 12 to 13, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129). New cstate: current_term: 13 leader_uuid: "0aa405b398df42edbf74ee643aeb18dc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:36.066884  4327 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Committing config change with OpId 16.16: config changed from index 15 to 16, 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.068712  4408 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Committing config change with OpId 16.16: config changed from index 15 to 16, 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.086349  4253 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:36.087915  9810 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:36.062796  4147 catalog_manager.cc:5697] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 13 to 14, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.098773  4147 catalog_manager.cc:5697] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 13 to 14, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.127059  4152 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 15 to 16, 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { replace: true } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.193511  4408 raft_consensus.cc:1275] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:36.197822 10033 consensus_queue.cc:1048] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:36.352793  4408 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:22:36.359593 10045 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:36.370795  4327 raft_consensus.cc:1275] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:22:36.372627 10045 consensus_queue.cc:1048] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:22:36.400319  4408 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:36.403486 10001 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:22:36.426707  4987 consensus_queue.cc:237] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 16.16, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } }
I20260709 12:22:36.439898  4252 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
I20260709 12:22:36.444583 10045 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:22:36.449170  4401 raft_consensus.cc:1275] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
I20260709 12:22:36.452625 10045 consensus_queue.cc:1048] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:22:36.458385  4252 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Committing config change with OpId 16.17: config changed from index 16 to 17, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.509749  4987 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Refusing update from remote peer 0aa405b398df42edbf74ee643aeb18dc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:22:36.455075 10027 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Committing config change with OpId 16.17: config changed from index 16 to 17, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.561952 10001 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 12:22:36.603039 10086 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:22:36.650676  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 116145us
I20260709 12:22:36.660081  4408 raft_consensus.cc:2955] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Committing config change with OpId 16.17: config changed from index 16 to 17, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
I20260709 12:22:36.727577  4137 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c18183fd904d43f68b0e600ddb8ae249 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:36.537206  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.740480  4151 catalog_manager.cc:5697] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc reported cstate change: config changed from index 16 to 17, VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) evicted. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } attrs { promote: false } } }
W20260709 12:22:36.779531  4218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 115632us
W20260709 12:22:36.779959  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 155522us
I20260709 12:22:36.872613  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
W20260709 12:22:36.872282  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 69063.5us
W20260709 12:22:36.863219 10086 log.cc:927] Time spent T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:36.874711  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.875460  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:36.932549  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 58297.6us
I20260709 12:22:37.062623  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:37.081630  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 137319us
W20260709 12:22:37.083619  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 150406us
W20260709 12:22:37.083912  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 117909us
W20260709 12:22:37.261566  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 146489us
W20260709 12:22:37.312424  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 57826us
I20260709 12:22:37.341569  4316 tablet_service.cc:1558] Processing DeleteTablet for tablet c18183fd904d43f68b0e600ddb8ae249 with delete_type TABLET_DATA_TOMBSTONED (TS b3efae3bdfff46bb9bbff1ed1ea70a90 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:50060
W20260709 12:22:37.423871  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 99702.7us
I20260709 12:22:37.520727 10118 tablet_replica.cc:333] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:22:37.521963 10118 raft_consensus.cc:2243] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.522920 10118 raft_consensus.cc:2272] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.525915 10118 ts_tablet_manager.cc:1916] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:37.553469  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
W20260709 12:22:37.557408  4371 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
W20260709 12:22:37.597067  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.626907  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.629595  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.653088  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.659404  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.664850  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.672794 10118 ts_tablet_manager.cc:1929] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.16
W20260709 12:22:37.675469  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.675179 10118 log.cc:1199] T c18183fd904d43f68b0e600ddb8ae249 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting WAL directory at /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/wals/c18183fd904d43f68b0e600ddb8ae249
I20260709 12:22:37.678282  4138 catalog_manager.cc:5028] TS b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): tablet c18183fd904d43f68b0e600ddb8ae249 (table test-workload [id=4d70f300ec2c42d3b22a38f5b26568e6]) successfully deleted
W20260709 12:22:37.700073  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.709014  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.725864  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.729138  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.746016  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.755494  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.765120  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.770797  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:22:37.770879  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.772105  3102 tablet_replica.cc:333] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.773778  3102 raft_consensus.cc:2243] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.775027  3102 raft_consensus.cc:2272] T 709bcc39a1e14a66abd5e1d758132d0a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:37.777328  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.777912  3102 tablet_replica.cc:333] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.781529  3102 raft_consensus.cc:2243] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.782716  3102 raft_consensus.cc:2272] T c64033b0103b421a95ee1540d4b31df5 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.787947  3102 tablet_replica.cc:333] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.790148  3102 raft_consensus.cc:2243] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.791226  3102 raft_consensus.cc:2272] T 7d321543daa94c458a2b9ed5e9d553a3 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:37.795728  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.819069  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.804229  3102 tablet_replica.cc:333] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.821007  3102 raft_consensus.cc:2243] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.822228  3102 raft_consensus.cc:2272] T 7935718b80b24232b822244ef31fa44b P 0aa405b398df42edbf74ee643aeb18dc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.847218  3102 tablet_replica.cc:333] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:22:37.862854  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:37.869614  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.871519  3102 raft_consensus.cc:2243] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.875669  3102 raft_consensus.cc:2272] T 6bee4570f5474c8f916b3144395312d5 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.886098  3102 tablet_replica.cc:333] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.887328  3102 raft_consensus.cc:2243] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.888163  3102 raft_consensus.cc:2272] T fdb68505c01944fb98aa2334aa5c28e9 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.891355  3102 tablet_replica.cc:333] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.892462  3102 raft_consensus.cc:2243] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.893244  3102 raft_consensus.cc:2272] T 6675e0fefdad403abd03803e0c2bf3dd P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.896294  3102 tablet_replica.cc:333] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.897241  3102 raft_consensus.cc:2243] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.898062  3102 raft_consensus.cc:2272] T 78ee025f73f248629704f4ff6eaad5a0 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.901342  3102 tablet_replica.cc:333] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.902318  3102 raft_consensus.cc:2243] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.903016  3102 raft_consensus.cc:2272] T 853b8c508a614bb4b9fdc0c62fe13342 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.906132  3102 tablet_replica.cc:333] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.908422  3102 raft_consensus.cc:2243] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.910542  3102 raft_consensus.cc:2272] T 34ae0ae4c14d4870b094e2733b40e647 P 0aa405b398df42edbf74ee643aeb18dc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.913635  3102 tablet_replica.cc:333] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:22:37.913954  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.914613  3102 raft_consensus.cc:2243] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.915599  3102 raft_consensus.cc:2272] T bac26358ed7f4644aa3f5b040afcdca4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.918650  3102 tablet_replica.cc:333] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.919708  3102 raft_consensus.cc:2243] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.920444  3102 raft_consensus.cc:2272] T 4d4dedbb3ee0412db92c974e0c25a776 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.924098  3102 tablet_replica.cc:333] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.925010  3102 raft_consensus.cc:2243] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.926119  3102 raft_consensus.cc:2272] T 7b29d30a957d40fdbc729fc5e9955b1b P 0aa405b398df42edbf74ee643aeb18dc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.930719  3102 tablet_replica.cc:333] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.931706  3102 raft_consensus.cc:2243] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.932499  3102 raft_consensus.cc:2272] T 1abb211136c54a29beecc019715aaa2d P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.939284  3102 tablet_replica.cc:333] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.940234  3102 raft_consensus.cc:2243] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.940933  3102 raft_consensus.cc:2272] T 4c52d75f63d54dbeba6b3c868117e4c4 P 0aa405b398df42edbf74ee643aeb18dc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.948367  3102 tablet_replica.cc:333] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.949278  3102 raft_consensus.cc:2243] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.950178  3102 raft_consensus.cc:2272] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.952817  3102 tablet_replica.cc:333] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.953701  3102 raft_consensus.cc:2243] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.954416  3102 raft_consensus.cc:2272] T 01f50fa8d8c34c06a67470615046629f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.957515  3102 tablet_replica.cc:333] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.958441  3102 raft_consensus.cc:2243] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.960011  3102 raft_consensus.cc:2272] T 6aa28105446e4c7c9261f9a99c5dc017 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.963269  3102 tablet_replica.cc:333] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:22:37.963642  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.964437  3102 raft_consensus.cc:2243] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.965263  3102 raft_consensus.cc:2272] T b18524a049aa4e8687009c73a015e710 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:37.969628  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.972200  3102 tablet_replica.cc:333] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.973341  3102 raft_consensus.cc:2243] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.974074  3102 raft_consensus.cc:2272] T a7d14a1bca614fe1af748ef119552803 P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.977074  3102 tablet_replica.cc:333] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.978055  3102 raft_consensus.cc:2243] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.978683  3102 raft_consensus.cc:2272] T 0d57b9080cd745529aba05aa6b7a640e P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.981529  3102 tablet_replica.cc:333] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:22:37.984171  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.991490  3102 raft_consensus.cc:2243] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.992928  3102 raft_consensus.cc:2272] T 446eb926cc6444ab93580e61ad7fc581 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.996420  3102 tablet_replica.cc:333] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:37.997892  3102 raft_consensus.cc:2243] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.998549  3102 raft_consensus.cc:2272] T a0fa0b9753bf4f05871dfa6b329de33a P 0aa405b398df42edbf74ee643aeb18dc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.001663  3102 tablet_replica.cc:333] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.002568  3102 raft_consensus.cc:2243] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.006989  3102 raft_consensus.cc:2272] T 2f35b6d3672d440581ae00175c31e5b7 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.023547  3102 tablet_replica.cc:333] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:22:38.024607  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.031948  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.033082  3102 raft_consensus.cc:2243] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.034257  3102 raft_consensus.cc:2272] T 89ea196b53354b90b1803ebad82f35ff P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.041604  3102 tablet_replica.cc:333] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.042748  3102 raft_consensus.cc:2243] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.043618  3102 raft_consensus.cc:2272] T 57d10956b3f84b66bce8c7e86299d1fa P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.046705  3102 tablet_replica.cc:333] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.055670  3102 raft_consensus.cc:2243] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.056944  3102 raft_consensus.cc:2272] T 520cf0102a3945aebdd2da293d919a52 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.066501  3102 tablet_replica.cc:333] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
W20260709 12:22:38.068638  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.071138  3102 raft_consensus.cc:2243] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.072034  3102 raft_consensus.cc:2272] T b22e067af7004ed88fb3125c7ac731ad P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:38.079680  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.082302  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.084601  3102 tablet_replica.cc:333] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.085937  3102 raft_consensus.cc:2243] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.094269  3102 raft_consensus.cc:2272] T 7092b1e5ebf04097a82982b4008c4d7e P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.099129  3102 tablet_replica.cc:333] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.104929  3102 raft_consensus.cc:2243] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.105686  3102 raft_consensus.cc:2272] T be5f00fff96847178a1970711feff2f0 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.108738  3102 tablet_replica.cc:333] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.112058  3102 raft_consensus.cc:2243] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.112769  3102 raft_consensus.cc:2272] T fd41dc8658414bcfb8662c0efe3caffc P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.115446  3102 tablet_replica.cc:333] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.127523  3102 raft_consensus.cc:2243] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.132745  3102 raft_consensus.cc:2272] T 1c970994e11f4080b5624db5219101b4 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.153956  3102 tablet_replica.cc:333] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.231007  3102 raft_consensus.cc:2243] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.236181  3102 raft_consensus.cc:2272] T a2c18c2d1c094cb9a849a72508c8962f P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.242769  3102 tablet_replica.cc:333] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.250564  3102 raft_consensus.cc:2243] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.252513  3102 raft_consensus.cc:2272] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:38.185261  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.280786  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 95460.1us
I20260709 12:22:38.303465  3102 tablet_replica.cc:333] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.305656  3102 raft_consensus.cc:2243] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.306967  3102 raft_consensus.cc:2272] T 9f8081e75d074f30b97f8a1542e86cec P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.323190  3102 tablet_replica.cc:333] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.330950  3102 raft_consensus.cc:2243] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.332319  3102 raft_consensus.cc:2272] T 987201f60eb64f869c89f0703e622738 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:38.346024  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 51255us
I20260709 12:22:38.382082  3102 tablet_replica.cc:333] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.383587  3102 raft_consensus.cc:2243] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.385902  3102 raft_consensus.cc:2272] T c18183fd904d43f68b0e600ddb8ae249 P 0aa405b398df42edbf74ee643aeb18dc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:38.399708  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 51677.4us
I20260709 12:22:38.442219  3102 tablet_replica.cc:333] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.544901  3102 raft_consensus.cc:2243] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.558658  3102 raft_consensus.cc:2272] T d97e8a8c644540508f2457db68e20be8 P 0aa405b398df42edbf74ee643aeb18dc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.632323  3102 tablet_replica.cc:333] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.668437  3102 raft_consensus.cc:2243] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.687884  3102 raft_consensus.cc:2272] T 631cc1317abe4f99b307dee5289f9258 P 0aa405b398df42edbf74ee643aeb18dc [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.690734  4987 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 16.16, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: NON_VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: true } }
I20260709 12:22:38.713606  3102 tablet_replica.cc:333] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.714998  3102 raft_consensus.cc:2243] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.716212  3102 raft_consensus.cc:2272] T f77d531cd9f54dcbb332d1ff622d8443 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.723544  3102 tablet_replica.cc:333] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.728053  3102 raft_consensus.cc:2243] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.732297  4403 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
W20260709 12:22:38.737402  4956 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.737919  3102 raft_consensus.cc:2272] T ff19d9953d5b4cddb487ccf873740dee P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.741253 10033 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:22:38.750382  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.755472  3102 tablet_replica.cc:333] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.761071  3102 raft_consensus.cc:2243] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:22:38.803836  3102 raft_consensus.cc:2272] T e070006215b747e39d88b78e59a78364 P 0aa405b398df42edbf74ee643aeb18dc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.810032 10027 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Committing config change with OpId 16.17: config changed from index 8 to 17, NON_VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: NON_VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: true } } }
I20260709 12:22:38.827898 10001 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:38.828724 10001 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:38.834237  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:38.838757  3102 tablet_replica.cc:333] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.814857  4408 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Committing config change with OpId 16.17: config changed from index 8 to 17, NON_VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: NON_VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: true } } }
I20260709 12:22:38.853789 10001 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:38.887645  3102 raft_consensus.cc:2243] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.855942  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "0aa405b398df42edbf74ee643aeb18dc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:38.895473  3102 raft_consensus.cc:2272] T 53b63478950f49c4a21f85e72a0a2218 P 0aa405b398df42edbf74ee643aeb18dc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.898273  4218 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa405b398df42edbf74ee643aeb18dc; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:38.899668 10001 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:38.898716  3102 tablet_replica.cc:333] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc: stopping tablet replica
I20260709 12:22:38.900774  3102 raft_consensus.cc:2243] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:38.901823  3102 raft_consensus.cc:2272] T 374e8fa3690a41af9874f32b270bf3e1 P 0aa405b398df42edbf74ee643aeb18dc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:38.903805 10097 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:38.904649 10097 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:38.922341  4371 leader_election.cc:336] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:38.927359  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:38.927434 10097 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:38.929267  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:38.930464 10129 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:22:38.949223  4149 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: config changed from index 8 to 17, NON_VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) added. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: NON_VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.984850 10097 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:38.985635 10097 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:38.992991 10097 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:38.995633  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:38.998584  4371 leader_election.cc:336] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:38.999154  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.000216 10123 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:22:39.006132 10058 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.006800 10058 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.003001 10123 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.009317 10058 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.015172 10123 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:39.023020  4296 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.025806  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:39.031265 10123 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.041754  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.045387  4296 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:39.046200 10058 raft_consensus.cc:2749] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:39.048458  4371 leader_election.cc:336] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.049384  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:39.050419 10123 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:39.052294 10123 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.052960 10123 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.057888  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:39.058735  4327 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 18.
I20260709 12:22:39.060443  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.061606 10130 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:39.061998 10130 raft_consensus.cc:493] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.062419 10130 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.068482 10123 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.097093 10130 raft_consensus.cc:515] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.104671  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b29d30a957d40fdbc729fc5e9955b1b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:39.105324  4327 raft_consensus.cc:3060] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:39.111191  4371 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.116072 10058 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.116796 10058 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.117358 10123 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.118070 10123 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.122547 10123 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.124770  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.125800 10058 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:39.129185  4371 leader_election.cc:336] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.130376  4327 raft_consensus.cc:2468] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 19.
W20260709 12:22:39.127276  4296 leader_election.cc:336] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.133939  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.134644  4408 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:39.136556 10033 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.133458 10130 leader_election.cc:290] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.137283 10033 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.141853  4372 leader_election.cc:304] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.143494 10130 raft_consensus.cc:2804] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:39.144964  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.145520 10130 raft_consensus.cc:697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 19 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:39.146710 10125 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:22:39.146675 10130 consensus_queue.cc:237] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.147269 10125 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.148097 10125 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:39.161010  4371 leader_election.cc:336] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.161654  4371 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.162599 10027 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.162952 10123 raft_consensus.cc:2749] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:39.163264 10027 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.166406 10027 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.167232 10033 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.169842 10127 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.170665 10127 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.173049 10127 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.169937  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.174558  4408 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:39.177467  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.179515  4408 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
I20260709 12:22:39.187646  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.188791  4408 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 18.
I20260709 12:22:39.190256  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.192045 10124 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:22:39.192349  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.192597 10124 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.193041 10124 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.194092 10127 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.194792 10127 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.197434 10127 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.198622  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.193749 10125 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.199623 10045 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.200079 10045 raft_consensus.cc:493] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:39.191488  4296 leader_election.cc:336] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.200515 10045 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.202133 10125 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.203598  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.207476 10027 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:22:39.212558 10027 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.213152 10027 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:22:39.214089  4955 leader_election.cc:336] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.208097  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709bcc39a1e14a66abd5e1d758132d0a" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:39.215976  4408 raft_consensus.cc:3060] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:22:39.220957  4296 leader_election.cc:336] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.221493  4296 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.222245 10127 raft_consensus.cc:2749] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:22:39.223457  4296 leader_election.cc:336] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.224403 10045 raft_consensus.cc:515] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.224399 10124 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.229293 10045 leader_election.cc:290] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.230726 10124 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.229460  4408 raft_consensus.cc:2468] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 15.
W20260709 12:22:39.237685  4296 leader_election.cc:336] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.240291  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bee4570f5474c8f916b3144395312d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:39.240891  4403 raft_consensus.cc:3060] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.238135  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:39.241765  4401 raft_consensus.cc:3060] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:22:39.238392 10033 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.245976 10033 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.248344 10033 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.252280  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:39.252995  4333 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:39.256951  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.264016 10033 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:39.264745 10033 raft_consensus.cc:493] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.265331 10033 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.240510 10027 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.259243 10045 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.275861 10045 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.276917 10027 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.279717  4401 raft_consensus.cc:2468] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 16.
I20260709 12:22:39.275059  4403 raft_consensus.cc:2468] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:39.278822  4296 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.284088 10127 raft_consensus.cc:2804] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:22:39.284765 10127 raft_consensus.cc:697] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:39.285640 10058 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.285704 10127 consensus_queue.cc:237] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.286356 10058 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.288467 10058 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.282667 10129 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.290318 10129 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.284175  4296 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.302711 10129 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:39.305250  4296 leader_election.cc:336] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.305207  4150 catalog_manager.cc:5697] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 18 to 19, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 19 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:39.307403  4955 leader_election.cc:336] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.311589  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:39.312284 10138 ts_tablet_manager.cc:933] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Initiating tablet copy from peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.312336  4333 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:39.296876 10058 raft_consensus.cc:2804] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:22:39.315583  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.336117  4955 leader_election.cc:304] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.316870 10045 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.341827 10045 raft_consensus.cc:2804] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:39.342568  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:39.343267  4403 raft_consensus.cc:3060] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:22:39.360742  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.363408 10058 raft_consensus.cc:697] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:39.368420  4403 raft_consensus.cc:2468] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 19.
I20260709 12:22:39.353484 10129 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.411007 10129 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.413661 10129 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.413883  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.422022 10142 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.422603 10142 raft_consensus.cc:493] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.423023 10142 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.367283 10058 consensus_queue.cc:237] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.372318 10045 raft_consensus.cc:697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
W20260709 12:22:39.439971  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 126218us
W20260709 12:22:39.452936  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 116883us
I20260709 12:22:39.454252  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.454444 10045 consensus_queue.cc:237] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.474303 10139 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.474980 10139 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.458447 10138 tablet_copy_client.cc:323] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet copy: Beginning tablet copy session from remote peer at address 127.3.7.132:43853
I20260709 12:22:39.455070 10033 raft_consensus.cc:515] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.477082 10139 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.489363  5002 tablet_copy_service.cc:140] P 0952d204644f41a88e5e463e697dcc27: Received BeginTabletCopySession request for tablet 4d4dedbb3ee0412db92c974e0c25a776 from peer b3efae3bdfff46bb9bbff1ed1ea70a90 ({username='slave'} at 127.0.0.1:52862)
I20260709 12:22:39.479084 10033 leader_election.cc:290] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.490281  5002 tablet_copy_service.cc:161] P 0952d204644f41a88e5e463e697dcc27: Beginning new tablet copy session on tablet 4d4dedbb3ee0412db92c974e0c25a776 from peer b3efae3bdfff46bb9bbff1ed1ea70a90 at {username='slave'} at 127.0.0.1:52862: session id = b3efae3bdfff46bb9bbff1ed1ea70a90-4d4dedbb3ee0412db92c974e0c25a776
I20260709 12:22:39.478722  4150 catalog_manager.cc:5697] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 14 to 15, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 15 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.498711 10142 raft_consensus.cc:515] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.515909  4987 raft_consensus.cc:2393] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 12: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:39.519570  4296 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.521957 10142 leader_election.cc:290] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:39.528626  4371 leader_election.cc:336] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.529222  4371 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.538100 10150 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.538853 10150 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.541507 10150 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.543586 10140 raft_consensus.cc:2749] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:39.544461 10124 raft_consensus.cc:3060] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.545250  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.546020  4987 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 17.
W20260709 12:22:39.537333  4371 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.549542  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:39.548475  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446eb926cc6444ab93580e61ad7fc581" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:39.558393  4333 raft_consensus.cc:3060] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.559615  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:39.563915  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 99755.3us
I20260709 12:22:39.567111 10145 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:39.567626 10145 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.568058 10145 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.575464 10153 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.560495 10140 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:39.576074 10153 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.578393 10153 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.579381 10153 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.579851 10153 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.580663  4327 raft_consensus.cc:1275] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 19 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:22:39.581856 10153 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.582793 10097 consensus_queue.cc:1048] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:39.583123  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89ea196b53354b90b1803ebad82f35ff" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:39.582828  4955 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:22:39.593596  4296 leader_election.cc:336] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.599746  4333 raft_consensus.cc:2468] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:39.601408  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.602176  4401 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 11.
I20260709 12:22:39.590555 10153 raft_consensus.cc:2804] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:22:39.606236  5002 tablet_copy_source_session.cc:215] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:39.607402  4956 leader_election.cc:304] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.626691 10151 raft_consensus.cc:2804] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:39.627478 10151 raft_consensus.cc:697] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:39.604487 10124 raft_consensus.cc:2749] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:39.628477 10151 consensus_queue.cc:237] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.632948 10153 raft_consensus.cc:697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 19 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:39.634025 10153 consensus_queue.cc:237] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.635336 10145 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.638466 10145 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.622977 10130 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.654753 10130 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.657207 10130 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.647493  4150 catalog_manager.cc:5697] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 11 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 12 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.652364  4327 raft_consensus.cc:2468] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:39.673146  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092b1e5ebf04097a82982b4008c4d7e" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:39.673859  4987 raft_consensus.cc:3060] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.670003  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.674687  4992 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:39.678295  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.679679  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.679677 10129 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:39.680867 10129 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.681273 10129 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:39.693166  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:39.693945  4371 leader_election.cc:336] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.705366  4403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:39.706158  4403 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 17.
I20260709 12:22:39.711683 10138 ts_tablet_manager.cc:1916] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 12:22:39.723801  4987 raft_consensus.cc:2468] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 18.
W20260709 12:22:39.708830  4955 leader_election.cc:336] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:39.726831  4149 catalog_manager.cc:5697] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 15 to 16, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 16 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:39.746042  4955 connection.cc:769] client connection to 127.3.7.129:34061 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:22:39.730633  4296 connection.cc:769] client connection to 127.3.7.129:34061 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:22:39.747627  4956 leader_election.cc:304] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.749343 10146 raft_consensus.cc:2804] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:39.749955 10146 raft_consensus.cc:697] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:39.707733 10129 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.757687  4401 raft_consensus.cc:2393] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0952d204644f41a88e5e463e697dcc27 in current term 14: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:39.757808 10129 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.750972 10146 consensus_queue.cc:237] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.763607  4992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c18c2d1c094cb9a849a72508c8962f" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:39.764220  4992 raft_consensus.cc:3060] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:39.774324  4992 raft_consensus.cc:2468] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:39.778398  4371 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.779368 10152 raft_consensus.cc:2804] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:39.779933 10152 raft_consensus.cc:697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:39.780879 10152 consensus_queue.cc:237] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.791772  4150 catalog_manager.cc:5697] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 13 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.803290  4150 catalog_manager.cc:5697] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 18 to 19, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 19 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.812568 10124 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.813292 10124 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.818043 10124 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:39.830024 10138 ts_tablet_manager.cc:1929] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 5.7
I20260709 12:22:39.860746  4153 catalog_manager.cc:5697] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 13 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 14 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.863739 10058 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.864395 10058 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
W20260709 12:22:39.852810  4371 leader_election.cc:336] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:39.888329 10058 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.892696  4150 catalog_manager.cc:5697] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 11 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 12 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.899812  4403 raft_consensus.cc:1275] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:22:39.905542 10146 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.906123 10146 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.908380 10146 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.909531  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.910377 10153 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:22:39.910770 10153 raft_consensus.cc:493] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.911150 10153 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:22:39.912006  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:39.912730  4329 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 17.
I20260709 12:22:39.914073  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.915205 10144 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:39.915663 10144 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.916052 10144 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.920456  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:39.921893 10027 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:22:39.922276 10027 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.922627 10027 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.924252 10153 raft_consensus.cc:515] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.926447 10153 leader_election.cc:290] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:22:39.927311  4955 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:39.928113  4955 leader_election.cc:336] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:39.928500  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
W20260709 12:22:39.932669  4955 leader_election.cc:336] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:39.933094 10151 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:39.929034  4296 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.934331 10058 raft_consensus.cc:2804] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:39.934806 10058 raft_consensus.cc:697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:39.936125 10129 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.936656 10129 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:39.935761 10058 consensus_queue.cc:237] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.944008 10129 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.944156  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:39.945068  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:39.946983  4326 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:39.931073 10027 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.950735 10144 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:39.951931  4990 raft_consensus.cc:2393] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 18: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:39.952483 10027 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:39.930507 10138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4dedbb3ee0412db92c974e0c25a776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.957702  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:39.964172 10027 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:39.964834 10027 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:39.969928  4955 leader_election.cc:336] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:39.970885  4955 leader_election.cc:336] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:39.971272 10123 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:39.971800 10123 raft_consensus.cc:493] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
W20260709 12:22:39.973642  4955 leader_election.cc:336] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:39.974678  4955 leader_election.cc:336] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:39.975679  4955 leader_election.cc:336] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:39.979687  4326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:39.980314  4326 raft_consensus.cc:3060] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:22:39.981936  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:39.982271  4296 leader_election.cc:336] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:39.985466  4371 leader_election.cc:336] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:39.976585 10144 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:39.972975 10123 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.029325 10127 consensus_queue.cc:1048] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:22:40.035547  4326 raft_consensus.cc:2468] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 18.
I20260709 12:22:40.043677  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:40.045713  4956 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:40.047370 10146 raft_consensus.cc:2804] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:22:40.047636  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.047912 10146 raft_consensus.cc:697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 18 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:40.048856 10146 consensus_queue.cc:237] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:40.056706  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520cf0102a3945aebdd2da293d919a52" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:40.057315  4408 raft_consensus.cc:3060] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:22:40.063525  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.064621  4408 raft_consensus.cc:2468] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
W20260709 12:22:40.036918  4296 leader_election.cc:336] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:40.037703 10027 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:40.068147  4296 leader_election.cc:336] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:40.067327  4408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:40.071370  4408 raft_consensus.cc:3060] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:22:40.079391  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:40.085098  4150 catalog_manager.cc:5697] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 17 to 18, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 18 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.087435  4405 raft_consensus.cc:1275] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:22:40.088308  4408 raft_consensus.cc:2468] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 18.
I20260709 12:22:40.090072  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:40.113418 10058 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:40.124852 10123 raft_consensus.cc:515] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:40.127506  4401 raft_consensus.cc:2393] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in current term 14: Already voted for candidate 899897e6794541b5ab538af361fc9e6c in this term.
I20260709 12:22:40.128206  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e070006215b747e39d88b78e59a78364" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:40.128615 10145 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:40.128862  4329 raft_consensus.cc:3060] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.129317 10145 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:40.131439 10145 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:40.141076  4329 raft_consensus.cc:2468] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 14.
I20260709 12:22:40.142978  4372 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:40.144649 10140 raft_consensus.cc:2804] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:40.145406 10140 raft_consensus.cc:697] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:40.146690 10140 consensus_queue.cc:237] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:40.127105 10123 leader_election.cc:290] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:22:40.172927  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.175145  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.188742  4371 leader_election.cc:336] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:40.193302  4296 leader_election.cc:304] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:40.209860 10125 raft_consensus.cc:2749] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.171126 10138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40644 (request call id 1847) took 1022 ms. Trace:
I20260709 12:22:40.244180  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:40.244943  4987 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 13.
I20260709 12:22:40.204192 10127 consensus_queue.cc:1048] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:22:40.236158 10138 rpcz_store.cc:276] 0709 12:22:39.148614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.182842 (+ 34228us) service_pool.cc:224] Handling call
0709 12:22:39.312756 (+129914us) ts_tablet_manager.cc:934] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Initiating tablet copy from peer 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
0709 12:22:39.704369 (+391613us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:39.778701 (+ 74332us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:39.829873 (+ 51172us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:39.930145 (+100272us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 12:22:40.170173 (+240028us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:40.170553 (+   380us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:40.170950 (+   397us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:40.171019 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16261,"tablet-copy.queue_time_us":128632,"thread_start_us":221492,"threads_started":2}
I20260709 12:22:40.268837 10138 tablet_copy_client.cc:806] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:40.269405 10138 tablet_copy_client.cc:670] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet copy: Starting download of 1 WAL segments...
W20260709 12:22:40.274173  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.277781  4990 raft_consensus.cc:1275] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:22:40.278959  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.283753  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:40.282896  4150 catalog_manager.cc:5697] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 17 to 18, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 18 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:40.288184  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.292016 10123 consensus_queue.cc:1048] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:40.301586  4326 raft_consensus.cc:1275] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:40.302961  4327 raft_consensus.cc:1275] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:22:40.303478  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 114640us
I20260709 12:22:40.304503  4955 leader_election.cc:304] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:40.305207 10153 raft_consensus.cc:2804] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:22:40.305341  4955 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:22:40.305974 10153 raft_consensus.cc:697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:40.308084 10171 raft_consensus.cc:2804] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:22:40.308624 10171 raft_consensus.cc:697] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 18 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:40.306952 10153 consensus_queue.cc:237] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:40.309540 10171 consensus_queue.cc:237] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:40.311847  4153 catalog_manager.cc:5697] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 13 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 14 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:40.325985  4401 raft_consensus.cc:1275] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:22:40.331326 10144 consensus_queue.cc:1048] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:40.337378 10172 consensus_queue.cc:1048] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:22:40.352375  4153 catalog_manager.cc:5697] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 11 to 12, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 12 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:40.354187  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.362833  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.363399  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.363401  4955 leader_election.cc:336] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:40.364559  4955 leader_election.cc:336] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:40.365259  4955 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:40.369935  4955 leader_election.cc:336] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:40.370714  4955 leader_election.cc:336] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:40.373673  4955 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:40.374967 10153 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:22:40.378332  4403 raft_consensus.cc:1275] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:22:40.397519 10172 consensus_queue.cc:1048] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:22:40.400514 10172 consensus_queue.cc:1048] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:40.401451  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:40.402693 10174 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:22:40.405318  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.407694  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.412237  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.416462  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.403112 10174 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aa405b398df42edbf74ee643aeb18dc)
I20260709 12:22:40.427593 10174 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.492367  4150 catalog_manager.cc:5697] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 17 to 18, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 18 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:40.520704  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.543431  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:40.534961 10174 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:40.546098 10174 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Requested vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:40.552670  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.587899  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.607904  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.622686  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 146391us
W20260709 12:22:40.619071  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.623013 10186 log.cc:927] Time spent T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:22:40.648944  4296 leader_election.cc:336] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:22:40.651039 10193 log.cc:927] Time spent T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:40.653796  4334 raft_consensus.cc:1275] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:22:40.660573 10045 consensus_queue.cc:1048] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:22:40.666565 10138 tablet_copy_client.cc:538] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:22:40.674315  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.677758  4990 raft_consensus.cc:1275] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:22:40.681620  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff19d9953d5b4cddb487ccf873740dee" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:40.682579  4990 raft_consensus.cc:3060] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:40.694192  4326 raft_consensus.cc:1275] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 899897e6794541b5ab538af361fc9e6c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:22:40.698398 10130 consensus_queue.cc:1048] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:22:40.679581  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.674823  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.704919  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.705559  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.706048  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.706514  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.706981  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.711818  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 91901.9us
W20260709 12:22:40.717062  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:40.733887  4990 raft_consensus.cc:2468] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3efae3bdfff46bb9bbff1ed1ea70a90 in term 14.
I20260709 12:22:40.751004 10192 consensus_queue.cc:1048] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:22:40.758635  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.759512  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:40.776134  4296 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
W20260709 12:22:40.783505  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.784006  3102 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:40.784281  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.784832  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.791487  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.784067  4296 leader_election.cc:336] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:40.794962 10192 raft_consensus.cc:2804] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:40.808939 10192 raft_consensus.cc:697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Becoming Leader. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:40.810439 10192 consensus_queue.cc:237] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:40.872464 10138 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap starting.
W20260709 12:22:40.876252  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 83819.5us
I20260709 12:22:40.880266  4403 raft_consensus.cc:1275] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 12:22:40.895741  4296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:34061, user_credentials={real_user=slave}} blocked reactor thread for 63688.1us
I20260709 12:22:40.944213 10172 consensus_queue.cc:1048] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:22:40.961457  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 73790.5us
I20260709 12:22:40.961540  4153 catalog_manager.cc:5697] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: term changed from 13 to 14, leader changed from 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129) to b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130). New cstate: current_term: 14 leader_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:40.969846  4403 raft_consensus.cc:1275] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:22:40.974987  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.975518  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:40.990729 10151 consensus_queue.cc:1048] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:22:41.032627  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 48256.7us
W20260709 12:22:41.052119  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:41.165318  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:41.205514 10138 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:41.206645 10138 tablet_bootstrap.cc:492] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Bootstrap complete.
I20260709 12:22:41.207479 10138 ts_tablet_manager.cc:1403] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent bootstrapping tablet: real 0.352s	user 0.057s	sys 0.015s
I20260709 12:22:41.215364 10138 raft_consensus.cc:359] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: NON_VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: true } }
I20260709 12:22:41.216445 10138 raft_consensus.cc:740] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Initialized, Role: LEARNER
I20260709 12:22:41.217207 10138 consensus_queue.cc:260] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 16.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: NON_VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: true } }
I20260709 12:22:41.220389 10138 ts_tablet_manager.cc:1434] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:22:41.227151  5002 tablet_copy_service.cc:342] P 0952d204644f41a88e5e463e697dcc27: Request end of tablet copy session b3efae3bdfff46bb9bbff1ed1ea70a90-4d4dedbb3ee0412db92c974e0c25a776 received from {username='slave'} at 127.0.0.1:52862
I20260709 12:22:41.227692  5002 tablet_copy_service.cc:434] P 0952d204644f41a88e5e463e697dcc27: ending tablet copy session b3efae3bdfff46bb9bbff1ed1ea70a90-4d4dedbb3ee0412db92c974e0c25a776 on tablet 4d4dedbb3ee0412db92c974e0c25a776 with peer b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:41.327986  4333 raft_consensus.cc:1217] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.16->[16.17-16.17]   Dedup: 16.17->[]
W20260709 12:22:41.391544  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:41.427167  4992 raft_consensus.cc:1275] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Refusing update from remote peer b3efae3bdfff46bb9bbff1ed1ea70a90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:22:41.432793 10125 consensus_queue.cc:1048] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:22:41.784487  3102 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4278)
I20260709 12:22:41.784940 10151 raft_consensus.cc:1064] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: attempting to promote NON_VOTER b3efae3bdfff46bb9bbff1ed1ea70a90 to VOTER
I20260709 12:22:41.787644 10151 consensus_queue.cc:237] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 16.17, Last appended by leader: 15, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: false } }
I20260709 12:22:41.830399  4333 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 LEARNER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 17. Preceding OpId from leader: term: 16 index: 18. (index mismatch)
I20260709 12:22:41.831826 10151 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:22:41.834216  4400 raft_consensus.cc:1275] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 16 index: 17. Preceding OpId from leader: term: 16 index: 18. (index mismatch)
I20260709 12:22:41.842846 10151 consensus_queue.cc:1048] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:22:41.860014  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:41.929138 10176 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Committing config change with OpId 16.18: config changed from index 17 to 18, b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: false } } }
I20260709 12:22:41.931281  4333 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Committing config change with OpId 16.18: config changed from index 17 to 18, b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: false } } }
I20260709 12:22:41.958189  4153 catalog_manager.cc:5697] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 reported cstate change: config changed from index 17 to 18, b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: false } } }
I20260709 12:22:42.025396  4403 raft_consensus.cc:2955] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Committing config change with OpId 16.18: config changed from index 17 to 18, b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } attrs { replace: true } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } attrs { promote: false } } }
W20260709 12:22:42.086529  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.099824  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.161923  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.186595  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 58285.6us
W20260709 12:22:42.463176  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.474917  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.541193  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.559770  4371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111) [suppressed 400 similar messages]
W20260709 12:22:42.615593  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.631289  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.683774  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.744867  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.759773  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.785437  3102 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:42.788906  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.806795  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.807672  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.812603  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.816536  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.825224  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.829219  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.837054  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.871590  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.905781  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.921644  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.930610  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.931224  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.962387  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.968545  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.982954  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.991724  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.013262  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.013691  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.122553  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:43.124182  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.150282  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.179011  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.202726  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:43.204306  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.252751  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:43.413390  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.477969  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.483500  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:43.630590  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.711704  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:43.785995  3102 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:43.851610  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:44.013917  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:44.520780  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:44.768082  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:44.786499  3102 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:44.830363  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:44.958105  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.010103  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.021346  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.050146  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.098624  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.126211  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.217801  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.244103  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.260533  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.279282  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.287942  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.297524  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.342789  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.409889  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.413087  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.416992  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.420130  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.427049  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.434348  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.451663  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.452404  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.459617  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.561254  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.606902  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.621488  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.645457  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.646503  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.664528  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.716593  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:45.718652  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.733188  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.748600  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.765488  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.787055  3102 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:45.856571  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:45.995638  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:46.017143  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:46.146522  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:46.158972  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:46.258400  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:46.258971  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:46.722930  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:46.787578  3102 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:46.809933  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.336541  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.428364  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.484434  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.519613  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.584739  4296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 12:22:47.634620  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.693671  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.718144  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.731508  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.781059  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.788975  3102 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:47.814324  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.817876  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.815200  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.823913  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.852384  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.859478  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.869326  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.892357  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.893533  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.893965  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.951807  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.955081  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.955809  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:47.959797  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.993433  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:47.994155  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.034060  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:48.134505  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.139549  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.180246  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.237095  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:48.273993  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.308461  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.309160  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.358297  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.479802  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.481335  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.537742  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.547092  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:48.549824  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 79193.1us
W20260709 12:22:48.651952  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.743115  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.750357  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:48.792268  3102 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:48.828712  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:48.985581  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:22:49.456509  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:49.792781  3102 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:49.911098  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.025233  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.013142  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.149406  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.245581  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.266577  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.252974  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.283224  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.322651  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.349836  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.359506  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.391521  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.400626  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.403604  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.432665  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.433430  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.547690  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.560962  4955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:36481, user_credentials={real_user=slave}} blocked reactor thread for 92516.7us
W20260709 12:22:50.562254  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.575933  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.579964  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.579407  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.582965  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.587972  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.585404  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.668237  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.668869  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.669332  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.696264  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.738690  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.760047  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.793347  3102 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:50.841286  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.848758  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:50.884177  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.885942  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.914258  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:50.958562  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:51.168015  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:51.228706  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:51.312791  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:51.321115  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:51.394285  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:51.476655  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:51.732508  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:22:51.803551  3102 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:52.032524  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:52.202216  4372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 56565.7us
W20260709 12:22:52.287822  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:52.472772  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:52.515376  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.559692  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:52.561738  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.604560  4296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 12:22:52.613009  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.625738  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:52.641916  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.711115  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.723516  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.724087  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:52.728885  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.729471  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.778642  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.788878  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:52.804087  3102 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:53.577287  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080027c6e0 after lost signal to thread 3105
W20260709 12:22:53.578645  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080032a9a0 after lost signal to thread 4187
W20260709 12:22:53.580030  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080005c900 after lost signal to thread 4358
W20260709 12:22:53.583686  4355 debug-util.cc:398] Leaking SignalData structure 0x7b0800129100 after lost signal to thread 4433
W20260709 12:22:53.586092  4355 debug-util.cc:398] Leaking SignalData structure 0x7b080021fb60 after lost signal to thread 5016
W20260709 12:22:53.648698  4371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.018s	sys 0.019s
W20260709 12:22:53.658453  4371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.022s	sys 0.019s
W20260709 12:22:53.659330  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 865499us
I20260709 12:22:53.719753 10259 raft_consensus.cc:493] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
W20260709 12:22:53.720777  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:53.720965 10259 raft_consensus.cc:515] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.725150 10259 leader_election.cc:290] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:53.728461  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.731626  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.732369  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:53.733120  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:53.766010 10259 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:53.776414 10259 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.778745 10259 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:53.786505  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374e8fa3690a41af9874f32b270bf3e1" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:53.804618  3102 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:53.808816  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.814936  4184 debug-util.cc:398] Leaking SignalData structure 0x7b0800042de0 after lost signal to thread 3105
W20260709 12:22:53.816044  4184 debug-util.cc:398] Leaking SignalData structure 0x7b080035a6a0 after lost signal to thread 4187
W20260709 12:22:53.817307  4184 debug-util.cc:398] Leaking SignalData structure 0x7b080008b5a0 after lost signal to thread 4358
W20260709 12:22:53.818473  4184 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9560 after lost signal to thread 4433
W20260709 12:22:53.819808  4184 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6d20 after lost signal to thread 5016
I20260709 12:22:53.824584 10259 raft_consensus.cc:493] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:53.825212 10259 raft_consensus.cc:515] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:53.848331  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:53.852836 10268 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:22:53.853432  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:53.853468 10268 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.856482 10259 leader_election.cc:290] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:53.858209 10252 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:53.858836 10252 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.862135 10252 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:53.863209 10258 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:53.864068  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:53.865063 10259 raft_consensus.cc:493] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:53.865566 10268 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:53.863801 10258 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:53.868230 10258 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:53.865641 10259 raft_consensus.cc:515] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.871166 10259 leader_election.cc:290] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:53.887475 10279 raft_consensus.cc:493] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:53.888156 10279 raft_consensus.cc:515] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.891945 10279 leader_election.cc:290] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:53.892227  4956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42725, user_credentials={real_user=slave}} blocked reactor thread for 81981.6us
I20260709 12:22:53.901528  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:53.903715 10285 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:53.904405 10285 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:22:53.906057  4327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57d10956b3f84b66bce8c7e86299d1fa" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:53.906790  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:53.912192 10261 raft_consensus.cc:493] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:53.913010 10285 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:22:53.912750 10261 raft_consensus.cc:515] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.915102 10261 leader_election.cc:290] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:53.925208 10286 raft_consensus.cc:493] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:53.925994 10286 raft_consensus.cc:515] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.928623 10286 leader_election.cc:290] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:53.929754 10279 raft_consensus.cc:493] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0952d204644f41a88e5e463e697dcc27)
I20260709 12:22:53.965281 10279 raft_consensus.cc:515] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:53.931782  4329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64033b0103b421a95ee1540d4b31df5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:53.936803  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:53.937675  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:53.970715 10279 leader_election.cc:290] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:53.941282  4371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:43853, user_credentials={real_user=slave}} blocked reactor thread for 70265.6us
I20260709 12:22:53.943109  4406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:53.971741  4371 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:53.972019  4406 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 12.
I20260709 12:22:53.945413  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:53.972712 10254 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:22:53.973933  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752b8a9170934f31b770429d237cdb43" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:22:53.975736  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.976320  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:53.976868  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.977437  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.977782  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:53.979283  4371 leader_election.cc:336] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:53.979872  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:53.981248 10281 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:53.981637 10281 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:53.982012 10281 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:53.983625  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e8a8c644540508f2457db68e20be8" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:53.987233  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:53.988610  4371 leader_election.cc:304] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:53.989709 10254 raft_consensus.cc:2749] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:53.996301  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c970994e11f4080b5624db5219101b4" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:53.999348  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7935718b80b24232b822244ef31fa44b" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:53.999719  4955 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:54.000900 10252 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:22:54.001144 10254 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:54.001761 10254 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:54.005338  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:54.008780  4405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08fb4e151924fb6944c6a5f82c4f9d2" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:22:54.009315  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:54.016300  4371 leader_election.cc:304] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:54.019951 10287 raft_consensus.cc:2749] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:22:54.021982 10254 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
W20260709 12:22:54.032874  4371 leader_election.cc:336] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:54.033529  4371 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:54.034339 10254 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:22:54.035468  4371 leader_election.cc:336] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:54.035938  4371 leader_election.cc:304] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:54.036736 10254 raft_consensus.cc:2749] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:54.037860  4371 leader_election.cc:336] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:54.038332  4371 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:54.039111 10287 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:22:54.039319  4371 leader_election.cc:336] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:54.039827  4371 leader_election.cc:304] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:54.039989 10281 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:54.041109 10287 raft_consensus.cc:2749] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:22:54.042531  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:54.045500  4333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:54.046909  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:54.049724  4955 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:54.050791 10269 raft_consensus.cc:2749] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:22:54.055065  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd41dc8658414bcfb8662c0efe3caffc" candidate_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:54.057790  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:22:54.058665 10287 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:22:54.063421 10281 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:54.080765  4296 leader_election.cc:304] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:54.082708 10255 raft_consensus.cc:2749] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:22:54.089274  4296 leader_election.cc:336] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:54.095535  4296 leader_election.cc:304] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:54.096524 10255 raft_consensus.cc:2749] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:22:54.108494  4296 leader_election.cc:336] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:22:54.109118  4296 leader_election.cc:304] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27, 0aa405b398df42edbf74ee643aeb18dc
I20260709 12:22:54.110935 10279 raft_consensus.cc:2749] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:22:54.132247  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.171073  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.173291  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.263679  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:54.288450  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:54.293596  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.357445  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.412817  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:22:54.417097  4986 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Rejecting Update request from peer b3efae3bdfff46bb9bbff1ed1ea70a90 for earlier term 12. Current term is 13. Ops: []
W20260709 12:22:54.430292  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:54.437506 10255 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:54.438752 10279 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:22:54.439111 10279 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b3efae3bdfff46bb9bbff1ed1ea70a90, State: Running, Role: LEADER
I20260709 12:22:54.440099 10279 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:54.447793 10279 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:22:54.524585  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.678817  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:54.702392  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.805141  3102 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:54.824260  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:54.855103  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:22:55.457609  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:55.463222  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:55.507731  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:55.515599 10254 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:55.516220 10254 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:55.518518 10254 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:55.519695  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:22:55.520572  4990 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
I20260709 12:22:55.521576  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:55.522220  4334 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:55.523927  4372 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:55.525846 10254 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:22:55.526224 10254 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:22:55.526578 10254 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:22:55.543074 10254 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:55.552927  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:55.555472 10254 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:22:55.560593  4990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:22:55.561501  4990 raft_consensus.cc:2393] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 899897e6794541b5ab538af361fc9e6c in current term 13: Already voted for candidate 0952d204644f41a88e5e463e697dcc27 in this term.
W20260709 12:22:55.573868  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:55.578466  4334 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 13.
I20260709 12:22:55.581940  4372 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 0952d204644f41a88e5e463e697dcc27
I20260709 12:22:55.583087 10254 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:22:55.583586 10254 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:55.584479 10254 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:55.615413  4149 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 12 to 13, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 13 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:55.623029  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.640794  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.681200  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.687603  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.755338  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:55.782799 10290 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.783371 10290 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:55.785662 10290 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:55.787631  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" is_pre_election: true
I20260709 12:22:55.788516  4334 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 13.
I20260709 12:22:55.789979  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 
I20260709 12:22:55.787678  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:22:55.792830 10290 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:22:55.793344 10290 raft_consensus.cc:493] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.794883 10290 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:55.805644  3102 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:55.813333  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.830330  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:55.835634 10290 raft_consensus.cc:515] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:55.870173 10290 leader_election.cc:290] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:22:55.871173  4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c"
I20260709 12:22:55.886327  4334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01644bc7ce5c458c882adfcf42aa8d83" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90"
I20260709 12:22:55.886976  4334 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:22:55.894385  4334 raft_consensus.cc:2468] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0952d204644f41a88e5e463e697dcc27 in term 14.
I20260709 12:22:55.898044  4956 leader_election.cc:304] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90; no voters: 899897e6794541b5ab538af361fc9e6c
I20260709 12:22:55.899520 10290 raft_consensus.cc:2804] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:22:55.900378 10290 raft_consensus.cc:697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Becoming Leader. State: Replica: 0952d204644f41a88e5e463e697dcc27, State: Running, Role: LEADER
I20260709 12:22:55.901319 10290 consensus_queue.cc:237] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:22:55.907910  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:55.920125  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:55.935995  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.940049  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:55.966854  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:55.969858  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.030558  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:22:56.047742  4149 catalog_manager.cc:5697] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 reported cstate change: term changed from 13 to 14, leader changed from 899897e6794541b5ab538af361fc9e6c (127.3.7.131) to 0952d204644f41a88e5e463e697dcc27 (127.3.7.132). New cstate: current_term: 14 leader_uuid: "0952d204644f41a88e5e463e697dcc27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:56.086670  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:56.090482  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.124396  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.125025  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:56.143523  4990 raft_consensus.cc:1240] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Rejecting Update request from peer 899897e6794541b5ab538af361fc9e6c for earlier term 13. Current term is 14. Ops: []
I20260709 12:22:56.146000 10300 consensus_queue.cc:1059] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:22:56.147008 10300 consensus_queue.cc:1243] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Peer 0952d204644f41a88e5e463e697dcc27 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:22:56.147534 10235 raft_consensus.cc:3055] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:22:56.147899 10235 raft_consensus.cc:740] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:22:56.148705 10235 consensus_queue.cc:260] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:22:56.149966 10235 raft_consensus.cc:3060] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:22:56.166543  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.184823  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.187405  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:56.264168  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.341137  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:56.360349  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.372534  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:22:56.411896  4334 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:22:56.414618 10290 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:22:56.493175  4401 raft_consensus.cc:1275] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Refusing update from remote peer 0952d204644f41a88e5e463e697dcc27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:22:56.493587  4401 pending_rounds.cc:85] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Aborting all ops after (but not including) 11
I20260709 12:22:56.493795  4401 pending_rounds.cc:107] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:22:56.494064  4401 raft_consensus.cc:2889] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.495765 10290 consensus_queue.cc:1048] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:22:56.502849  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:56.519177  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.691277  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:56.727530  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.768705  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.806141  3102 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:56.875550  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.907721  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:56.924327  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:56.967643  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:57.039127  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:57.076471  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:57.087617  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:57.109756  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:57.191195  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:57.446446  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:22:57.618669  4371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111) [suppressed 390 similar messages]
W20260709 12:22:57.792174  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:57.806668  3102 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:57.815070  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:57.947516  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.040781  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.045231  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.087733  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.190310  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.203123  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.219484  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.269861  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.288460  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.343672  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.411589  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.467453  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.471635  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.505941  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.519011  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.568972  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.713701  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.754056  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.795671  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.807379  3102 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:58.822120  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.824945  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.824102  4296 consensus_peers.cc:597] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.846756  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.847494  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:58.909004  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:58.935017  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.033224  4296 consensus_peers.cc:597] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.090445  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.163913  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:59.342260  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:59.347505  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.408584  4296 consensus_peers.cc:597] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.439358  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.450088  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:59.454999  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.591140  4296 consensus_peers.cc:597] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.618000  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.629447  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:59.726992  4296 consensus_peers.cc:597] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.738622  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:22:59.812551  3102 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 4278)
W20260709 12:22:59.847577  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:22:59.938082  4296 consensus_peers.cc:597] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:00.267580  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.276162  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.315835  4371 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:00.320200  4296 consensus_peers.cc:597] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:00.451352  4296 consensus_peers.cc:597] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.563737  4371 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.610564  4296 consensus_peers.cc:597] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.634184  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:00.778667  4296 consensus_peers.cc:597] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.783951  4296 consensus_peers.cc:597] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.850841  4371 consensus_peers.cc:597] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.862396  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.880702  4296 consensus_peers.cc:597] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:00.916558  4371 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:00.939353  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
W20260709 12:23:00.969238  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:00.969929  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:00.973696  4371 consensus_peers.cc:597] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.005620  4296 consensus_peers.cc:597] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:01.048755  4296 consensus_peers.cc:597] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.051811  4371 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:01.119451  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
W20260709 12:23:01.127543  4372 consensus_peers.cc:597] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.140455  4372 consensus_peers.cc:597] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.159761  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.163775  4372 consensus_peers.cc:597] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.171257  4371 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.182327  4956 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.195858  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:01.197877  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:01.198897  3102 tablet_replica.cc:333] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.199769  3102 raft_consensus.cc:2243] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.201179  3102 raft_consensus.cc:2272] T c64033b0103b421a95ee1540d4b31df5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.204946  3102 tablet_replica.cc:333] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.205965  3102 raft_consensus.cc:2243] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:01.206411  4956 consensus_peers.cc:597] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.206835  3102 raft_consensus.cc:2272] T 4c52d75f63d54dbeba6b3c868117e4c4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.210017  3102 tablet_replica.cc:333] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
W20260709 12:23:01.210058  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:01.211097  3102 raft_consensus.cc:2243] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.212129  3102 raft_consensus.cc:2272] T 7d321543daa94c458a2b9ed5e9d553a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.215390  3102 tablet_replica.cc:333] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.216495  3102 raft_consensus.cc:2243] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.217312  3102 raft_consensus.cc:2272] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.218276  4956 consensus_peers.cc:597] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.218417  4372 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.220296  3102 tablet_replica.cc:333] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.221101  3102 raft_consensus.cc:2243] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.222330  3102 raft_consensus.cc:2272] T 8afcac1f47834987ac3889edd37f61a3 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.225164  3102 tablet_replica.cc:333] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.225941  3102 raft_consensus.cc:2243] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:01.226454  4956 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.227063  3102 raft_consensus.cc:2272] T c75e006bba424d8b9ae7dfa589237877 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.230116  3102 tablet_replica.cc:333] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.230916  3102 raft_consensus.cc:2243] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.232290  3102 raft_consensus.cc:2272] T 7092b1e5ebf04097a82982b4008c4d7e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.235119  3102 tablet_replica.cc:333] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.235952  3102 raft_consensus.cc:2243] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.236987  3102 raft_consensus.cc:2272] T 795c79b77a3c478183b1eaf256f074d5 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.239336  3102 tablet_replica.cc:333] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.240098  3102 raft_consensus.cc:2243] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.240959  3102 raft_consensus.cc:2272] T 4d4dedbb3ee0412db92c974e0c25a776 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.245028  3102 tablet_replica.cc:333] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.246035  3102 raft_consensus.cc:2243] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.246695  3102 raft_consensus.cc:2272] T bac26358ed7f4644aa3f5b040afcdca4 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.249454  3102 tablet_replica.cc:333] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
W20260709 12:23:01.249392  4956 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.250541  3102 raft_consensus.cc:2243] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.251819  3102 raft_consensus.cc:2272] T b9d53e2537c9446fb3bf3c50fc0d5556 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.253629  4956 consensus_peers.cc:597] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.254840  3102 tablet_replica.cc:333] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.255823  3102 raft_consensus.cc:2243] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.256469  3102 raft_consensus.cc:2272] T 34ae0ae4c14d4870b094e2733b40e647 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.259199  3102 tablet_replica.cc:333] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.260030  3102 raft_consensus.cc:2243] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.260826  3102 raft_consensus.cc:2272] T 7b29d30a957d40fdbc729fc5e9955b1b P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.263784  3102 tablet_replica.cc:333] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
W20260709 12:23:01.264416  4371 consensus_peers.cc:597] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:01.264714  3102 raft_consensus.cc:2243] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.266127  3102 raft_consensus.cc:2272] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.268864  3102 tablet_replica.cc:333] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.269562  3102 raft_consensus.cc:2243] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.270358  3102 raft_consensus.cc:2272] T 01f50fa8d8c34c06a67470615046629f P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.272903  3102 tablet_replica.cc:333] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.273661  3102 raft_consensus.cc:2243] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.274932  3102 raft_consensus.cc:2272] T 7f8c0670d52b4df8ad46e1549814b7a8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.277585  3102 tablet_replica.cc:333] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.278366  3102 raft_consensus.cc:2243] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.279002  3102 raft_consensus.cc:2272] T 446eb926cc6444ab93580e61ad7fc581 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.282058  3102 tablet_replica.cc:333] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.282872  3102 raft_consensus.cc:2243] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.284108  3102 raft_consensus.cc:2272] T 393ed0f79d194bc1a6199031055676bf P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.286944  3102 tablet_replica.cc:333] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.287892  3102 raft_consensus.cc:2243] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.289021  3102 raft_consensus.cc:2272] T a0fa0b9753bf4f05871dfa6b329de33a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.292635  3102 tablet_replica.cc:333] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.293462  3102 raft_consensus.cc:2243] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.294440  3102 raft_consensus.cc:2272] T a08fb4e151924fb6944c6a5f82c4f9d2 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.296120  4956 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.297043  3102 tablet_replica.cc:333] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.299386  3102 raft_consensus.cc:2243] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.300115  3102 raft_consensus.cc:2272] T 01644bc7ce5c458c882adfcf42aa8d83 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.302768  3102 tablet_replica.cc:333] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.303553  3102 raft_consensus.cc:2243] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.304316  3102 raft_consensus.cc:2272] T 90175b58ea034e69b889717ca0ad0333 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.306190  4956 consensus_peers.cc:597] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.307060  3102 tablet_replica.cc:333] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.307976  3102 raft_consensus.cc:2243] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.309136  3102 raft_consensus.cc:2272] T a7d14a1bca614fe1af748ef119552803 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.311833  3102 tablet_replica.cc:333] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.312855  3102 raft_consensus.cc:2243] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.314157  3102 raft_consensus.cc:2272] T ff19d9953d5b4cddb487ccf873740dee P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.316493  3102 tablet_replica.cc:333] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.317248  3102 raft_consensus.cc:2243] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.317951  3102 raft_consensus.cc:2272] T e070006215b747e39d88b78e59a78364 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.320051  4956 consensus_peers.cc:597] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.320462  3102 tablet_replica.cc:333] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.321307  3102 raft_consensus.cc:2243] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.322429  3102 raft_consensus.cc:2272] T b18524a049aa4e8687009c73a015e710 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.324551  3102 tablet_replica.cc:333] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.325278  3102 raft_consensus.cc:2243] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.325896  3102 raft_consensus.cc:2272] T b22e067af7004ed88fb3125c7ac731ad P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.328625  3102 tablet_replica.cc:333] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.329465  3102 raft_consensus.cc:2243] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.331169  3102 raft_consensus.cc:2272] T bf5e08eda6fd4363b1af431c73621515 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.334108  3102 tablet_replica.cc:333] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.334805  3102 raft_consensus.cc:2243] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.335997  3102 raft_consensus.cc:2272] T 0d57b9080cd745529aba05aa6b7a640e P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.339457  3102 tablet_replica.cc:333] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.340206  3102 raft_consensus.cc:2243] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.340879  3102 raft_consensus.cc:2272] T fd41dc8658414bcfb8662c0efe3caffc P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.342165  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:01.343343  3102 tablet_replica.cc:333] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.344182  3102 raft_consensus.cc:2243] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.344868  3102 raft_consensus.cc:2272] T be5f00fff96847178a1970711feff2f0 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.347708  3102 tablet_replica.cc:333] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.348431  3102 raft_consensus.cc:2243] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.349100  3102 raft_consensus.cc:2272] T 9f8081e75d074f30b97f8a1542e86cec P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.351374  3102 tablet_replica.cc:333] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.352054  3102 raft_consensus.cc:2243] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.352994  3102 raft_consensus.cc:2272] T b3c4a4b844fc4fd39fac73554dc3d8d8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.354741  4956 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.355665  3102 tablet_replica.cc:333] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.356278  3102 raft_consensus.cc:2243] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.357360  3102 raft_consensus.cc:2272] T 631cc1317abe4f99b307dee5289f9258 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.359074  4372 consensus_peers.cc:597] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.359635  3102 tablet_replica.cc:333] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.360394  3102 raft_consensus.cc:2243] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.361433  3102 raft_consensus.cc:2272] T e2742c399a2d4e5dae60161a45cce316 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.363828  3102 tablet_replica.cc:333] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.364384  3102 raft_consensus.cc:2243] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.364800  3102 raft_consensus.cc:2272] T 752b8a9170934f31b770429d237cdb43 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.366642  3102 tablet_replica.cc:333] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.367164  3102 raft_consensus.cc:2243] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.368168  3102 raft_consensus.cc:2272] T 68963fca87f1465babfafe629c276422 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.370817  3102 tablet_replica.cc:333] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.371613  3102 raft_consensus.cc:2243] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.372231  3102 raft_consensus.cc:2272] T dd8463b2beaf488989ffd8e005249050 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.375774  3102 tablet_replica.cc:333] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.376525  3102 raft_consensus.cc:2243] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.377781  3102 raft_consensus.cc:2272] T 2f35b6d3672d440581ae00175c31e5b7 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.380779  3102 tablet_replica.cc:333] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.381502  3102 raft_consensus.cc:2243] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.382162  3102 raft_consensus.cc:2272] T 89ea196b53354b90b1803ebad82f35ff P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.384900  3102 tablet_replica.cc:333] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.385951  3102 raft_consensus.cc:2243] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:23:01.385879  4956 consensus_peers.cc:597] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.387537  3102 raft_consensus.cc:2272] T 57d10956b3f84b66bce8c7e86299d1fa P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.390489  3102 tablet_replica.cc:333] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.391464  3102 raft_consensus.cc:2243] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:01.392966  3102 raft_consensus.cc:2272] T 709bcc39a1e14a66abd5e1d758132d0a P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.395987  3102 tablet_replica.cc:333] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.396723  3102 raft_consensus.cc:2243] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.397429  3102 raft_consensus.cc:2272] T d97e8a8c644540508f2457db68e20be8 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.397809  4956 consensus_peers.cc:597] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.400332  3102 tablet_replica.cc:333] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90: stopping tablet replica
I20260709 12:23:01.401624  3102 raft_consensus.cc:2243] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:23:01.402278  4956 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:01.402827  3102 raft_consensus.cc:2272] T 987201f60eb64f869c89f0703e622738 P b3efae3bdfff46bb9bbff1ed1ea70a90 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:01.458716  4372 consensus_peers.cc:597] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.462111  4956 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.482123  4372 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.518182  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.521535  4372 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.583699  4372 consensus_peers.cc:597] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.622288  4372 consensus_peers.cc:597] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.623191  4372 consensus_peers.cc:597] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.635207  4372 consensus_peers.cc:597] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:01.705906  4371 consensus_peers.cc:597] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:01.830780  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:01.861052  4371 consensus_peers.cc:597] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.884559  4371 consensus_peers.cc:597] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.899137  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:01.916632  4371 consensus_peers.cc:597] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:02.003437  4371 consensus_peers.cc:597] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:02.046542  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:02.122962  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:02.181828  4955 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:23:02.221589 10326 raft_consensus.cc:493] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.222301 10326 raft_consensus.cc:515] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:23:02.225297 10326 leader_election.cc:290] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.234690  4371 leader_election.cc:336] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.244143  4372 leader_election.cc:336] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.244692  4372 leader_election.cc:304] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.247386 10326 raft_consensus.cc:2749] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:02.327610  4371 consensus_peers.cc:597] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:23:02.367722 10339 raft_consensus.cc:493] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.368374 10339 raft_consensus.cc:515] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:23:02.370590 10339 leader_election.cc:290] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:23:02.376621 10339 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:23:02.377146  4372 leader_election.cc:336] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.377138 10339 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.379283 10339 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.381001  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4079a3fa5d6b4cafa2f9b17573d0e1b0" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
W20260709 12:23:02.383478  4371 leader_election.cc:336] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.383997  4371 leader_election.cc:304] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.386451 10326 raft_consensus.cc:2749] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:02.389134  4372 leader_election.cc:336] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.393307 10339 raft_consensus.cc:493] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.394624 10311 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.395144 10311 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.397162 10311 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:23:02.389621  4372 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0952d204644f41a88e5e463e697dcc27, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.398820  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:23:02.398986 10326 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.393844 10339 raft_consensus.cc:515] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:23:02.404165 10339 leader_election.cc:290] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.409461  4372 leader_election.cc:336] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:02.410545  4956 leader_election.cc:336] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.411053  4956 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.411816 10311 raft_consensus.cc:2749] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:02.413105  4371 leader_election.cc:336] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.413601  4371 leader_election.cc:304] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.413909 10311 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.414476 10311 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.414780 10339 raft_consensus.cc:2749] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.416535 10311 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.420298  4955 leader_election.cc:336] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.424822  4956 leader_election.cc:336] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.425309  4956 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.426096 10311 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:02.470902  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
I20260709 12:23:02.477008 10339 raft_consensus.cc:493] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.478870 10338 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.479475 10338 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.481664 10311 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.481781 10338 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:23:02.482167 10311 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.483361  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
I20260709 12:23:02.484109 10311 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:23:02.477725 10339 raft_consensus.cc:515] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:23:02.488194 10339 leader_election.cc:290] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.492167  4372 leader_election.cc:336] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:02.497331  4955 leader_election.cc:336] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.496299  4371 leader_election.cc:336] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.498768  4371 leader_election.cc:304] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.500854 10326 raft_consensus.cc:2749] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:02.501161  4956 leader_election.cc:336] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.501754  4956 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.502521 10311 raft_consensus.cc:2749] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:23:02.502736  4956 leader_election.cc:336] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.503229  4956 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.504595 10311 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.509068 10311 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.509531 10311 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.511837 10311 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:23:02.513741  4400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "0952d204644f41a88e5e463e697dcc27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "899897e6794541b5ab538af361fc9e6c" is_pre_election: true
W20260709 12:23:02.518919  4956 leader_election.cc:336] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.519519  4956 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.520278 10311 raft_consensus.cc:2749] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:02.518750 10339 raft_consensus.cc:493] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.521387 10339 raft_consensus.cc:515] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:23:02.527841 10339 leader_election.cc:290] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.528475  4371 leader_election.cc:336] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.530611  4372 leader_election.cc:336] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.530985  4372 leader_election.cc:304] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.531627 10339 raft_consensus.cc:2749] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:02.548877 10311 raft_consensus.cc:493] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.549482 10311 raft_consensus.cc:515] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.551358 10311 leader_election.cc:290] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.557410  4956 leader_election.cc:336] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:02.558017  4955 leader_election.cc:336] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.558486  4955 leader_election.cc:304] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.559319 10311 raft_consensus.cc:2749] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.599501 10339 raft_consensus.cc:493] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.600098 10339 raft_consensus.cc:515] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } }
I20260709 12:23:02.602455 10339 leader_election.cc:290] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.609587  4371 leader_election.cc:336] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.612293  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
W20260709 12:23:02.614854  4372 leader_election.cc:336] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.615454  4372 leader_election.cc:304] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 899897e6794541b5ab538af361fc9e6c; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.617502 10339 raft_consensus.cc:2749] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.617894 10326 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.618650 10326 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:23:02.620123  4955 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111) [suppressed 496 similar messages]
I20260709 12:23:02.621141 10326 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.622555  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:23:02.624115  4987 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 17.
I20260709 12:23:02.625733  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
W20260709 12:23:02.628360  4372 leader_election.cc:336] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.629549 10326 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:02.630134 10326 raft_consensus.cc:493] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.630643 10326 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.640683 10326 raft_consensus.cc:515] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.647441 10311 raft_consensus.cc:493] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.648674  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d53e2537c9446fb3bf3c50fc0d5556" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:23:02.649235  4987 raft_consensus.cc:3060] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.648103 10311 raft_consensus.cc:515] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.651368 10311 leader_election.cc:290] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.655097  4955 leader_election.cc:336] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.656934  4956 leader_election.cc:336] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.657434  4956 leader_election.cc:304] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.658740 10311 raft_consensus.cc:2749] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:02.659332  4987 raft_consensus.cc:2468] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 18.
I20260709 12:23:02.660681  4371 leader_election.cc:304] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:23:02.661933 10339 raft_consensus.cc:2804] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:02.663203 10339 raft_consensus.cc:697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 18 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
W20260709 12:23:02.663636  4955 consensus_peers.cc:597] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.664218  4372 leader_election.cc:336] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.649446 10326 leader_election.cc:290] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.664459 10339 consensus_queue.cc:237] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.685725 10311 raft_consensus.cc:493] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.686563 10311 raft_consensus.cc:515] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.687070 10326 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.687623 10326 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.688657 10311 leader_election.cc:290] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:23:02.689553 10326 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.692790  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:23:02.693405  4987 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 17.
I20260709 12:23:02.694710 10338 raft_consensus.cc:493] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.694908  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:23:02.695279 10338 raft_consensus.cc:515] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.695921 10332 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:02.696287 10332 raft_consensus.cc:493] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.696635 10332 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.697367 10338 leader_election.cc:290] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.698613  4955 leader_election.cc:336] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.700695  4956 leader_election.cc:336] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.701148  4956 leader_election.cc:304] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.702515 10311 raft_consensus.cc:2749] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:02.703192  4955 leader_election.cc:336] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:02.706506  4956 leader_election.cc:336] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.706959  4956 leader_election.cc:304] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
W20260709 12:23:02.707509  4955 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:23:02.708865 10311 raft_consensus.cc:2749] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:02.709407  4372 leader_election.cc:336] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.711632 10332 raft_consensus.cc:515] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.712497  4153 catalog_manager.cc:5697] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c reported cstate change: term changed from 17 to 18, leader changed from b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130) to 899897e6794541b5ab538af361fc9e6c (127.3.7.131). New cstate: current_term: 18 leader_uuid: "899897e6794541b5ab538af361fc9e6c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:02.714767 10311 raft_consensus.cc:493] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.715256 10311 raft_consensus.cc:515] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.716781  4987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393ed0f79d194bc1a6199031055676bf" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:23:02.717636  4987 raft_consensus.cc:3060] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:02.721095 10311 leader_election.cc:290] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:02.725764  4372 leader_election.cc:336] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:02.726898  4955 leader_election.cc:336] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:02.727882  4956 leader_election.cc:336] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.728319  4956 leader_election.cc:304] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.729008 10311 raft_consensus.cc:2749] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:02.731972 10339 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.735623 10339 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.739063 10339 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.732601 10332 leader_election.cc:290] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.731405  4987 raft_consensus.cc:2468] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 18.
I20260709 12:23:02.740145  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27" is_pre_election: true
I20260709 12:23:02.740800  4986 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 11.
I20260709 12:23:02.740900  4371 leader_election.cc:304] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.742689  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: 
I20260709 12:23:02.743275 10332 raft_consensus.cc:2804] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:02.743502 10339 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:02.743860 10332 raft_consensus.cc:697] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 18 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:23:02.744266 10339 raft_consensus.cc:493] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
W20260709 12:23:02.744704  4372 leader_election.cc:336] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.744769 10339 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:02.745040 10332 consensus_queue.cc:237] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
W20260709 12:23:02.756830  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.761981 10339 raft_consensus.cc:515] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.768576 10339 leader_election.cc:290] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Requested vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 0952d204644f41a88e5e463e697dcc27 (127.3.7.132:43853)
I20260709 12:23:02.770027  4986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795c79b77a3c478183b1eaf256f074d5" candidate_uuid: "899897e6794541b5ab538af361fc9e6c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0952d204644f41a88e5e463e697dcc27"
I20260709 12:23:02.770623  4986 raft_consensus.cc:3060] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:02.770946  4955 consensus_peers.cc:597] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.771718  4372 leader_election.cc:336] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.776403  4986 raft_consensus.cc:2468] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 899897e6794541b5ab538af361fc9e6c in term 12.
I20260709 12:23:02.778252  4371 leader_election.cc:304] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27, 899897e6794541b5ab538af361fc9e6c; no voters: b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.778959 10339 raft_consensus.cc:2804] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:02.779487 10339 raft_consensus.cc:697] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Becoming Leader. State: Replica: 899897e6794541b5ab538af361fc9e6c, State: Running, Role: LEADER
I20260709 12:23:02.780347 10339 consensus_queue.cc:237] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.782647  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:02.784000  3102 tablet_replica.cc:333] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.785478 10311 raft_consensus.cc:493] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.785955 10311 raft_consensus.cc:515] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.784940  3102 raft_consensus.cc:2243] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.787868 10311 leader_election.cc:290] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:02.789556  4955 consensus_peers.cc:597] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.792979  4956 leader_election.cc:336] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:02.793421  3102 raft_consensus.cc:2272] T fdb68505c01944fb98aa2334aa5c28e9 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.794061  4955 leader_election.cc:336] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.795617  4955 leader_election.cc:304] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.798804 10311 raft_consensus.cc:2749] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:02.801327  3102 tablet_replica.cc:333] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.802075  3102 raft_consensus.cc:2243] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.802659  3102 raft_consensus.cc:2272] T 709bcc39a1e14a66abd5e1d758132d0a P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.806571  3102 tablet_replica.cc:333] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
W20260709 12:23:02.806874  4955 consensus_peers.cc:597] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.807577  3102 raft_consensus.cc:2243] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.807703 10311 raft_consensus.cc:493] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:02.808171 10311 raft_consensus.cc:515] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:02.808880  3102 raft_consensus.cc:2272] T 7d321543daa94c458a2b9ed5e9d553a3 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.810144 10311 leader_election.cc:290] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:23:02.811759  3102 tablet_replica.cc:333] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.812734  3102 raft_consensus.cc:2243] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.813577  3102 raft_consensus.cc:2272] T 7935718b80b24232b822244ef31fa44b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.814796  4956 leader_election.cc:336] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:02.815933  4955 leader_election.cc:336] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:02.816447  3102 tablet_replica.cc:333] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.816365  4955 leader_election.cc:304] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:02.817320  3102 raft_consensus.cc:2243] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.817790 10338 raft_consensus.cc:2749] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:23:02.818540  3102 raft_consensus.cc:2272] T 4c52d75f63d54dbeba6b3c868117e4c4 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.821826  3102 tablet_replica.cc:333] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.822724  3102 raft_consensus.cc:2243] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.823349  3102 raft_consensus.cc:2272] T 6bee4570f5474c8f916b3144395312d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.825757  3102 tablet_replica.cc:333] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.826377  3102 raft_consensus.cc:2243] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.826819  3102 raft_consensus.cc:2272] T c64033b0103b421a95ee1540d4b31df5 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.828658  3102 tablet_replica.cc:333] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.829210  3102 raft_consensus.cc:2243] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.830034  3102 raft_consensus.cc:2272] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.831974  3102 tablet_replica.cc:333] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.832592  3102 raft_consensus.cc:2243] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.833561  3102 raft_consensus.cc:2272] T c18183fd904d43f68b0e600ddb8ae249 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.836165  3102 tablet_replica.cc:333] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.836866  3102 raft_consensus.cc:2243] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.837917  3102 raft_consensus.cc:2272] T 8afcac1f47834987ac3889edd37f61a3 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.840245  3102 tablet_replica.cc:333] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
W20260709 12:23:02.840386  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.840914  3102 raft_consensus.cc:2243] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.841792  3102 raft_consensus.cc:2272] T 7b29d30a957d40fdbc729fc5e9955b1b P 899897e6794541b5ab538af361fc9e6c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.843729  3102 tablet_replica.cc:333] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.844277  3102 raft_consensus.cc:2243] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.845268  3102 raft_consensus.cc:2272] T 90175b58ea034e69b889717ca0ad0333 P 899897e6794541b5ab538af361fc9e6c [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.847977  3102 tablet_replica.cc:333] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.848781  3102 raft_consensus.cc:2243] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.849418  3102 raft_consensus.cc:2272] T 01644bc7ce5c458c882adfcf42aa8d83 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.849983  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:02.851542  4955 consensus_peers.cc:597] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.852001  3102 tablet_replica.cc:333] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.852694  3102 raft_consensus.cc:2243] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.853641  3102 raft_consensus.cc:2272] T 6675e0fefdad403abd03803e0c2bf3dd P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.856063  3102 tablet_replica.cc:333] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.856810  3102 raft_consensus.cc:2243] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.857396  3102 raft_consensus.cc:2272] T c75e006bba424d8b9ae7dfa589237877 P 899897e6794541b5ab538af361fc9e6c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.859480  3102 tablet_replica.cc:333] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.860025  3102 raft_consensus.cc:2243] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.860875  3102 raft_consensus.cc:2272] T 1abb211136c54a29beecc019715aaa2d P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.863095  3102 tablet_replica.cc:333] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.864048  3102 raft_consensus.cc:2243] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.864559  3102 raft_consensus.cc:2272] T 78ee025f73f248629704f4ff6eaad5a0 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.866882  3102 tablet_replica.cc:333] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.867623  3102 raft_consensus.cc:2243] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.868490  3102 raft_consensus.cc:2272] T 853b8c508a614bb4b9fdc0c62fe13342 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.870994  3102 tablet_replica.cc:333] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.871732  3102 raft_consensus.cc:2243] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.873013  3102 pending_rounds.cc:70] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Trying to abort 1 pending ops.
I20260709 12:23:02.873358  3102 pending_rounds.cc:77] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c: Aborting op as it isn't in flight: id { term: 12 index: 10 } timestamp: 7305624710277750784 op_type: NO_OP noop_request { }
I20260709 12:23:02.873740  3102 raft_consensus.cc:2889] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:02.874058  3102 raft_consensus.cc:2272] T 795c79b77a3c478183b1eaf256f074d5 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.876436  3102 tablet_replica.cc:333] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.877208  3102 raft_consensus.cc:2243] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.878049  3102 raft_consensus.cc:2272] T 4d4dedbb3ee0412db92c974e0c25a776 P 899897e6794541b5ab538af361fc9e6c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.880605  3102 tablet_replica.cc:333] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.881253  3102 raft_consensus.cc:2243] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:23:02.881204  4955 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.882323  3102 raft_consensus.cc:2272] T 34ae0ae4c14d4870b094e2733b40e647 P 899897e6794541b5ab538af361fc9e6c [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.884423  3102 tablet_replica.cc:333] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.885143  3102 raft_consensus.cc:2243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.886044  3102 pending_rounds.cc:70] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Trying to abort 1 pending ops.
I20260709 12:23:02.886351  3102 pending_rounds.cc:77] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305624709809901568 op_type: NO_OP noop_request { }
I20260709 12:23:02.886694  3102 raft_consensus.cc:2889] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:02.887015  3102 raft_consensus.cc:2272] T b9d53e2537c9446fb3bf3c50fc0d5556 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.889184  3102 tablet_replica.cc:333] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.889737  3102 raft_consensus.cc:2243] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.890393  3102 raft_consensus.cc:2272] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.892705  3102 tablet_replica.cc:333] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.893503  3102 raft_consensus.cc:2243] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.894541  3102 raft_consensus.cc:2272] T 01f50fa8d8c34c06a67470615046629f P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.895140  4955 consensus_peers.cc:597] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.896909  3102 tablet_replica.cc:333] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.897766  3102 raft_consensus.cc:2243] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.898823  3102 raft_consensus.cc:2272] T e070006215b747e39d88b78e59a78364 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.901242  3102 tablet_replica.cc:333] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.901871  3102 raft_consensus.cc:2243] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.902449  3102 raft_consensus.cc:2272] T 53b63478950f49c4a21f85e72a0a2218 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.904901  3102 tablet_replica.cc:333] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.905517  3102 raft_consensus.cc:2243] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.905946  3102 raft_consensus.cc:2272] T a08fb4e151924fb6944c6a5f82c4f9d2 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.908269  3102 tablet_replica.cc:333] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.909021  3102 raft_consensus.cc:2243] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.909883  3102 pending_rounds.cc:70] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Trying to abort 1 pending ops.
I20260709 12:23:02.910147  3102 pending_rounds.cc:77] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c: Aborting op as it isn't in flight: id { term: 18 index: 15 } timestamp: 7305624710134439936 op_type: NO_OP noop_request { }
I20260709 12:23:02.910502  3102 raft_consensus.cc:2889] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:02.910820  3102 raft_consensus.cc:2272] T 393ed0f79d194bc1a6199031055676bf P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.911103  4955 consensus_peers.cc:597] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.913341  3102 tablet_replica.cc:333] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.914083  3102 raft_consensus.cc:2243] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.914726  3102 raft_consensus.cc:2272] T 6aa28105446e4c7c9261f9a99c5dc017 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.917219  3102 tablet_replica.cc:333] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
W20260709 12:23:02.917703  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.917984  3102 raft_consensus.cc:2243] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.918736  3102 raft_consensus.cc:2272] T a0fa0b9753bf4f05871dfa6b329de33a P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.921144  3102 tablet_replica.cc:333] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.921886  3102 raft_consensus.cc:2243] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.922435  3102 raft_consensus.cc:2272] T 374e8fa3690a41af9874f32b270bf3e1 P 899897e6794541b5ab538af361fc9e6c [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:02.924125  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:02.924777  3102 tablet_replica.cc:333] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.925385  3102 raft_consensus.cc:2243] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.925843  3102 raft_consensus.cc:2272] T bf5e08eda6fd4363b1af431c73621515 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.927901  3102 tablet_replica.cc:333] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.928704  3102 raft_consensus.cc:2243] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.929327  3102 raft_consensus.cc:2272] T 0d57b9080cd745529aba05aa6b7a640e P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.931953  3102 tablet_replica.cc:333] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.932610  3102 raft_consensus.cc:2243] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.933187  3102 raft_consensus.cc:2272] T 520cf0102a3945aebdd2da293d919a52 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.935714  3102 tablet_replica.cc:333] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.936269  3102 raft_consensus.cc:2243] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.936728  3102 raft_consensus.cc:2272] T 68963fca87f1465babfafe629c276422 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.938724  3102 tablet_replica.cc:333] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.939250  3102 raft_consensus.cc:2243] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.939782  3102 raft_consensus.cc:2272] T 57d10956b3f84b66bce8c7e86299d1fa P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.941910  3102 tablet_replica.cc:333] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.942449  3102 raft_consensus.cc:2243] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.943363  3102 raft_consensus.cc:2272] T f77d531cd9f54dcbb332d1ff622d8443 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.945720  3102 tablet_replica.cc:333] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.946417  3102 raft_consensus.cc:2243] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.947531  3102 raft_consensus.cc:2272] T a2c18c2d1c094cb9a849a72508c8962f P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.949976  3102 tablet_replica.cc:333] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.950680  3102 raft_consensus.cc:2243] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.951330  3102 raft_consensus.cc:2272] T 1c970994e11f4080b5624db5219101b4 P 899897e6794541b5ab538af361fc9e6c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.953830  3102 tablet_replica.cc:333] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.954485  3102 raft_consensus.cc:2243] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.955152  3102 raft_consensus.cc:2272] T e2742c399a2d4e5dae60161a45cce316 P 899897e6794541b5ab538af361fc9e6c [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.957798  3102 tablet_replica.cc:333] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.958437  3102 raft_consensus.cc:2243] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.962968  3102 raft_consensus.cc:2272] T be5f00fff96847178a1970711feff2f0 P 899897e6794541b5ab538af361fc9e6c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.965487  3102 tablet_replica.cc:333] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.966138  3102 raft_consensus.cc:2243] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.967010  3102 raft_consensus.cc:2272] T 9f8081e75d074f30b97f8a1542e86cec P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.968968  3102 tablet_replica.cc:333] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.969472  3102 raft_consensus.cc:2243] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.970005  3102 raft_consensus.cc:2272] T b3c4a4b844fc4fd39fac73554dc3d8d8 P 899897e6794541b5ab538af361fc9e6c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.971956  3102 tablet_replica.cc:333] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.972441  3102 raft_consensus.cc:2243] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:02.973042  3102 raft_consensus.cc:2272] T 752b8a9170934f31b770429d237cdb43 P 899897e6794541b5ab538af361fc9e6c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:02.974892  3102 tablet_replica.cc:333] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c: stopping tablet replica
I20260709 12:23:02.975399  3102 raft_consensus.cc:2243] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:02.976281  3102 raft_consensus.cc:2272] T dd8463b2beaf488989ffd8e005249050 P 899897e6794541b5ab538af361fc9e6c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:03.000411  4955 consensus_peers.cc:597] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:03.008594  4955 consensus_peers.cc:597] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:03.013059  4955 consensus_peers.cc:597] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:03.013902  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:03.023448  4955 consensus_peers.cc:597] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Couldn't send request to peer 899897e6794541b5ab538af361fc9e6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:03.224519  4955 consensus_peers.cc:597] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:03.404207  4955 consensus_peers.cc:597] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:03.487457  4955 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:03.506114  4955 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:03.517729  4955 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:03.640625  4956 consensus_peers.cc:597] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.646613  4956 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.726235  4956 consensus_peers.cc:597] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.769925  4956 consensus_peers.cc:597] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.776959  4956 consensus_peers.cc:597] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.787273  4956 consensus_peers.cc:597] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.841483  4955 consensus_peers.cc:597] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:03.841991  4955 consensus_peers.cc:597] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:03.870785  4956 consensus_peers.cc:597] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.876264  4956 consensus_peers.cc:597] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:03.893720 10338 raft_consensus.cc:493] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:03.894335 10338 raft_consensus.cc:515] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:03.896377 10338 leader_election.cc:290] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:03.900015  4955 leader_election.cc:336] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
W20260709 12:23:03.902693  4955 consensus_peers.cc:597] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:03.903106  4955 leader_election.cc:336] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:03.903692  4955 leader_election.cc:304] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:23:03.904415 10338 raft_consensus.cc:2749] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:03.913511  4955 consensus_peers.cc:597] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 -> Peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Couldn't send request to peer 0aa405b398df42edbf74ee643aeb18dc. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:03.920680  4956 consensus_peers.cc:597] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:03.933426 10338 raft_consensus.cc:493] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:03.934028 10338 raft_consensus.cc:515] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:03.936204 10338 leader_election.cc:290] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:03.938616  4956 consensus_peers.cc:597] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:03.945103  4955 leader_election.cc:336] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:03.946105  4955 leader_election.cc:336] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
I20260709 12:23:03.946497  4955 leader_election.cc:304] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:23:03.947197 10338 raft_consensus.cc:2749] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:03.949254 10338 raft_consensus.cc:493] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:03.949718 10338 raft_consensus.cc:515] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:03.951867 10338 leader_election.cc:290] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:03.956276  4955 leader_election.cc:336] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
W20260709 12:23:03.958606  4956 leader_election.cc:336] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:03.959018  4956 leader_election.cc:304] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:03.960199 10338 raft_consensus.cc:2749] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.006183  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
W20260709 12:23:04.018422  4956 consensus_peers.cc:597] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:04.021155  4956 consensus_peers.cc:597] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:04.033303  4956 consensus_peers.cc:597] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:04.090103  4956 consensus_peers.cc:597] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 -> Peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Couldn't send request to peer b3efae3bdfff46bb9bbff1ed1ea70a90. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:04.099925 10338 raft_consensus.cc:493] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:04.100721 10338 raft_consensus.cc:515] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.103257 10338 leader_election.cc:290] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:04.109369  4955 leader_election.cc:336] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:04.110210  4955 leader_election.cc:336] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
I20260709 12:23:04.110639  4955 leader_election.cc:304] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:23:04.111460 10338 raft_consensus.cc:2749] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:04.133319  3102 tablet_server.cc:179] TabletServer@127.3.7.132:0 shutting down...
I20260709 12:23:04.139523 10311 raft_consensus.cc:493] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:04.140211 10311 raft_consensus.cc:515] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.142369 10311 leader_election.cc:290] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:04.150362  4956 leader_election.cc:336] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:04.155987  4955 leader_election.cc:336] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
I20260709 12:23:04.156773  4955 leader_election.cc:304] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:04.158020 10338 raft_consensus.cc:2749] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:04.180061 10338 raft_consensus.cc:493] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:04.180663 10338 raft_consensus.cc:515] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.187103 10338 leader_election.cc:290] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
W20260709 12:23:04.194514  4955 leader_election.cc:336] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
W20260709 12:23:04.196365  4956 leader_election.cc:336] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:04.196753  4956 leader_election.cc:304] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:04.197544 10338 raft_consensus.cc:2749] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:04.211669  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:04.212989  3102 tablet_replica.cc:333] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.213896  3102 raft_consensus.cc:2243] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.214592  3102 raft_consensus.cc:2272] T 8afcac1f47834987ac3889edd37f61a3 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.214783 10338 raft_consensus.cc:493] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:04.215435 10338 raft_consensus.cc:515] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.217775  3102 tablet_replica.cc:333] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.217415 10338 leader_election.cc:290] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:23:04.218799  3102 raft_consensus.cc:2243] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.219504  3102 raft_consensus.cc:2272] T 4079a3fa5d6b4cafa2f9b17573d0e1b0 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.222492  3102 tablet_replica.cc:333] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.223488  3102 raft_consensus.cc:2243] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:23:04.224103  4955 leader_election.cc:336] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:04.224748  3102 raft_consensus.cc:2272] T fd41dc8658414bcfb8662c0efe3caffc P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:04.224781  4955 leader_election.cc:336] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
I20260709 12:23:04.225468  4955 leader_election.cc:304] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:23:04.226136 10338 raft_consensus.cc:2749] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:04.228024  3102 tablet_replica.cc:333] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.228192 10338 raft_consensus.cc:493] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b3efae3bdfff46bb9bbff1ed1ea70a90)
I20260709 12:23:04.229066  3102 raft_consensus.cc:2243] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.228813 10338 raft_consensus.cc:515] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.230240  3102 raft_consensus.cc:2272] T bac26358ed7f4644aa3f5b040afcdca4 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.233454  3102 tablet_replica.cc:333] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.234400  3102 raft_consensus.cc:2243] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.235134  3102 raft_consensus.cc:2272] T a2c18c2d1c094cb9a849a72508c8962f P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.238267  3102 tablet_replica.cc:333] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.238399 10338 leader_election.cc:290] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725)
I20260709 12:23:04.239216  3102 raft_consensus.cc:2243] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.240476  3102 raft_consensus.cc:2272] T d97e8a8c644540508f2457db68e20be8 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.243492  3102 tablet_replica.cc:333] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.244324  3102 raft_consensus.cc:2243] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.245031  3102 raft_consensus.cc:2272] T 90175b58ea034e69b889717ca0ad0333 P 0952d204644f41a88e5e463e697dcc27 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.247911  3102 tablet_replica.cc:333] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
W20260709 12:23:04.247877  4956 leader_election.cc:336] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
W20260709 12:23:04.248770  4955 leader_election.cc:336] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:04.249007  3102 raft_consensus.cc:2243] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.249217  4955 leader_election.cc:304] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:04.249825  3102 raft_consensus.cc:2272] T a7d14a1bca614fe1af748ef119552803 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.250144 10350 raft_consensus.cc:2749] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:04.252854  3102 tablet_replica.cc:333] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.253254 10350 raft_consensus.cc:493] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:04.253777  3102 raft_consensus.cc:2243] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.253746 10350 raft_consensus.cc:515] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b3efae3bdfff46bb9bbff1ed1ea70a90" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42725 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.254988  3102 raft_consensus.cc:2272] T c75e006bba424d8b9ae7dfa589237877 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.257961  3102 tablet_replica.cc:333] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.258837  3102 raft_consensus.cc:2243] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.259963  3102 raft_consensus.cc:2272] T 6aa28105446e4c7c9261f9a99c5dc017 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:04.261654  4955 leader_election.cc:336] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
I20260709 12:23:04.262466 10350 leader_election.cc:290] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
I20260709 12:23:04.262893  3102 tablet_replica.cc:333] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
W20260709 12:23:04.263438  4956 leader_election.cc:336] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b3efae3bdfff46bb9bbff1ed1ea70a90 (127.3.7.130:42725): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42725: connect: Connection refused (error 111)
I20260709 12:23:04.263741  3102 raft_consensus.cc:2243] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.263945  4956 leader_election.cc:304] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 899897e6794541b5ab538af361fc9e6c, b3efae3bdfff46bb9bbff1ed1ea70a90
I20260709 12:23:04.264397  3102 raft_consensus.cc:2272] T b18524a049aa4e8687009c73a015e710 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.264794 10350 raft_consensus.cc:2749] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:04.267472  3102 tablet_replica.cc:333] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.268419  3102 raft_consensus.cc:2243] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.269963  3102 raft_consensus.cc:2272] T 4d4dedbb3ee0412db92c974e0c25a776 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.273027  3102 tablet_replica.cc:333] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.273869  3102 raft_consensus.cc:2243] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.274451  3102 raft_consensus.cc:2272] T 795c79b77a3c478183b1eaf256f074d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.277494  3102 tablet_replica.cc:333] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.280181  3102 raft_consensus.cc:2243] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.280900  3102 raft_consensus.cc:2272] T 7092b1e5ebf04097a82982b4008c4d7e P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.283643  3102 tablet_replica.cc:333] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.284437  3102 raft_consensus.cc:2243] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.285574  3102 raft_consensus.cc:2272] T 68963fca87f1465babfafe629c276422 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.288785  3102 tablet_replica.cc:333] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.289696  3102 raft_consensus.cc:2243] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.290817  3102 raft_consensus.cc:2272] T bf5e08eda6fd4363b1af431c73621515 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.293704  3102 tablet_replica.cc:333] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.294723  3102 raft_consensus.cc:2243] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.295782  3102 raft_consensus.cc:2272] T 752b8a9170934f31b770429d237cdb43 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.298491  3102 tablet_replica.cc:333] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.299264  3102 raft_consensus.cc:2243] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.299950  3102 raft_consensus.cc:2272] T dd8463b2beaf488989ffd8e005249050 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.304838 10350 raft_consensus.cc:493] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 899897e6794541b5ab538af361fc9e6c)
I20260709 12:23:04.305351 10350 raft_consensus.cc:515] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa405b398df42edbf74ee643aeb18dc" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 34061 } } peers { permanent_uuid: "899897e6794541b5ab538af361fc9e6c" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 36481 } } peers { permanent_uuid: "0952d204644f41a88e5e463e697dcc27" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 43853 } attrs { promote: false } }
I20260709 12:23:04.306205  3102 tablet_replica.cc:333] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.307061  3102 raft_consensus.cc:2243] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.307240 10350 leader_election.cc:290] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061), 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481)
W20260709 12:23:04.310601  4958 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.312103  3102 raft_consensus.cc:2272] T 7935718b80b24232b822244ef31fa44b P 0952d204644f41a88e5e463e697dcc27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.315446  3102 tablet_replica.cc:333] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
W20260709 12:23:04.315922  4955 leader_election.cc:336] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aa405b398df42edbf74ee643aeb18dc (127.3.7.129:34061): Network error: Client connection negotiation failed: client connection to 127.3.7.129:34061: connect: Connection refused (error 111)
I20260709 12:23:04.316404  3102 raft_consensus.cc:2243] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.317519  3102 raft_consensus.cc:2272] T 01644bc7ce5c458c882adfcf42aa8d83 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:04.318696  4955 leader_election.cc:336] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 899897e6794541b5ab538af361fc9e6c (127.3.7.131:36481): Network error: Client connection negotiation failed: client connection to 127.3.7.131:36481: connect: Connection refused (error 111)
I20260709 12:23:04.319234  4955 leader_election.cc:304] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0952d204644f41a88e5e463e697dcc27; no voters: 0aa405b398df42edbf74ee643aeb18dc, 899897e6794541b5ab538af361fc9e6c
I20260709 12:23:04.320456 10350 raft_consensus.cc:2749] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:04.320812  3102 tablet_replica.cc:333] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.322018  3102 raft_consensus.cc:2243] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.322598  3102 raft_consensus.cc:2272] T 6675e0fefdad403abd03803e0c2bf3dd P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.325213  3102 tablet_replica.cc:333] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.326225  3102 raft_consensus.cc:2243] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.326921  3102 raft_consensus.cc:2272] T fdb68505c01944fb98aa2334aa5c28e9 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.330015  3102 tablet_replica.cc:333] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.330974  3102 raft_consensus.cc:2243] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.332293  3102 raft_consensus.cc:2272] T 53b63478950f49c4a21f85e72a0a2218 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.335481  3102 tablet_replica.cc:333] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.336527  3102 raft_consensus.cc:2243] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.337836  3102 raft_consensus.cc:2272] T 374e8fa3690a41af9874f32b270bf3e1 P 0952d204644f41a88e5e463e697dcc27 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.341234  3102 tablet_replica.cc:333] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.342125  3102 raft_consensus.cc:2243] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.342789  3102 raft_consensus.cc:2272] T 2f35b6d3672d440581ae00175c31e5b7 P 0952d204644f41a88e5e463e697dcc27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.345614  3102 tablet_replica.cc:333] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.346403  3102 raft_consensus.cc:2243] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.347571  3102 raft_consensus.cc:2272] T 1c970994e11f4080b5624db5219101b4 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.350466  3102 tablet_replica.cc:333] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.351500  3102 raft_consensus.cc:2243] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.352229  3102 raft_consensus.cc:2272] T f77d531cd9f54dcbb332d1ff622d8443 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.355405  3102 tablet_replica.cc:333] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.356530  3102 raft_consensus.cc:2243] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.358078  3102 raft_consensus.cc:2272] T c18183fd904d43f68b0e600ddb8ae249 P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.361039  3102 tablet_replica.cc:333] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.361981  3102 raft_consensus.cc:2243] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.362577  3102 raft_consensus.cc:2272] T ff19d9953d5b4cddb487ccf873740dee P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.365461  3102 tablet_replica.cc:333] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.366303  3102 raft_consensus.cc:2243] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.366979  3102 raft_consensus.cc:2272] T 853b8c508a614bb4b9fdc0c62fe13342 P 0952d204644f41a88e5e463e697dcc27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.369861  3102 tablet_replica.cc:333] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.370644  3102 raft_consensus.cc:2243] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.371196  3102 raft_consensus.cc:2272] T 66d0cf9ce16c45e399c41f8f0bfb5e32 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.374358  3102 tablet_replica.cc:333] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.375234  3102 raft_consensus.cc:2243] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.376642  3102 raft_consensus.cc:2272] T 6bee4570f5474c8f916b3144395312d5 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.379487  3102 tablet_replica.cc:333] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.380298  3102 raft_consensus.cc:2243] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.381457  3102 raft_consensus.cc:2272] T 78ee025f73f248629704f4ff6eaad5a0 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.384405  3102 tablet_replica.cc:333] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.385346  3102 raft_consensus.cc:2243] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.385993  3102 raft_consensus.cc:2272] T 393ed0f79d194bc1a6199031055676bf P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.388810  3102 tablet_replica.cc:333] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.389559  3102 raft_consensus.cc:2243] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.390805  3102 raft_consensus.cc:2272] T 446eb926cc6444ab93580e61ad7fc581 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.393898  3102 tablet_replica.cc:333] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.394758  3102 raft_consensus.cc:2243] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.395398  3102 raft_consensus.cc:2272] T 987201f60eb64f869c89f0703e622738 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.398268  3102 tablet_replica.cc:333] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.399215  3102 raft_consensus.cc:2243] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.400434  3102 raft_consensus.cc:2272] T b22e067af7004ed88fb3125c7ac731ad P 0952d204644f41a88e5e463e697dcc27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.403679  3102 tablet_replica.cc:333] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.404456  3102 raft_consensus.cc:2243] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.405731  3102 raft_consensus.cc:2272] T 520cf0102a3945aebdd2da293d919a52 P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.408489  3102 tablet_replica.cc:333] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.409273  3102 raft_consensus.cc:2243] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.410030  3102 raft_consensus.cc:2272] T b9d53e2537c9446fb3bf3c50fc0d5556 P 0952d204644f41a88e5e463e697dcc27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.412560  3102 tablet_replica.cc:333] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.413241  3102 raft_consensus.cc:2243] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.413805  3102 raft_consensus.cc:2272] T 7f8c0670d52b4df8ad46e1549814b7a8 P 0952d204644f41a88e5e463e697dcc27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.416369  3102 tablet_replica.cc:333] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.417022  3102 raft_consensus.cc:2243] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.417533  3102 raft_consensus.cc:2272] T 1abb211136c54a29beecc019715aaa2d P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.420087  3102 tablet_replica.cc:333] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.420739  3102 raft_consensus.cc:2243] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.421725  3102 raft_consensus.cc:2272] T a08fb4e151924fb6944c6a5f82c4f9d2 P 0952d204644f41a88e5e463e697dcc27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.424295  3102 tablet_replica.cc:333] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.425101  3102 raft_consensus.cc:2243] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.426277  3102 raft_consensus.cc:2272] T e2742c399a2d4e5dae60161a45cce316 P 0952d204644f41a88e5e463e697dcc27 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.429003  3102 tablet_replica.cc:333] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.429630  3102 raft_consensus.cc:2243] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:04.430194  3102 raft_consensus.cc:2272] T 631cc1317abe4f99b307dee5289f9258 P 0952d204644f41a88e5e463e697dcc27 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.432767  3102 tablet_replica.cc:333] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27: stopping tablet replica
I20260709 12:23:04.433350  3102 raft_consensus.cc:2243] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:23:04.434689  3102 raft_consensus.cc:2272] T 89ea196b53354b90b1803ebad82f35ff P 0952d204644f41a88e5e463e697dcc27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:04.999841  3102 tablet_server.cc:196] TabletServer@127.3.7.132:0 shutdown complete.
I20260709 12:23:05.082710  3102 master.cc:562] Master@127.3.7.190:34185 shutting down...
W20260709 12:23:05.127266  4201 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:23:05.127631  4201 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:23:05.127866  4201 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:23:05.131068  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:05.131705  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:05.132077  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6ff35c4ac1544009dec2b8d57867ced: stopping tablet replica
I20260709 12:23:05.268541  3102 master.cc:584] Master@127.3.7.190:34185 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (204384 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:23:05.382383  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:35777
I20260709 12:23:05.383561  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:05.390419 10354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.390798 10352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.390866 10351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.392100  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:05.395618  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:05.395857  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:05.396054  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599785396029 us; error 0 us; skew 500 ppm
I20260709 12:23:05.396617  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:05.399184  3102 webserver.cc:533] Webserver started at http://127.3.7.190:35671/ using document root <none> and password file <none>
I20260709 12:23:05.399766  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:05.399971  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:05.400257  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:05.401437  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "9f6d3cbc67744fca86e03623203f37d0"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.406432  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:05.409929 10359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.410872  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:05.411247  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "9f6d3cbc67744fca86e03623203f37d0"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.411562  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:05.428619  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:05.429843  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:05.472775  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:35777
I20260709 12:23:05.472900 10411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:35777 every 8 connection(s)
I20260709 12:23:05.477181 10412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.488735 10412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0: Bootstrap starting.
I20260709 12:23:05.494279 10412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:05.499104 10412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0: No bootstrap required, opened a new log
I20260709 12:23:05.501663 10412 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6d3cbc67744fca86e03623203f37d0" member_type: VOTER }
I20260709 12:23:05.502095 10412 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:05.502408 10412 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f6d3cbc67744fca86e03623203f37d0, State: Initialized, Role: FOLLOWER
I20260709 12:23:05.503127 10412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6d3cbc67744fca86e03623203f37d0" member_type: VOTER }
I20260709 12:23:05.503741 10412 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:05.504022 10412 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:05.504598 10412 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:05.509853 10412 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6d3cbc67744fca86e03623203f37d0" member_type: VOTER }
I20260709 12:23:05.510461 10412 leader_election.cc:304] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f6d3cbc67744fca86e03623203f37d0; no voters: 
I20260709 12:23:05.511812 10412 leader_election.cc:290] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:05.512225 10415 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:05.513818 10415 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 1 LEADER]: Becoming Leader. State: Replica: 9f6d3cbc67744fca86e03623203f37d0, State: Running, Role: LEADER
I20260709 12:23:05.514554 10415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6d3cbc67744fca86e03623203f37d0" member_type: VOTER }
I20260709 12:23:05.514869 10412 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:05.519349 10416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f6d3cbc67744fca86e03623203f37d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6d3cbc67744fca86e03623203f37d0" member_type: VOTER } }
I20260709 12:23:05.519416 10417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f6d3cbc67744fca86e03623203f37d0. Latest consensus state: current_term: 1 leader_uuid: "9f6d3cbc67744fca86e03623203f37d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f6d3cbc67744fca86e03623203f37d0" member_type: VOTER } }
I20260709 12:23:05.520414 10416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:05.520592 10417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:05.523736 10422 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:05.528637 10422 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:05.538543 10422 catalog_manager.cc:1383] Generated new cluster ID: 16b385f55dd446749f3a5a7c4745a59d
I20260709 12:23:05.538877 10422 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:05.539446  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:05.567874 10422 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:05.569213 10422 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:05.585332 10422 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0: Generated new TSK 0
I20260709 12:23:05.585992 10422 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:05.606084  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:05.614099 10434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.614091 10433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.617432 10436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.618793  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:05.620852  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:05.621104  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:05.621280  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599785621255 us; error 0 us; skew 500 ppm
I20260709 12:23:05.621877  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:05.628631  3102 webserver.cc:533] Webserver started at http://127.3.7.129:38985/ using document root <none> and password file <none>
I20260709 12:23:05.629274  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:05.629520  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:05.629937  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:05.631788  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "bb8b600238cd49d29a1bd59a571ab995"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.636878  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:05.641062 10441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.641981  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:05.642364  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "bb8b600238cd49d29a1bd59a571ab995"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.642678  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:05.664474  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:05.665812  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:05.667526  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:05.670130  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:05.670339  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.670677  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:05.670853  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.716420  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:45267
I20260709 12:23:05.716527 10503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:45267 every 8 connection(s)
I20260709 12:23:05.722235  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:05.731822 10508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.734685 10509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.735909 10511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.737571  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:05.740005  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:05.740207  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:05.740411  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599785740396 us; error 0 us; skew 500 ppm
I20260709 12:23:05.740994  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:05.743623  3102 webserver.cc:533] Webserver started at http://127.3.7.130:44585/ using document root <none> and password file <none>
I20260709 12:23:05.744303  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:05.744567  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:05.744915  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:05.746529  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "2da3f34a85954a319ed87fd378e5e661"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.746658 10504 heartbeater.cc:344] Connected to a master server at 127.3.7.190:35777
I20260709 12:23:05.747098 10504 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:05.748062 10504 heartbeater.cc:507] Master 127.3.7.190:35777 requested a full tablet report, sending...
I20260709 12:23:05.750562 10376 ts_manager.cc:194] Registered new tserver with Master: bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:05.752346  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:23:05.752849 10376 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47540
I20260709 12:23:05.756729 10516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.757746  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:23:05.758072  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "2da3f34a85954a319ed87fd378e5e661"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.758327  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:05.782800  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:05.784168  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:05.785665  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:05.787914  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:05.788142  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.788385  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:05.788555  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.831775  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:42241
I20260709 12:23:05.831951 10579 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:42241 every 8 connection(s)
I20260709 12:23:05.836983  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:05.844661 10583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.847496 10584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.852732 10580 heartbeater.cc:344] Connected to a master server at 127.3.7.190:35777
I20260709 12:23:05.853226  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:05.853340 10580 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:05.854861 10580 heartbeater.cc:507] Master 127.3.7.190:35777 requested a full tablet report, sending...
W20260709 12:23:05.853322 10586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.857470  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:05.857772  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:05.858094  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599785858068 us; error 0 us; skew 500 ppm
I20260709 12:23:05.858018 10376 ts_manager.cc:194] Registered new tserver with Master: 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:05.859143  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:05.860587 10376 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47550
I20260709 12:23:05.863090  3102 webserver.cc:533] Webserver started at http://127.3.7.131:45019/ using document root <none> and password file <none>
I20260709 12:23:05.864012  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:05.864295  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:05.864668  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:05.866484  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "5703388aa4f747c280bf93e578f6bad7"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.874051  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:23:05.879014 10591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.880231  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:23:05.880687  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "5703388aa4f747c280bf93e578f6bad7"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.881074  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:05.912770  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:05.914075  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:05.915441  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:05.917881  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:05.918114  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.918391  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:05.918567  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.960464  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:37591
I20260709 12:23:05.960566 10653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:37591 every 8 connection(s)
I20260709 12:23:05.965488  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:05.972925 10657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:05.974776 10658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.978145  3102 server_base.cc:1061] running on GCE node
W20260709 12:23:05.978521 10660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:05.979314 10654 heartbeater.cc:344] Connected to a master server at 127.3.7.190:35777
I20260709 12:23:05.979719 10654 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:05.979728  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:05.980171  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:05.980371  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599785980356 us; error 0 us; skew 500 ppm
I20260709 12:23:05.980588 10654 heartbeater.cc:507] Master 127.3.7.190:35777 requested a full tablet report, sending...
I20260709 12:23:05.981053  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:05.982649 10376 ts_manager.cc:194] Registered new tserver with Master: 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:05.984122  3102 webserver.cc:533] Webserver started at http://127.3.7.132:36717/ using document root <none> and password file <none>
I20260709 12:23:05.984359 10376 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47558
I20260709 12:23:05.984710  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:05.984979  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:05.985265  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:05.986418  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-3-root/instance:
uuid: "becf98b94b704731a507d96d1a44737c"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.991891  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:23:05.995514 10665 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:05.996263  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:23:05.996601  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-3-root
uuid: "becf98b94b704731a507d96d1a44737c"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:05.996904  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:06.010592  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:06.011965  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:06.013535  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:06.015888  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:06.016104  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.016367  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:06.016615  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:06.068549  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.132:42917
I20260709 12:23:06.068655 10728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.132:42917 every 8 connection(s)
I20260709 12:23:06.083590 10729 heartbeater.cc:344] Connected to a master server at 127.3.7.190:35777
I20260709 12:23:06.084126 10729 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:06.085003 10729 heartbeater.cc:507] Master 127.3.7.190:35777 requested a full tablet report, sending...
I20260709 12:23:06.087109 10376 ts_manager.cc:194] Registered new tserver with Master: becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:06.087244  3102 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015469769s
I20260709 12:23:06.089020 10376 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47560
I20260709 12:23:06.114140 10376 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47574:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:23:06.389599 10545 tablet_service.cc:1511] Processing CreateTablet for tablet 814d4d8348e448728625bdcbaf25f440 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:06.391070 10545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814d4d8348e448728625bdcbaf25f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.396651 10616 tablet_service.cc:1511] Processing CreateTablet for tablet f1674e84a5d245b4aa6ed2f18f24cf87 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:06.398119 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1674e84a5d245b4aa6ed2f18f24cf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.400568 10690 tablet_service.cc:1511] Processing CreateTablet for tablet 935517510de547e9a555aa468eea1a10 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:06.402161 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935517510de547e9a555aa468eea1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.403599 10692 tablet_service.cc:1511] Processing CreateTablet for tablet abfc8bc479844f489e1971345747ec0a (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:06.404526 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 7083196608e84b20b65b0c53c528d4d3 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:06.405042 10692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfc8bc479844f489e1971345747ec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.405920 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7083196608e84b20b65b0c53c528d4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.408489 10688 tablet_service.cc:1511] Processing CreateTablet for tablet e7a83257d2814ade9d44473bff639778 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:06.409881 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a83257d2814ade9d44473bff639778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.391851 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 935517510de547e9a555aa468eea1a10 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:06.412135 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935517510de547e9a555aa468eea1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.411976 10686 tablet_service.cc:1511] Processing CreateTablet for tablet 72e198a442da43a78d7375424fa47317 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:06.392760 10614 tablet_service.cc:1511] Processing CreateTablet for tablet 7083196608e84b20b65b0c53c528d4d3 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:06.413378 10686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e198a442da43a78d7375424fa47317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.414327 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7083196608e84b20b65b0c53c528d4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.394079 10618 tablet_service.cc:1511] Processing CreateTablet for tablet 4362cb4cea024bab8e1befd005c38931 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:06.416167 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4362cb4cea024bab8e1befd005c38931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.396010 10617 tablet_service.cc:1511] Processing CreateTablet for tablet abfc8bc479844f489e1971345747ec0a (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:06.420248 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfc8bc479844f489e1971345747ec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.419687 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 5480174671f54c06a686c1598f36a6e6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:06.421842 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5480174671f54c06a686c1598f36a6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.401768 10693 tablet_service.cc:1511] Processing CreateTablet for tablet 4362cb4cea024bab8e1befd005c38931 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:06.424218 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4362cb4cea024bab8e1befd005c38931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.425388 10685 tablet_service.cc:1511] Processing CreateTablet for tablet f8af59f95c2f43cc9cd8093395b00e10 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:06.392565 10619 tablet_service.cc:1511] Processing CreateTablet for tablet c3aa16e74031433c95a793a2a839503b (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:06.428227 10691 tablet_service.cc:1511] Processing CreateTablet for tablet 54527023f4db4ec3bdbcc711a0b053a4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:06.400583 10694 tablet_service.cc:1511] Processing CreateTablet for tablet 814d4d8348e448728625bdcbaf25f440 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:06.429399 10619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3aa16e74031433c95a793a2a839503b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.427277 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8af59f95c2f43cc9cd8093395b00e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.443760 10694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814d4d8348e448728625bdcbaf25f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.446964 10691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54527023f4db4ec3bdbcc711a0b053a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.458622 10544 tablet_service.cc:1511] Processing CreateTablet for tablet c3aa16e74031433c95a793a2a839503b (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:06.460742 10544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3aa16e74031433c95a793a2a839503b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.465489 10749 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:06.466326 10543 tablet_service.cc:1511] Processing CreateTablet for tablet abfc8bc479844f489e1971345747ec0a (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:06.467900 10543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfc8bc479844f489e1971345747ec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.471206 10542 tablet_service.cc:1511] Processing CreateTablet for tablet f1674e84a5d245b4aa6ed2f18f24cf87 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:06.472685 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1674e84a5d245b4aa6ed2f18f24cf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.481652 10466 tablet_service.cc:1511] Processing CreateTablet for tablet f1674e84a5d245b4aa6ed2f18f24cf87 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:06.482345 10541 tablet_service.cc:1511] Processing CreateTablet for tablet 54527023f4db4ec3bdbcc711a0b053a4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:06.483251 10466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1674e84a5d245b4aa6ed2f18f24cf87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.483897 10541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54527023f4db4ec3bdbcc711a0b053a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.483630 10468 tablet_service.cc:1511] Processing CreateTablet for tablet c3aa16e74031433c95a793a2a839503b (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:06.485045 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3aa16e74031433c95a793a2a839503b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.485798 10463 tablet_service.cc:1511] Processing CreateTablet for tablet 65720f7f3c724a08ba663044df41940e (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:06.487268 10463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65720f7f3c724a08ba663044df41940e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.496315 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 72e198a442da43a78d7375424fa47317 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:06.497884 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e198a442da43a78d7375424fa47317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.498258 10611 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0f84b23d4749ca89ce418105b87c0d (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:06.500530 10610 tablet_service.cc:1511] Processing CreateTablet for tablet 73bbd93e93934a568405bc6dbe1d4877 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:06.500969 10535 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0f84b23d4749ca89ce418105b87c0d (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:06.502107 10610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bbd93e93934a568405bc6dbe1d4877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.502336 10535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0f84b23d4749ca89ce418105b87c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.496534 10612 tablet_service.cc:1511] Processing CreateTablet for tablet 72e198a442da43a78d7375424fa47317 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:06.494585 10538 tablet_service.cc:1511] Processing CreateTablet for tablet e7a83257d2814ade9d44473bff639778 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:06.507740 10613 tablet_service.cc:1511] Processing CreateTablet for tablet 5480174671f54c06a686c1598f36a6e6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:06.508342 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a83257d2814ade9d44473bff639778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.488528 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 7083196608e84b20b65b0c53c528d4d3 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:06.510453 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7083196608e84b20b65b0c53c528d4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.493393 10460 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0f84b23d4749ca89ce418105b87c0d (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:06.512894 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0f84b23d4749ca89ce418105b87c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.490528 10461 tablet_service.cc:1511] Processing CreateTablet for tablet 5480174671f54c06a686c1598f36a6e6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:06.492982 10539 tablet_service.cc:1511] Processing CreateTablet for tablet 65720f7f3c724a08ba663044df41940e (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:06.489635 10465 tablet_service.cc:1511] Processing CreateTablet for tablet 54527023f4db4ec3bdbcc711a0b053a4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:06.492643 10464 tablet_service.cc:1511] Processing CreateTablet for tablet 935517510de547e9a555aa468eea1a10 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:06.520697 10461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5480174671f54c06a686c1598f36a6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.488528 10467 tablet_service.cc:1511] Processing CreateTablet for tablet 4362cb4cea024bab8e1befd005c38931 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:06.522369 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4362cb4cea024bab8e1befd005c38931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.488730 10462 tablet_service.cc:1511] Processing CreateTablet for tablet e7a83257d2814ade9d44473bff639778 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:06.524441 10465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54527023f4db4ec3bdbcc711a0b053a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.491482 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 814d4d8348e448728625bdcbaf25f440 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:06.525995 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814d4d8348e448728625bdcbaf25f440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.523667 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65720f7f3c724a08ba663044df41940e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.528156 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0f84b23d4749ca89ce418105b87c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.531764 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5480174671f54c06a686c1598f36a6e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:06.532387 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:06.535739 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e198a442da43a78d7375424fa47317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.536765 10689 tablet_service.cc:1511] Processing CreateTablet for tablet bccd8757dfaa4ea6976b07cb5734fecf (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:06.538986 10617 tablet_service.cc:1511] Processing CreateTablet for tablet 65720f7f3c724a08ba663044df41940e (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:06.540053 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccd8757dfaa4ea6976b07cb5734fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.540505 10617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65720f7f3c724a08ba663044df41940e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.542625 10464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935517510de547e9a555aa468eea1a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.545289 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a83257d2814ade9d44473bff639778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.558503 10689 tablet_service.cc:1511] Processing CreateTablet for tablet fc30d8c3835c47719e8e2711dd5dd271 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:06.561319 10616 tablet_service.cc:1511] Processing CreateTablet for tablet bccd8757dfaa4ea6976b07cb5734fecf (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:06.562767 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccd8757dfaa4ea6976b07cb5734fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.568765 10545 tablet_service.cc:1511] Processing CreateTablet for tablet f8af59f95c2f43cc9cd8093395b00e10 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:06.570467 10545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8af59f95c2f43cc9cd8093395b00e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.572484 10749 tablet_bootstrap.cc:654] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.572710 10538 tablet_service.cc:1511] Processing CreateTablet for tablet bccd8757dfaa4ea6976b07cb5734fecf (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:06.574277 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccd8757dfaa4ea6976b07cb5734fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.519013 10691 tablet_service.cc:1511] Processing CreateTablet for tablet 73bbd93e93934a568405bc6dbe1d4877 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:06.612949 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 516058c81d8243688175010331c582ee (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:06.615183 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516058c81d8243688175010331c582ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.656234 10750 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:06.665522 10543 tablet_service.cc:1511] Processing CreateTablet for tablet 0f80c13834594ea58841f45cbd2ced65 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:06.672272 10692 tablet_service.cc:1511] Processing CreateTablet for tablet 516058c81d8243688175010331c582ee (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:06.640887 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc30d8c3835c47719e8e2711dd5dd271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.667145 10543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f80c13834594ea58841f45cbd2ced65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.687687 10691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bbd93e93934a568405bc6dbe1d4877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.698596 10618 tablet_service.cc:1511] Processing CreateTablet for tablet 0f80c13834594ea58841f45cbd2ced65 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:06.698194 10535 tablet_service.cc:1511] Processing CreateTablet for tablet fc30d8c3835c47719e8e2711dd5dd271 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:06.720479 10752 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:06.723096 10693 tablet_service.cc:1511] Processing CreateTablet for tablet 5986a6cceb0d4ee4ba760b56e3a47fab (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:06.725589 10690 tablet_service.cc:1511] Processing CreateTablet for tablet a33216b1d944418dbcc3a556377d0670 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:06.730975 10750 tablet_bootstrap.cc:654] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.734529 10613 tablet_service.cc:1511] Processing CreateTablet for tablet 5986a6cceb0d4ee4ba760b56e3a47fab (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:06.736027 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5986a6cceb0d4ee4ba760b56e3a47fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.740967 10749 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:06.741555 10749 ts_tablet_manager.cc:1403] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.276s	user 0.018s	sys 0.028s
I20260709 12:23:06.744483 10619 tablet_service.cc:1511] Processing CreateTablet for tablet c5186731547d45a68e190092f5f7a7c2 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:06.745955 10619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5186731547d45a68e190092f5f7a7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.747968 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f80c13834594ea58841f45cbd2ced65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.744484 10468 tablet_service.cc:1511] Processing CreateTablet for tablet 73bbd93e93934a568405bc6dbe1d4877 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:06.757740 10504 heartbeater.cc:499] Master 127.3.7.190:35777 was elected leader, sending a full tablet report...
I20260709 12:23:06.762594 10463 tablet_service.cc:1511] Processing CreateTablet for tablet 0f80c13834594ea58841f45cbd2ced65 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:06.757182 10692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516058c81d8243688175010331c582ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.782227 10614 tablet_service.cc:1511] Processing CreateTablet for tablet c771f43203d841dd8d4f4e999b6d360e (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:06.783679 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c771f43203d841dd8d4f4e999b6d360e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.783461 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 516058c81d8243688175010331c582ee (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:06.784502 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5986a6cceb0d4ee4ba760b56e3a47fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.786504 10750 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:06.787062 10750 ts_tablet_manager.cc:1403] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.012s
I20260709 12:23:06.788331 10688 tablet_service.cc:1511] Processing CreateTablet for tablet c5186731547d45a68e190092f5f7a7c2 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:06.789748 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5186731547d45a68e190092f5f7a7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.789856 10542 tablet_service.cc:1511] Processing CreateTablet for tablet c771f43203d841dd8d4f4e999b6d360e (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:06.790306 10750 raft_consensus.cc:359] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:06.791986 10461 tablet_service.cc:1511] Processing CreateTablet for tablet c771f43203d841dd8d4f4e999b6d360e (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:06.792510 10753 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:06.793231 10467 tablet_service.cc:1511] Processing CreateTablet for tablet f8af59f95c2f43cc9cd8093395b00e10 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:06.813796 10465 tablet_service.cc:1511] Processing CreateTablet for tablet 43ee7750d0674f87be848140c6a02f18 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:06.795615 10535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc30d8c3835c47719e8e2711dd5dd271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.791129 10750 raft_consensus.cc:385] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.819804 10750 raft_consensus.cc:740] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.781728 10466 tablet_service.cc:1511] Processing CreateTablet for tablet fc30d8c3835c47719e8e2711dd5dd271 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:06.801504 10460 tablet_service.cc:1511] Processing CreateTablet for tablet c5186731547d45a68e190092f5f7a7c2 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:06.804549 10539 tablet_service.cc:1511] Processing CreateTablet for tablet a33216b1d944418dbcc3a556377d0670 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:06.830907 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c771f43203d841dd8d4f4e999b6d360e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.807708 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33216b1d944418dbcc3a556377d0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.833123 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33216b1d944418dbcc3a556377d0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.808324 10611 tablet_service.cc:1511] Processing CreateTablet for tablet c8577a637ba643f8a4061e59fe155f9f (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:06.809136 10687 tablet_service.cc:1511] Processing CreateTablet for tablet c8577a637ba643f8a4061e59fe155f9f (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:06.773362 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bbd93e93934a568405bc6dbe1d4877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.841019 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 78d6d3887b1d47638ed56acc7074311b (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:06.842656 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d6d3887b1d47638ed56acc7074311b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.814944 10544 tablet_service.cc:1511] Processing CreateTablet for tablet 5986a6cceb0d4ee4ba760b56e3a47fab (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:06.794509 10749 raft_consensus.cc:359] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:06.834878 10616 tablet_service.cc:1511] Processing CreateTablet for tablet 43ee7750d0674f87be848140c6a02f18 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:06.844400 10749 raft_consensus.cc:385] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:06.844794 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8577a637ba643f8a4061e59fe155f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.844828 10749 raft_consensus.cc:740] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:06.845484 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ee7750d0674f87be848140c6a02f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.846413 10749 consensus_queue.cc:260] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:06.847268 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516058c81d8243688175010331c582ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.844213 10752 tablet_bootstrap.cc:654] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:06.853181 10463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f80c13834594ea58841f45cbd2ced65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.857635 10461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c771f43203d841dd8d4f4e999b6d360e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.815181 10469 tablet_service.cc:1511] Processing CreateTablet for tablet a33216b1d944418dbcc3a556377d0670 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:06.808133 10537 tablet_service.cc:1511] Processing CreateTablet for tablet c8577a637ba643f8a4061e59fe155f9f (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:06.831173 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 43ee7750d0674f87be848140c6a02f18 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:06.864125 10580 heartbeater.cc:499] Master 127.3.7.190:35777 was elected leader, sending a full tablet report...
I20260709 12:23:06.844026 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8577a637ba643f8a4061e59fe155f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.864836 10464 tablet_service.cc:1511] Processing CreateTablet for tablet 78d6d3887b1d47638ed56acc7074311b (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:06.835470 10750 consensus_queue.cc:260] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:06.859810 10466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc30d8c3835c47719e8e2711dd5dd271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.870141 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ee7750d0674f87be848140c6a02f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.878892 10538 tablet_service.cc:1511] Processing CreateTablet for tablet 78d6d3887b1d47638ed56acc7074311b (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:06.916962 10464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d6d3887b1d47638ed56acc7074311b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.941708 10688 tablet_service.cc:1511] Processing CreateTablet for tablet ff41525191314521b655a8d37cb1a242 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:06.911994 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d6d3887b1d47638ed56acc7074311b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.943229 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff41525191314521b655a8d37cb1a242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.984874 10750 ts_tablet_manager.cc:1434] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.197s	user 0.016s	sys 0.029s
I20260709 12:23:06.985756 10654 heartbeater.cc:499] Master 127.3.7.190:35777 was elected leader, sending a full tablet report...
I20260709 12:23:06.986052 10750 tablet_bootstrap.cc:492] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:06.987500 10544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5986a6cceb0d4ee4ba760b56e3a47fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.988373 10752 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:06.989025 10752 ts_tablet_manager.cc:1403] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.269s	user 0.014s	sys 0.031s
I20260709 12:23:06.996697 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5186731547d45a68e190092f5f7a7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.998566 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33216b1d944418dbcc3a556377d0670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:06.999465 10615 tablet_service.cc:1511] Processing CreateTablet for tablet ff41525191314521b655a8d37cb1a242 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:07.001151 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff41525191314521b655a8d37cb1a242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.027535 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8577a637ba643f8a4061e59fe155f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.028044 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8af59f95c2f43cc9cd8093395b00e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.032836 10753 tablet_bootstrap.cc:654] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.039788 10465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ee7750d0674f87be848140c6a02f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.041199 10752 raft_consensus.cc:359] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:06.983408 10756 raft_consensus.cc:493] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.055610 10752 raft_consensus.cc:385] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.055692 10756 raft_consensus.cc:515] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.056231 10752 raft_consensus.cc:740] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.057371 10752 consensus_queue.cc:260] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.056413 10749 ts_tablet_manager.cc:1434] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.315s	user 0.044s	sys 0.054s
W20260709 12:23:07.089645 10581 tablet.cc:2406] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:07.092226 10729 heartbeater.cc:499] Master 127.3.7.190:35777 was elected leader, sending a full tablet report...
I20260709 12:23:07.103684 10749 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:07.116425 10752 ts_tablet_manager.cc:1434] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.007s
I20260709 12:23:07.126201 10753 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:07.126859 10753 ts_tablet_manager.cc:1403] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.352s	user 0.044s	sys 0.009s
I20260709 12:23:07.132401 10753 raft_consensus.cc:359] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.133249 10749 tablet_bootstrap.cc:654] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.137676 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 99999f0404c846758d5ec30143015bc4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:07.139097 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 99999f0404c846758d5ec30143015bc4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:07.141623 10750 tablet_bootstrap.cc:654] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.139108 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99999f0404c846758d5ec30143015bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.119853 10756 leader_election.cc:290] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:07.155019 10468 tablet_service.cc:1511] Processing CreateTablet for tablet ff41525191314521b655a8d37cb1a242 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:07.133361 10753 raft_consensus.cc:385] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.162516 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99999f0404c846758d5ec30143015bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.169905 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff41525191314521b655a8d37cb1a242. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.170545 10462 tablet_service.cc:1511] Processing CreateTablet for tablet ea516217c42649acb0675e458549a1be (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:07.171940 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea516217c42649acb0675e458549a1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.173481 10762 raft_consensus.cc:493] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.173820 10535 tablet_service.cc:1511] Processing CreateTablet for tablet ea516217c42649acb0675e458549a1be (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:07.177685 10535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea516217c42649acb0675e458549a1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.174029 10762 raft_consensus.cc:515] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.181790 10762 leader_election.cc:290] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:07.163585 10753 raft_consensus.cc:740] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.196477 10750 tablet_bootstrap.cc:492] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:07.197278 10750 ts_tablet_manager.cc:1403] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.211s	user 0.020s	sys 0.008s
I20260709 12:23:07.198056 10616 tablet_service.cc:1511] Processing CreateTablet for tablet 99999f0404c846758d5ec30143015bc4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:07.199707 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99999f0404c846758d5ec30143015bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.200301 10753 consensus_queue.cc:260] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.217645 10749 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:07.218288 10749 ts_tablet_manager.cc:1403] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.002s
I20260709 12:23:07.221464 10749 raft_consensus.cc:359] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:07.222205 10749 raft_consensus.cc:385] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.222532 10749 raft_consensus.cc:740] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.223495 10749 consensus_queue.cc:260] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:07.225031 10752 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:07.238385 10611 tablet_service.cc:1511] Processing CreateTablet for tablet ea516217c42649acb0675e458549a1be (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:07.240020 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea516217c42649acb0675e458549a1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.242347 10749 ts_tablet_manager.cc:1434] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:23:07.243551 10749 tablet_bootstrap.cc:492] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:07.247643 10752 tablet_bootstrap.cc:654] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.262579 10688 tablet_service.cc:1511] Processing CreateTablet for tablet 38a4197603f34f92bea91d9a4641abbd (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:07.269474 10750 raft_consensus.cc:359] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.270753 10750 raft_consensus.cc:385] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.271067 10750 raft_consensus.cc:740] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.273034 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a4197603f34f92bea91d9a4641abbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.273382 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 38a4197603f34f92bea91d9a4641abbd (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:07.274981 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a4197603f34f92bea91d9a4641abbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.278292 10749 tablet_bootstrap.cc:654] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.279322 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 38a4197603f34f92bea91d9a4641abbd (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:07.281049 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a4197603f34f92bea91d9a4641abbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.283612 10750 consensus_queue.cc:260] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.287140 10750 ts_tablet_manager.cc:1434] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.000s
I20260709 12:23:07.288170 10750 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:07.309377 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 2b394c6b2e7544aa890058148e0ac514 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:07.310906 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b394c6b2e7544aa890058148e0ac514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.323230 10616 tablet_service.cc:1511] Processing CreateTablet for tablet 2b394c6b2e7544aa890058148e0ac514 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:07.324752 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b394c6b2e7544aa890058148e0ac514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.327862 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 2b394c6b2e7544aa890058148e0ac514 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:07.329311 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b394c6b2e7544aa890058148e0ac514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.330850 10544 tablet_service.cc:1511] Processing CreateTablet for tablet 5c174a58645b464782b247e7837bb5ff (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:07.332290 10544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c174a58645b464782b247e7837bb5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.333503 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935517510de547e9a555aa468eea1a10" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:07.336331 10614 tablet_service.cc:1511] Processing CreateTablet for tablet 5c174a58645b464782b247e7837bb5ff (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:07.336501 10690 tablet_service.cc:1511] Processing CreateTablet for tablet 5c174a58645b464782b247e7837bb5ff (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:07.337814 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c174a58645b464782b247e7837bb5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.337991 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c174a58645b464782b247e7837bb5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.340235 10756 raft_consensus.cc:493] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.340426 10467 tablet_service.cc:1511] Processing CreateTablet for tablet e9e217311b654a3999a76cac4fed6129 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:07.340804 10756 raft_consensus.cc:515] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.341868 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e217311b654a3999a76cac4fed6129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.343811 10756 leader_election.cc:290] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:07.350924 10755 raft_consensus.cc:493] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.345299 10750 tablet_bootstrap.cc:654] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.354257 10755 raft_consensus.cc:515] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.362946 10755 leader_election.cc:290] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:07.374714 10594 leader_election.cc:343] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:07.418593 10594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 69213.4us
I20260709 12:23:07.377372 10752 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:07.422565 10752 ts_tablet_manager.cc:1403] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.198s	user 0.019s	sys 0.023s
I20260709 12:23:07.423282 10611 tablet_service.cc:1511] Processing CreateTablet for tablet e9e217311b654a3999a76cac4fed6129 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:07.377956 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfc8bc479844f489e1971345747ec0a" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:07.383625 10693 tablet_service.cc:1511] Processing CreateTablet for tablet fccafdd46a364d3584441cf6aab82cf8 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:07.384370 10460 tablet_service.cc:1511] Processing CreateTablet for tablet fccafdd46a364d3584441cf6aab82cf8 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:07.395004 10769 raft_consensus.cc:493] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.417923 10749 tablet_bootstrap.cc:492] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:07.427568 10749 ts_tablet_manager.cc:1403] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.008s
I20260709 12:23:07.429867 10752 raft_consensus.cc:359] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:07.430925 10752 raft_consensus.cc:385] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.431610 10752 raft_consensus.cc:740] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
W20260709 12:23:07.426976 10594 leader_election.cc:343] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.433682 10752 consensus_queue.cc:260] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:07.437103 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4362cb4cea024bab8e1befd005c38931" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:07.438922 10666 leader_election.cc:343] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.443048 10687 tablet_service.cc:1511] Processing CreateTablet for tablet c8b4dbad2b434c9fbf4dd26ec67449f2 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:07.445037 10753 ts_tablet_manager.cc:1434] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.318s	user 0.031s	sys 0.006s
I20260709 12:23:07.446273 10753 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:07.424927 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e217311b654a3999a76cac4fed6129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.426530 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccafdd46a364d3584441cf6aab82cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.425493 10769 raft_consensus.cc:515] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.446861 10615 tablet_service.cc:1511] Processing CreateTablet for tablet c8b4dbad2b434c9fbf4dd26ec67449f2 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:07.449612 10769 leader_election.cc:290] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:07.426975 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccafdd46a364d3584441cf6aab82cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.430856 10749 raft_consensus.cc:359] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.461926 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b4dbad2b434c9fbf4dd26ec67449f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.463613 10749 raft_consensus.cc:385] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.469103 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b4dbad2b434c9fbf4dd26ec67449f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.473390 10468 tablet_service.cc:1511] Processing CreateTablet for tablet c8b4dbad2b434c9fbf4dd26ec67449f2 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:07.474773 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b4dbad2b434c9fbf4dd26ec67449f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.485176 10755 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.485735 10755 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:07.485972 10542 tablet_service.cc:1511] Processing CreateTablet for tablet fcc42f485018420e94dafb287e1f73b5 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:07.487339 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc42f485018420e94dafb287e1f73b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.487965 10755 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:07.488387 10537 tablet_service.cc:1511] Processing CreateTablet for tablet fccafdd46a364d3584441cf6aab82cf8 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:07.489849 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccafdd46a364d3584441cf6aab82cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.469970 10749 raft_consensus.cc:740] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.518242 10752 ts_tablet_manager.cc:1434] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.003s
I20260709 12:23:07.519455 10752 tablet_bootstrap.cc:492] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:07.519635 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:07.521687 10519 leader_election.cc:343] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.524887 10616 tablet_service.cc:1511] Processing CreateTablet for tablet fcc42f485018420e94dafb287e1f73b5 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:07.525345 10538 tablet_service.cc:1511] Processing CreateTablet for tablet ab2d2836c0834b29a9007f5c0c4469fe (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:07.526221 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:07.526736 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab2d2836c0834b29a9007f5c0c4469fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.527338 10749 consensus_queue.cc:260] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.528643 10469 tablet_service.cc:1511] Processing CreateTablet for tablet ab2d2836c0834b29a9007f5c0c4469fe (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:07.529706 10749 ts_tablet_manager.cc:1434] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 12:23:07.530004 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab2d2836c0834b29a9007f5c0c4469fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.528667 10614 tablet_service.cc:1511] Processing CreateTablet for tablet ab2d2836c0834b29a9007f5c0c4469fe (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:07.530725 10749 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:07.526266 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc42f485018420e94dafb287e1f73b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:07.535104 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:23:07.538012 10519 leader_election.cc:343] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.548723 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab2d2836c0834b29a9007f5c0c4469fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.555871 10752 tablet_bootstrap.cc:654] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.557066 10750 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:07.557801 10750 ts_tablet_manager.cc:1403] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.270s	user 0.017s	sys 0.000s
I20260709 12:23:07.567875 10688 tablet_service.cc:1511] Processing CreateTablet for tablet fcc42f485018420e94dafb287e1f73b5 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:07.571897 10690 tablet_service.cc:1511] Processing CreateTablet for tablet 41ad3183541b4bb29af186841577e9f6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:07.575856 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad3183541b4bb29af186841577e9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.578531 10750 raft_consensus.cc:359] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.579420 10750 raft_consensus.cc:385] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.579835 10750 raft_consensus.cc:740] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.581588 10750 consensus_queue.cc:260] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.585356 10750 ts_tablet_manager.cc:1434] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:23:07.586566 10750 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:07.595934 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4362cb4cea024bab8e1befd005c38931" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:07.598387 10539 tablet_service.cc:1511] Processing CreateTablet for tablet 41ad3183541b4bb29af186841577e9f6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:23:07.599881 10669 leader_election.cc:343] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.605669 10753 tablet_bootstrap.cc:654] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.600625 10669 leader_election.cc:304] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:07.612628 10762 raft_consensus.cc:2749] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.612201 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc42f485018420e94dafb287e1f73b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.620954 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 41ad3183541b4bb29af186841577e9f6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:07.600018 10540 tablet_service.cc:1511] Processing CreateTablet for tablet e9e217311b654a3999a76cac4fed6129 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:07.646819 10618 tablet_service.cc:1511] Processing CreateTablet for tablet fab9491812e14055a4628f9b82270f73 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:07.648626 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab9491812e14055a4628f9b82270f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.636437 10749 tablet_bootstrap.cc:654] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.655573 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad3183541b4bb29af186841577e9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.643913 10750 tablet_bootstrap.cc:654] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.663476 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfc8bc479844f489e1971345747ec0a" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:07.664244 10555 raft_consensus.cc:2468] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:07.665874 10595 leader_election.cc:304] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:07.667161 10756 raft_consensus.cc:2804] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.667588 10756 raft_consensus.cc:493] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.667922 10756 raft_consensus.cc:3060] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.679597 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65720f7f3c724a08ba663044df41940e" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:07.681030 10685 tablet_service.cc:1511] Processing CreateTablet for tablet fab9491812e14055a4628f9b82270f73 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:23:07.685019 10445 leader_election.cc:343] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.685551 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:07.683192 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935517510de547e9a555aa468eea1a10" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:07.686683 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:07.682338 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ad3183541b4bb29af186841577e9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.694607 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab9491812e14055a4628f9b82270f73. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:07.694751 10592 leader_election.cc:343] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:07.691715 10517 leader_election.cc:343] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.695456 10592 leader_election.cc:304] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:07.695675 10517 leader_election.cc:304] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:07.694662 10762 raft_consensus.cc:493] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.696569 10755 raft_consensus.cc:2749] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.696652 10762 raft_consensus.cc:515] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:07.698513 10517 leader_election.cc:343] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.699415 10517 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:07.700418 10755 raft_consensus.cc:2749] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.705518 10750 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:07.705130 10460 tablet_service.cc:1511] Processing CreateTablet for tablet fab9491812e14055a4628f9b82270f73 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:07.706079 10750 ts_tablet_manager.cc:1403] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.000s
I20260709 12:23:07.707466 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e217311b654a3999a76cac4fed6129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.707885 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:07.711546 10753 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:07.712000 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65720f7f3c724a08ba663044df41940e" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:07.712253 10753 ts_tablet_manager.cc:1403] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.266s	user 0.023s	sys 0.012s
I20260709 12:23:07.711407 10762 leader_election.cc:290] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:07.718638 10666 leader_election.cc:343] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.722002 10753 raft_consensus.cc:359] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.723232 10753 raft_consensus.cc:385] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.723713 10753 raft_consensus.cc:740] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.724241 10752 tablet_bootstrap.cc:492] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:07.724920 10752 ts_tablet_manager.cc:1403] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.206s	user 0.017s	sys 0.006s
I20260709 12:23:07.731528 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab9491812e14055a4628f9b82270f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.731200 10753 consensus_queue.cc:260] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.738832 10753 ts_tablet_manager.cc:1434] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 12:23:07.740782 10538 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb2769bf67740918d65b198cc6cac17 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:07.742161 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:07.742668 10750 raft_consensus.cc:359] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:07.743527 10445 leader_election.cc:343] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:07.744999 10669 leader_election.cc:343] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.745777 10445 leader_election.cc:304] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:07.745808 10669 leader_election.cc:304] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
W20260709 12:23:07.750500 10592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 55967.4us
I20260709 12:23:07.750602 10787 raft_consensus.cc:493] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.750609 10762 raft_consensus.cc:2749] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.747792 10616 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb2769bf67740918d65b198cc6cac17 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:07.686932 10756 raft_consensus.cc:515] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.750808 10772 raft_consensus.cc:2749] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.752978 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb2769bf67740918d65b198cc6cac17 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:07.753943 10756 leader_election.cc:290] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:07.754484 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb2769bf67740918d65b198cc6cac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.754580 10756 raft_consensus.cc:2749] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.745154 10750 raft_consensus.cc:385] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.756657 10750 raft_consensus.cc:740] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.757386 10750 consensus_queue.cc:260] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.759343 10462 tablet_service.cc:1511] Processing CreateTablet for tablet a8799df3e4f34b99897048a5879fc688 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:07.760854 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8799df3e4f34b99897048a5879fc688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.761519 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfc8bc479844f489e1971345747ec0a" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:07.761415 10752 raft_consensus.cc:359] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.762347 10752 raft_consensus.cc:385] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.762688 10752 raft_consensus.cc:740] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
W20260709 12:23:07.763247 10594 leader_election.cc:343] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.764119 10750 ts_tablet_manager.cc:1434] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.004s
I20260709 12:23:07.768029 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb2769bf67740918d65b198cc6cac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.768240 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfc8bc479844f489e1971345747ec0a" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:07.768976 10555 raft_consensus.cc:3060] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.772059 10750 tablet_bootstrap.cc:492] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:07.772589 10542 tablet_service.cc:1511] Processing CreateTablet for tablet a8799df3e4f34b99897048a5879fc688 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:07.774024 10542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8799df3e4f34b99897048a5879fc688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.776821 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb2769bf67740918d65b198cc6cac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.786275 10611 tablet_service.cc:1511] Processing CreateTablet for tablet a8799df3e4f34b99897048a5879fc688 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:07.787720 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8799df3e4f34b99897048a5879fc688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.791839 10753 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:07.783615 10787 raft_consensus.cc:515] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.799130 10749 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:07.800809 10749 ts_tablet_manager.cc:1403] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.270s	user 0.016s	sys 0.004s
I20260709 12:23:07.804054 10468 tablet_service.cc:1511] Processing CreateTablet for tablet 8e51200a353f4204a472f75887547285 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:07.804407 10749 raft_consensus.cc:359] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.805321 10749 raft_consensus.cc:385] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.805770 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e51200a353f4204a472f75887547285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.805677 10749 raft_consensus.cc:740] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.795286 10555 raft_consensus.cc:2468] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:07.808456 10595 leader_election.cc:304] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:07.809947 10786 raft_consensus.cc:2804] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:07.810532 10786 raft_consensus.cc:697] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:07.811183 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1674e84a5d245b4aa6ed2f18f24cf87" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:07.811477 10786 consensus_queue.cc:237] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:07.813060 10592 leader_election.cc:343] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.814509 10756 raft_consensus.cc:493] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.815115 10756 raft_consensus.cc:515] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.816658 10787 leader_election.cc:290] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:07.818059 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1674e84a5d245b4aa6ed2f18f24cf87" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:07.823788 10595 leader_election.cc:343] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.824422 10595 leader_election.cc:304] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:07.820564 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4362cb4cea024bab8e1befd005c38931" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:07.825356 10477 raft_consensus.cc:2468] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:07.826406 10753 tablet_bootstrap.cc:654] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.815155 10690 tablet_service.cc:1511] Processing CreateTablet for tablet 8e51200a353f4204a472f75887547285 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:07.821813 10756 leader_election.cc:290] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:07.827446 10592 leader_election.cc:304] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:07.827929 10756 raft_consensus.cc:2749] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:07.828130 10690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e51200a353f4204a472f75887547285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.819409 10752 consensus_queue.cc:260] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.828747 10756 raft_consensus.cc:2804] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:07.829173 10756 raft_consensus.cc:493] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.829562 10756 raft_consensus.cc:3060] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.832010 10752 ts_tablet_manager.cc:1434] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.107s	user 0.003s	sys 0.005s
I20260709 12:23:07.833405 10752 tablet_bootstrap.cc:492] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:07.824673 10750 tablet_bootstrap.cc:654] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.844869 10749 consensus_queue.cc:260] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:07.853844 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 8e51200a353f4204a472f75887547285 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:07.855542 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e51200a353f4204a472f75887547285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.856031 10693 tablet_service.cc:1511] Processing CreateTablet for tablet 69fa17fbe6be4fe9a202b19d42b57529 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:07.857502 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fa17fbe6be4fe9a202b19d42b57529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.847325 10752 tablet_bootstrap.cc:654] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:07.887352 10469 tablet_service.cc:1511] Processing CreateTablet for tablet 69fa17fbe6be4fe9a202b19d42b57529 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:07.888866 10469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fa17fbe6be4fe9a202b19d42b57529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.892459 10540 tablet_service.cc:1511] Processing CreateTablet for tablet fc875de41c5440e78f3da51713684d46 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:07.893903 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc875de41c5440e78f3da51713684d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.911525 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4362cb4cea024bab8e1befd005c38931" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:07.912590 10703 raft_consensus.cc:2468] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:07.914418 10614 tablet_service.cc:1511] Processing CreateTablet for tablet 69fa17fbe6be4fe9a202b19d42b57529 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:07.916497 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fa17fbe6be4fe9a202b19d42b57529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.929307 10618 tablet_service.cc:1511] Processing CreateTablet for tablet fc875de41c5440e78f3da51713684d46 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:07.930881 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc875de41c5440e78f3da51713684d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.932397 10688 tablet_service.cc:1511] Processing CreateTablet for tablet fc875de41c5440e78f3da51713684d46 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:07.933727 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc875de41c5440e78f3da51713684d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:07.936291 10375 catalog_manager.cc:5697] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.937573 10756 raft_consensus.cc:515] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:07.928154 10749 ts_tablet_manager.cc:1434] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.004s
I20260709 12:23:07.949182 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4362cb4cea024bab8e1befd005c38931" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:07.949707 10703 raft_consensus.cc:3060] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.956342 10753 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:07.956939 10753 ts_tablet_manager.cc:1403] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.027s
I20260709 12:23:07.957859 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4362cb4cea024bab8e1befd005c38931" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:07.958714 10477 raft_consensus.cc:3060] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:07.963739 10762 raft_consensus.cc:493] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.964552 10762 raft_consensus.cc:515] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.968266 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7083196608e84b20b65b0c53c528d4d3" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:07.969794 10669 leader_election.cc:343] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.974911 10753 raft_consensus.cc:359] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:07.975687 10756 leader_election.cc:290] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:07.981320 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7083196608e84b20b65b0c53c528d4d3" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:07.982309 10750 tablet_bootstrap.cc:492] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:07.982858 10749 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:07.982961 10750 ts_tablet_manager.cc:1403] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.211s	user 0.027s	sys 0.016s
W20260709 12:23:07.983526 10669 leader_election.cc:343] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:07.984054 10669 leader_election.cc:304] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:07.986799 10750 raft_consensus.cc:359] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.987996 10750 raft_consensus.cc:385] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.989773 10750 raft_consensus.cc:740] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:07.977667 10753 raft_consensus.cc:385] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:07.992455 10750 consensus_queue.cc:260] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:07.997393 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 90b167d5dc1549a8a9cd1f8365c6a2cd (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:08.002177 10539 tablet_service.cc:1511] Processing CreateTablet for tablet 90b167d5dc1549a8a9cd1f8365c6a2cd (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:07.988231 10762 leader_election.cc:290] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:08.011505 10755 raft_consensus.cc:493] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.013551 10762 raft_consensus.cc:2749] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.013952 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b167d5dc1549a8a9cd1f8365c6a2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.014264 10750 ts_tablet_manager.cc:1434] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:23:08.015192 10477 raft_consensus.cc:2468] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:08.015395 10750 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:08.016469 10592 leader_election.cc:304] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:08.016749 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b167d5dc1549a8a9cd1f8365c6a2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.017338 10756 raft_consensus.cc:2804] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.017845 10756 raft_consensus.cc:697] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:08.018709 10756 consensus_queue.cc:237] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.012274 10755 raft_consensus.cc:515] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.023926 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 90b167d5dc1549a8a9cd1f8365c6a2cd (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:08.025830 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b167d5dc1549a8a9cd1f8365c6a2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.007085 10753 raft_consensus.cc:740] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.035156 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0f84b23d4749ca89ce418105b87c0d" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:08.035328 10755 leader_election.cc:290] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:08.036159 10753 consensus_queue.cc:260] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:08.036708 10517 leader_election.cc:343] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.039042 10753 ts_tablet_manager.cc:1434] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 12:23:08.039774 10749 tablet_bootstrap.cc:654] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.040292 10753 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:08.045944 10750 tablet_bootstrap.cc:654] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.053514 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0f84b23d4749ca89ce418105b87c0d" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
W20260709 12:23:08.056830 10520 leader_election.cc:343] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.058682 10520 leader_election.cc:304] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:08.059331 10752 tablet_bootstrap.cc:492] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:08.059890 10752 ts_tablet_manager.cc:1403] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.227s	user 0.015s	sys 0.004s
I20260709 12:23:08.060272 10755 raft_consensus.cc:2749] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.066082 10752 raft_consensus.cc:359] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.066959 10752 raft_consensus.cc:385] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.067457 10752 raft_consensus.cc:740] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.067554 10693 tablet_service.cc:1511] Processing CreateTablet for tablet c862ff91f7484100b8a72ae26d09b8c1 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:08.069133 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c862ff91f7484100b8a72ae26d09b8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.068761 10752 consensus_queue.cc:260] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.076342 10752 ts_tablet_manager.cc:1434] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:23:08.081300 10753 tablet_bootstrap.cc:654] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:08.034530 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 51050us
I20260709 12:23:08.097436 10796 raft_consensus.cc:493] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.098083 10796 raft_consensus.cc:515] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.083730 10703 raft_consensus.cc:2468] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:08.107668 10796 leader_election.cc:290] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:08.108691 10460 tablet_service.cc:1511] Processing CreateTablet for tablet c862ff91f7484100b8a72ae26d09b8c1 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:08.097482 10789 raft_consensus.cc:493] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.109786 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:08.110283 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c862ff91f7484100b8a72ae26d09b8c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.111641 10669 leader_election.cc:343] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.109786 10789 raft_consensus.cc:515] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.116986 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:08.113512 10539 tablet_service.cc:1511] Processing CreateTablet for tablet c862ff91f7484100b8a72ae26d09b8c1 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 12:23:08.118636 10669 leader_election.cc:343] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.119028 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c862ff91f7484100b8a72ae26d09b8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.119114 10669 leader_election.cc:304] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:08.120595 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7083196608e84b20b65b0c53c528d4d3" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:08.120936 10796 raft_consensus.cc:2749] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:08.122310 10595 leader_election.cc:343] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.125430 10750 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:08.118945 10789 leader_election.cc:290] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:08.126986 10750 ts_tablet_manager.cc:1403] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.005s
I20260709 12:23:08.128553 10752 tablet_bootstrap.cc:492] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:08.131377 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7083196608e84b20b65b0c53c528d4d3" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:08.137650 10750 raft_consensus.cc:359] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.143463 10750 raft_consensus.cc:385] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.143844 10750 raft_consensus.cc:740] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.144606 10750 consensus_queue.cc:260] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.145056 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 23d44f30f58f4416a927ce5433bfe923 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:08.147081 10750 ts_tablet_manager.cc:1434] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:23:08.139482 10703 raft_consensus.cc:2468] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:08.148059 10688 tablet_service.cc:1511] Processing CreateTablet for tablet 23d44f30f58f4416a927ce5433bfe923 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:08.149343 10468 tablet_service.cc:1511] Processing CreateTablet for tablet 23d44f30f58f4416a927ce5433bfe923 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:08.150556 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9f415c2c9243428aacae2dc707b9d1 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:08.156976 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9f415c2c9243428aacae2dc707b9d1 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:08.158342 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f415c2c9243428aacae2dc707b9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.159334 10467 tablet_service.cc:1511] Processing CreateTablet for tablet 92c0dd6625ef4c2099f58370e62c08d8 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:08.160655 10467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c0dd6625ef4c2099f58370e62c08d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.162958 10594 leader_election.cc:304] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:08.164266 10789 raft_consensus.cc:2804] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.164471 10753 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:08.164697 10789 raft_consensus.cc:493] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.165025 10753 ts_tablet_manager.cc:1403] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.004s
I20260709 12:23:08.165084 10789 raft_consensus.cc:3060] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.166172 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d44f30f58f4416a927ce5433bfe923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.172533 10749 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:08.173060 10749 ts_tablet_manager.cc:1403] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.019s
I20260709 12:23:08.173138 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 92c0dd6625ef4c2099f58370e62c08d8 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:08.173523 10616 tablet_service.cc:1511] Processing CreateTablet for tablet 92c0dd6625ef4c2099f58370e62c08d8 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:08.174582 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c0dd6625ef4c2099f58370e62c08d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.176379 10749 raft_consensus.cc:359] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.177228 10749 raft_consensus.cc:385] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.177541 10749 raft_consensus.cc:740] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.166412 10374 catalog_manager.cc:5697] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.170166 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 85284a3fbf5b49628135573479cf48d6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:08.181718 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d44f30f58f4416a927ce5433bfe923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.183845 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85284a3fbf5b49628135573479cf48d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.187820 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f415c2c9243428aacae2dc707b9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.183606 10618 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9f415c2c9243428aacae2dc707b9d1 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:08.188158 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 85284a3fbf5b49628135573479cf48d6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:08.189159 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d44f30f58f4416a927ce5433bfe923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.189600 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85284a3fbf5b49628135573479cf48d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.189898 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c0dd6625ef4c2099f58370e62c08d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.190759 10750 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:08.192123 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9f415c2c9243428aacae2dc707b9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.170848 10752 tablet_bootstrap.cc:654] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.200019 10753 raft_consensus.cc:359] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.200940 10753 raft_consensus.cc:385] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.201252 10753 raft_consensus.cc:740] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.205269 10789 raft_consensus.cc:515] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.211410 10749 consensus_queue.cc:260] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.212829 10753 consensus_queue.cc:260] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.217538 10753 ts_tablet_manager.cc:1434] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.004s
I20260709 12:23:08.218037 10538 tablet_service.cc:1511] Processing CreateTablet for tablet 85284a3fbf5b49628135573479cf48d6 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:08.218648 10753 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:08.221010 10749 ts_tablet_manager.cc:1434] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:23:08.233282 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85284a3fbf5b49628135573479cf48d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.251974 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7083196608e84b20b65b0c53c528d4d3" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:08.253144 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 483a0bc6f3d945efaabbad914d574e84 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:08.254484 10616 tablet_service.cc:1511] Processing CreateTablet for tablet 483a0bc6f3d945efaabbad914d574e84 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:08.255874 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 483a0bc6f3d945efaabbad914d574e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.254457 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 483a0bc6f3d945efaabbad914d574e84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.256981 10595 leader_election.cc:343] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.263773 10750 tablet_bootstrap.cc:654] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.265107 10772 raft_consensus.cc:493] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.265605 10772 raft_consensus.cc:515] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.266356 10756 consensus_queue.cc:1048] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:08.267179 10749 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:08.268507 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
W20260709 12:23:08.269898 10445 leader_election.cc:343] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.270864 10772 leader_election.cc:290] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:08.272411 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:08.273041 10554 raft_consensus.cc:2468] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:08.275694 10445 leader_election.cc:304] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:08.276513 10772 raft_consensus.cc:2804] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.277951 10772 raft_consensus.cc:493] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.278899 10772 raft_consensus.cc:3060] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.282325 10749 tablet_bootstrap.cc:654] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.284129 10789 leader_election.cc:290] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:08.285009 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7083196608e84b20b65b0c53c528d4d3" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:08.292564 10703 raft_consensus.cc:3060] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.291689 10539 tablet_service.cc:1511] Processing CreateTablet for tablet a3175d59583845a9aa8e63d4982cf0c0 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:08.294363 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3175d59583845a9aa8e63d4982cf0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.289655 10693 tablet_service.cc:1511] Processing CreateTablet for tablet a3175d59583845a9aa8e63d4982cf0c0 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:08.289780 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 483a0bc6f3d945efaabbad914d574e84 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:08.297212 10616 tablet_service.cc:1511] Processing CreateTablet for tablet a3175d59583845a9aa8e63d4982cf0c0 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:08.298382 10616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3175d59583845a9aa8e63d4982cf0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.290659 10460 tablet_service.cc:1511] Processing CreateTablet for tablet 2567db905aed4ca3af769c4464b8aa2f (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:08.299326 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3175d59583845a9aa8e63d4982cf0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.299454 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2567db905aed4ca3af769c4464b8aa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.290241 10772 raft_consensus.cc:515] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.308048 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 483a0bc6f3d945efaabbad914d574e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.323262 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:08.308054 10614 tablet_service.cc:1511] Processing CreateTablet for tablet 2567db905aed4ca3af769c4464b8aa2f (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:23:08.325048 10445 leader_election.cc:343] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.325537 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2567db905aed4ca3af769c4464b8aa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.327566 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:08.328279 10554 raft_consensus.cc:3060] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.329739 10750 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:08.330279 10750 ts_tablet_manager.cc:1403] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.140s	user 0.007s	sys 0.005s
I20260709 12:23:08.312016 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 2567db905aed4ca3af769c4464b8aa2f (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:08.331470 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2567db905aed4ca3af769c4464b8aa2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:08.338960 10594 consensus_peers.cc:597] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 -> Peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Couldn't send request to peer becf98b94b704731a507d96d1a44737c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.339337 10752 tablet_bootstrap.cc:492] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:08.339938 10752 ts_tablet_manager.cc:1403] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.224s	user 0.018s	sys 0.024s
I20260709 12:23:08.344389 10750 raft_consensus.cc:359] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.334698 10772 leader_election.cc:290] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:08.344573 10703 raft_consensus.cc:2468] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:08.347669 10750 raft_consensus.cc:385] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.349437 10750 raft_consensus.cc:740] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.350206 10594 leader_election.cc:304] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:08.350678 10750 consensus_queue.cc:260] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.351497 10789 raft_consensus.cc:2804] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.347133 10749 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:08.354537 10789 raft_consensus.cc:697] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:08.366845 10749 ts_tablet_manager.cc:1403] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.008s
I20260709 12:23:08.367242 10789 consensus_queue.cc:237] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.370462 10749 raft_consensus.cc:359] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.361394 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 75cfb94c077d4b08b3644c08191e8af3 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:08.365684 10554 raft_consensus.cc:2468] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:08.347393 10752 raft_consensus.cc:359] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.375964 10537 tablet_service.cc:1511] Processing CreateTablet for tablet 75cfb94c077d4b08b3644c08191e8af3 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:08.376230 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 75cfb94c077d4b08b3644c08191e8af3 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:08.388840 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75cfb94c077d4b08b3644c08191e8af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.378978 10753 tablet_bootstrap.cc:654] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.382880 10749 raft_consensus.cc:385] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.390312 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75cfb94c077d4b08b3644c08191e8af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.394867 10752 raft_consensus.cc:385] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.395783 10749 raft_consensus.cc:740] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.424891 10445 leader_election.cc:304] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:08.425293 10807 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.425222 10618 tablet_service.cc:1511] Processing CreateTablet for tablet 7a978264a6a14ca296d74a58c7d58705 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:08.426008 10807 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.428349 10807 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:08.429281 10749 consensus_queue.cc:260] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.430037 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:08.430953 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:08.431722 10594 leader_election.cc:343] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.432439 10772 raft_consensus.cc:2804] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:08.420389 10752 raft_consensus.cc:740] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.443884 10752 consensus_queue.cc:260] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.444783 10750 ts_tablet_manager.cc:1434] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.114s	user 0.018s	sys 0.001s
W20260709 12:23:08.433059 10592 leader_election.cc:343] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.441646 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a978264a6a14ca296d74a58c7d58705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.442761 10537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75cfb94c077d4b08b3644c08191e8af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.448642 10592 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:08.450788 10749 ts_tablet_manager.cc:1434] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:23:08.451354 10756 raft_consensus.cc:2749] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.451980 10749 tablet_bootstrap.cc:492] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:08.455685 10460 tablet_service.cc:1511] Processing CreateTablet for tablet 7a978264a6a14ca296d74a58c7d58705 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:08.457546 10460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a978264a6a14ca296d74a58c7d58705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.467012 10749 tablet_bootstrap.cc:654] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.467563 10752 ts_tablet_manager.cc:1434] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.002s
I20260709 12:23:08.476439 10750 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:08.481560 10540 tablet_service.cc:1511] Processing CreateTablet for tablet 8204fe73f2004e518c32b6310ee18b82 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:08.482962 10540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8204fe73f2004e518c32b6310ee18b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.485587 10750 tablet_bootstrap.cc:654] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.495398 10693 tablet_service.cc:1511] Processing CreateTablet for tablet 7a978264a6a14ca296d74a58c7d58705 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:08.496459 10752 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:08.496786 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a978264a6a14ca296d74a58c7d58705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.488703 10772 raft_consensus.cc:697] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:08.501489 10772 consensus_queue.cc:237] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.498291 10374 catalog_manager.cc:5697] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.511026 10614 tablet_service.cc:1511] Processing CreateTablet for tablet 8204fe73f2004e518c32b6310ee18b82 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:08.512485 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8204fe73f2004e518c32b6310ee18b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.515268 10789 consensus_queue.cc:1048] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.533042 10812 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.534524 10812 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:08.543002 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:08.546644 10753 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:08.566622 10539 tablet_service.cc:1511] Processing CreateTablet for tablet 192ce4b500dc4ba197c4a4b9dcf6b485 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:08.567353 10462 tablet_service.cc:1511] Processing CreateTablet for tablet 192ce4b500dc4ba197c4a4b9dcf6b485 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:08.568140 10539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 192ce4b500dc4ba197c4a4b9dcf6b485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.568955 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 192ce4b500dc4ba197c4a4b9dcf6b485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.571463 10753 ts_tablet_manager.cc:1403] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.353s	user 0.028s	sys 0.025s
I20260709 12:23:08.593302 10538 tablet_service.cc:1511] Processing CreateTablet for tablet 84deda81af094e08b2e7a4ed94f091c4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:08.594831 10538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84deda81af094e08b2e7a4ed94f091c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.571233 10752 tablet_bootstrap.cc:654] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.574231 10687 tablet_service.cc:1511] Processing CreateTablet for tablet 8204fe73f2004e518c32b6310ee18b82 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:08.596962 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8204fe73f2004e518c32b6310ee18b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.595093 10753 raft_consensus.cc:359] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.615639 10753 raft_consensus.cc:385] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.581459 10685 tablet_service.cc:1511] Processing CreateTablet for tablet 84deda81af094e08b2e7a4ed94f091c4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:08.577740 10615 tablet_service.cc:1511] Processing CreateTablet for tablet 192ce4b500dc4ba197c4a4b9dcf6b485 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:08.587152 10468 tablet_service.cc:1511] Processing CreateTablet for tablet 84deda81af094e08b2e7a4ed94f091c4 (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:08.623673 10688 tablet_service.cc:1511] Processing CreateTablet for tablet daf3398d20ad4a14a89bcff5962ec30d (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:08.628713 10462 tablet_service.cc:1511] Processing CreateTablet for tablet daf3398d20ad4a14a89bcff5962ec30d (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:08.630352 10789 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.631316 10750 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:08.631364 10615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 192ce4b500dc4ba197c4a4b9dcf6b485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.630551 10374 catalog_manager.cc:5697] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.632032 10750 ts_tablet_manager.cc:1403] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.015s
I20260709 12:23:08.630909 10789 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.634399 10796 raft_consensus.cc:493] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.638473 10468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84deda81af094e08b2e7a4ed94f091c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.634923 10796 raft_consensus.cc:515] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.640724 10796 leader_election.cc:290] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:08.642844 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84deda81af094e08b2e7a4ed94f091c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.643180 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:08.642606 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfc8bc479844f489e1971345747ec0a" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:08.646057 10594 leader_election.cc:343] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.647706 10789 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:08.652348 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3398d20ad4a14a89bcff5962ec30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.660899 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfc8bc479844f489e1971345747ec0a" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:08.660872 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:08.621029 10753 raft_consensus.cc:740] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.669155 10669 leader_election.cc:304] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:08.669999 10796 raft_consensus.cc:2749] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.668004 10750 raft_consensus.cc:359] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.671228 10750 raft_consensus.cc:385] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.671579 10750 raft_consensus.cc:740] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.672158 10750 consensus_queue.cc:260] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.676286 10789 consensus_queue.cc:1048] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:08.679239 10592 leader_election.cc:343] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:08.679733 10592 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:08.684140 10750 ts_tablet_manager.cc:1434] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:23:08.685642 10750 tablet_bootstrap.cc:492] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:08.686334 10789 raft_consensus.cc:2749] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.686549 10756 raft_consensus.cc:493] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.696501 10462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3398d20ad4a14a89bcff5962ec30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.702538 10752 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:08.703195 10756 raft_consensus.cc:515] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.704885 10749 tablet_bootstrap.cc:492] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:08.705410 10753 consensus_queue.cc:260] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.721158 10753 ts_tablet_manager.cc:1434] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.002s
I20260709 12:23:08.630527 10618 tablet_service.cc:1511] Processing CreateTablet for tablet daf3398d20ad4a14a89bcff5962ec30d (DEFAULT_TABLE table=test-workload [id=9453736da0bb405a872402e6aa3719db]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:08.723816 10756 leader_election.cc:290] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:08.726296 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:08.727634 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:08.728570 10554 raft_consensus.cc:2393] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5703388aa4f747c280bf93e578f6bad7 in current term 1: Already voted for candidate bb8b600238cd49d29a1bd59a571ab995 in this term.
I20260709 12:23:08.730444 10812 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:08.734208 10595 leader_election.cc:304] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:08.727890 10749 ts_tablet_manager.cc:1403] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.276s	user 0.027s	sys 0.003s
I20260709 12:23:08.738515 10749 raft_consensus.cc:359] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.742183 10756 raft_consensus.cc:3060] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.746917 10753 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:08.742302 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:08.748509 10554 raft_consensus.cc:2468] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:08.754379 10756 raft_consensus.cc:2749] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:08.740494 10749 raft_consensus.cc:385] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.756763 10749 raft_consensus.cc:740] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.740643 10752 ts_tablet_manager.cc:1403] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.244s	user 0.042s	sys 0.034s
I20260709 12:23:08.758349 10750 tablet_bootstrap.cc:654] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.757879 10618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3398d20ad4a14a89bcff5962ec30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:08.757936 10749 consensus_queue.cc:260] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.763787 10749 ts_tablet_manager.cc:1434] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:23:08.764213 10753 tablet_bootstrap.cc:654] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.765300 10749 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:08.816797 10445 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:08.762884 10752 raft_consensus.cc:359] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.842514 10752 raft_consensus.cc:385] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.847797 10755 raft_consensus.cc:493] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.848308 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:08.848977 10755 raft_consensus.cc:515] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.854333 10750 tablet_bootstrap.cc:492] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:08.859679 10749 tablet_bootstrap.cc:654] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.859956 10812 raft_consensus.cc:2804] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.860631 10812 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.861123 10812 raft_consensus.cc:3060] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.869041 10702 raft_consensus.cc:3060] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.871414 10750 ts_tablet_manager.cc:1403] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.186s	user 0.012s	sys 0.005s
I20260709 12:23:08.843160 10752 raft_consensus.cc:740] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.877715 10807 consensus_queue.cc:1048] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:08.880388 10752 consensus_queue.cc:260] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.881385 10750 raft_consensus.cc:359] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.882280 10703 raft_consensus.cc:2468] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:08.892530 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1674e84a5d245b4aa6ed2f18f24cf87" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:08.893848 10477 raft_consensus.cc:2468] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:08.896970 10517 leader_election.cc:304] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:08.882308 10750 raft_consensus.cc:385] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.899187 10750 raft_consensus.cc:740] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.905834 10753 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:08.907116 10753 ts_tablet_manager.cc:1403] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.002s
I20260709 12:23:08.908746 10752 ts_tablet_manager.cc:1434] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.149s	user 0.006s	sys 0.005s
I20260709 12:23:08.893014 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1674e84a5d245b4aa6ed2f18f24cf87" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:08.924659 10629 raft_consensus.cc:2468] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:08.924160 10750 consensus_queue.cc:260] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:08.911275 10752 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:08.898309 10755 leader_election.cc:290] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:08.939503 10750 ts_tablet_manager.cc:1434] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.006s
I20260709 12:23:08.939963 10755 raft_consensus.cc:2804] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:08.940485 10755 raft_consensus.cc:493] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.944634 10750 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
W20260709 12:23:08.949304 10595 consensus_peers.cc:597] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.945925 10753 raft_consensus.cc:359] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:08.954144 10749 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:08.950186 10755 raft_consensus.cc:3060] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:08.958194 10749 ts_tablet_manager.cc:1403] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.037s
I20260709 12:23:08.963234 10749 raft_consensus.cc:359] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.966593 10814 consensus_queue.cc:1048] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:08.975879 10752 tablet_bootstrap.cc:654] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.982510 10812 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:08.969233 10749 raft_consensus.cc:385] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.985778 10749 raft_consensus.cc:740] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.986404 10750 tablet_bootstrap.cc:654] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:08.986610 10749 consensus_queue.cc:260] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.951223 10753 raft_consensus.cc:385] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:08.989619 10753 raft_consensus.cc:740] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:08.989383 10749 ts_tablet_manager.cc:1434] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:08.994107 10755 raft_consensus.cc:515] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:08.999769 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1674e84a5d245b4aa6ed2f18f24cf87" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:08.999941 10755 leader_election.cc:290] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:09.000732 10477 raft_consensus.cc:3060] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.004391 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1674e84a5d245b4aa6ed2f18f24cf87" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.005128 10629 raft_consensus.cc:3060] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.019564 10830 raft_consensus.cc:493] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.020287 10830 raft_consensus.cc:515] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.023715 10749 tablet_bootstrap.cc:492] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:09.028494 10812 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:09.029620 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:09.030661 10701 raft_consensus.cc:3060] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.032759 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:09.033684 10555 raft_consensus.cc:3060] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.034945 10749 tablet_bootstrap.cc:654] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.029683 10752 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:09.038064 10752 ts_tablet_manager.cc:1403] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.001s
I20260709 12:23:09.041579 10752 raft_consensus.cc:359] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.042475 10752 raft_consensus.cc:385] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.042872 10752 raft_consensus.cc:740] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.042691 10772 consensus_queue.cc:1048] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.043826 10830 leader_election.cc:290] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:09.044584 10752 consensus_queue.cc:260] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.045765 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65720f7f3c724a08ba663044df41940e" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.047734 10796 raft_consensus.cc:493] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.048275 10796 raft_consensus.cc:515] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:09.048893 10520 leader_election.cc:343] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.022410 10753 consensus_queue.cc:260] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.050763 10796 leader_election.cc:290] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.054098 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935517510de547e9a555aa468eea1a10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:09.055904 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935517510de547e9a555aa468eea1a10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
W20260709 12:23:09.056063 10666 leader_election.cc:343] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.056754 10628 raft_consensus.cc:2468] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:09.058228 10669 leader_election.cc:304] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:09.063669 10796 raft_consensus.cc:2804] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.064155 10796 raft_consensus.cc:493] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.064553 10796 raft_consensus.cc:3060] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.065899 10752 ts_tablet_manager.cc:1434] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:23:09.068048 10753 ts_tablet_manager.cc:1434] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.160s	user 0.011s	sys 0.000s
I20260709 12:23:09.075637 10753 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.077553 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65720f7f3c724a08ba663044df41940e" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:09.078388 10479 raft_consensus.cc:2468] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.076421 10752 tablet_bootstrap.cc:492] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:09.087409 10517 leader_election.cc:304] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:09.089502 10830 raft_consensus.cc:2804] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.089924 10830 raft_consensus.cc:493] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.090276 10830 raft_consensus.cc:3060] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.087559 10477 raft_consensus.cc:2468] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.096784 10517 leader_election.cc:304] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.097627 10755 raft_consensus.cc:2804] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.085682 10629 raft_consensus.cc:2468] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.098417 10750 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.099838 10750 ts_tablet_manager.cc:1403] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.044s
I20260709 12:23:09.087713 10555 raft_consensus.cc:2468] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:09.102249 10445 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.103451 10772 raft_consensus.cc:2804] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.104099 10772 raft_consensus.cc:697] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:09.105207 10772 consensus_queue.cc:237] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.110625 10750 raft_consensus.cc:359] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.111912 10750 raft_consensus.cc:385] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.112293 10750 raft_consensus.cc:740] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.116647 10753 tablet_bootstrap.cc:654] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.125226 10752 tablet_bootstrap.cc:654] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.128353 10749 tablet_bootstrap.cc:492] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:09.129086 10749 ts_tablet_manager.cc:1403] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.009s
I20260709 12:23:09.130611 10750 consensus_queue.cc:260] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.130982 10755 raft_consensus.cc:697] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.134281 10755 consensus_queue.cc:237] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.136055 10841 raft_consensus.cc:493] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.136709 10841 raft_consensus.cc:515] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.137800 10749 raft_consensus.cc:359] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.138710 10749 raft_consensus.cc:385] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.138649 10830 raft_consensus.cc:515] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.139389 10749 raft_consensus.cc:740] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.141054 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.141587 10830 leader_election.cc:290] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:09.140842 10749 consensus_queue.cc:260] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:09.144238 10520 leader_election.cc:343] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.144006 10796 raft_consensus.cc:515] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.146041 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65720f7f3c724a08ba663044df41940e" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:09.146739 10477 raft_consensus.cc:3060] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.148013 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935517510de547e9a555aa468eea1a10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.148345 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935517510de547e9a555aa468eea1a10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:09.148756 10629 raft_consensus.cc:3060] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.149916 10666 leader_election.cc:343] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.151636 10749 ts_tablet_manager.cc:1434] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:23:09.151996 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65720f7f3c724a08ba663044df41940e" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.158705 10627 raft_consensus.cc:3060] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.160120 10750 ts_tablet_manager.cc:1434] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 12:23:09.161685 10750 tablet_bootstrap.cc:492] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:09.153322 10796 leader_election.cc:290] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.171823 10376 catalog_manager.cc:5697] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.175490 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.176506 10704 raft_consensus.cc:2468] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.179275 10519 leader_election.cc:304] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:09.180512 10830 raft_consensus.cc:2804] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.168226 10701 raft_consensus.cc:2468] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:09.180919 10830 raft_consensus.cc:493] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.182595 10749 tablet_bootstrap.cc:492] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:09.173170 10841 leader_election.cc:290] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.190923 10841 raft_consensus.cc:493] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.191768 10841 raft_consensus.cc:515] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.194847 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e198a442da43a78d7375424fa47317" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.195585 10628 raft_consensus.cc:2468] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.196523 10749 tablet_bootstrap.cc:654] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.196825 10520 leader_election.cc:304] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:09.197569 10629 raft_consensus.cc:2468] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:09.186663 10477 raft_consensus.cc:2468] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.188006 10830 raft_consensus.cc:3060] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.199407 10841 leader_election.cc:290] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.209012 10750 tablet_bootstrap.cc:654] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.210390 10755 raft_consensus.cc:2804] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.210886 10755 raft_consensus.cc:493] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.211289 10755 raft_consensus.cc:3060] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.215541 10669 leader_election.cc:304] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:09.216684 10796 raft_consensus.cc:2804] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.217186 10796 raft_consensus.cc:697] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:09.217968 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e198a442da43a78d7375424fa47317" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.218010 10796 consensus_queue.cc:237] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:09.226308 10519 leader_election.cc:343] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.230556 10627 raft_consensus.cc:2468] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.232220 10517 leader_election.cc:304] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.234361 10752 tablet_bootstrap.cc:492] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:09.234897 10752 ts_tablet_manager.cc:1403] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.029s
I20260709 12:23:09.235940 10830 raft_consensus.cc:515] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.238198 10830 leader_election.cc:290] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.238878 10830 raft_consensus.cc:2804] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.237820 10752 raft_consensus.cc:359] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.240060 10752 raft_consensus.cc:385] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.240430 10752 raft_consensus.cc:740] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.239431 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:09.241093 10830 raft_consensus.cc:697] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.244251 10752 consensus_queue.cc:260] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.246511 10701 raft_consensus.cc:3060] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.248169 10830 consensus_queue.cc:237] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.250159 10753 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:09.250703 10753 ts_tablet_manager.cc:1403] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.013s
I20260709 12:23:09.243429 10755 raft_consensus.cc:515] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:09.245465 10520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 48759.6us
I20260709 12:23:09.256539 10753 raft_consensus.cc:359] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.257292 10753 raft_consensus.cc:385] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.257601 10753 raft_consensus.cc:740] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.258426 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e198a442da43a78d7375424fa47317" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.258402 10753 consensus_queue.cc:260] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.259153 10629 raft_consensus.cc:3060] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.264811 10750 tablet_bootstrap.cc:492] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.265383 10750 ts_tablet_manager.cc:1403] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.021s
I20260709 12:23:09.269148 10755 leader_election.cc:290] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.269652 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.271332 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e198a442da43a78d7375424fa47317" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:09.272286 10704 raft_consensus.cc:3060] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.271795 10375 catalog_manager.cc:5697] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.276798 10750 raft_consensus.cc:359] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.277832 10750 raft_consensus.cc:385] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.278357 10750 raft_consensus.cc:740] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.285913 10752 ts_tablet_manager.cc:1434] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.007s
I20260709 12:23:09.288750 10750 consensus_queue.cc:260] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.294752 10750 ts_tablet_manager.cc:1434] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:23:09.296698 10750 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
W20260709 12:23:09.281838 10520 leader_election.cc:343] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.300329 10753 ts_tablet_manager.cc:1434] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.003s
I20260709 12:23:09.302111 10753 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.280169 10629 raft_consensus.cc:2468] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.306566 10701 raft_consensus.cc:2468] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.307904 10519 leader_election.cc:304] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:09.313174 10752 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:09.314226 10830 raft_consensus.cc:2804] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.314818 10520 leader_election.cc:304] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:09.315963 10830 raft_consensus.cc:697] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.318681 10755 raft_consensus.cc:2804] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.319410 10750 tablet_bootstrap.cc:654] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.319273 10755 raft_consensus.cc:697] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.320226 10755 consensus_queue.cc:237] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.320173 10704 raft_consensus.cc:2468] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.318737 10830 consensus_queue.cc:237] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.330276 10749 tablet_bootstrap.cc:492] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:09.330799 10749 ts_tablet_manager.cc:1403] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.008s
I20260709 12:23:09.334115 10749 raft_consensus.cc:359] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.335343 10753 tablet_bootstrap.cc:654] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.336151 10750 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.336704 10750 ts_tablet_manager.cc:1403] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.019s
I20260709 12:23:09.340080 10750 raft_consensus.cc:359] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.340776 10750 raft_consensus.cc:385] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.341071 10750 raft_consensus.cc:740] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.341415 10752 tablet_bootstrap.cc:654] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.335137 10749 raft_consensus.cc:385] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.344818 10750 consensus_queue.cc:260] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.345583 10749 raft_consensus.cc:740] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.346437 10749 consensus_queue.cc:260] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.347122 10750 ts_tablet_manager.cc:1434] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:09.348687 10750 tablet_bootstrap.cc:492] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:09.350914 10749 ts_tablet_manager.cc:1434] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 12:23:09.352277 10749 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:09.352171 10373 catalog_manager.cc:5697] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.355129 10750 tablet_bootstrap.cc:654] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.354382 10373 catalog_manager.cc:5697] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.365132 10555 raft_consensus.cc:3060] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.367740 10772 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.368461 10772 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.370412 10749 tablet_bootstrap.cc:654] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.373348 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.374478 10629 raft_consensus.cc:2468] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:09.376362 10445 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.377614 10812 raft_consensus.cc:2804] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.378310 10812 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.378810 10812 raft_consensus.cc:3060] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.401449 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:09.403985 10444 leader_election.cc:343] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.404938 10772 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.361714 10753 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:09.412089 10753 ts_tablet_manager.cc:1403] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.002s
I20260709 12:23:09.416965 10753 raft_consensus.cc:359] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.419500 10753 raft_consensus.cc:385] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.422279 10753 raft_consensus.cc:740] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.423463 10812 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.433982 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.434806 10629 raft_consensus.cc:3060] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.446772 10752 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:09.447080 10749 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:09.447559 10749 ts_tablet_manager.cc:1403] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.096s	user 0.005s	sys 0.035s
I20260709 12:23:09.448314 10752 ts_tablet_manager.cc:1403] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.136s	user 0.043s	sys 0.020s
I20260709 12:23:09.451190 10752 raft_consensus.cc:359] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.451455 10749 raft_consensus.cc:359] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.451948 10752 raft_consensus.cc:385] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.452117 10749 raft_consensus.cc:385] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.452276 10752 raft_consensus.cc:740] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.452440 10749 raft_consensus.cc:740] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.453053 10812 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.453207 10749 consensus_queue.cc:260] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.455400 10629 raft_consensus.cc:2468] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:09.429595 10753 consensus_queue.cc:260] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.457187 10749 ts_tablet_manager.cc:1434] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:09.458019 10753 ts_tablet_manager.cc:1434] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:23:09.458079 10750 tablet_bootstrap.cc:492] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.458473 10445 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.458794 10750 ts_tablet_manager.cc:1403] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.110s	user 0.045s	sys 0.056s
I20260709 12:23:09.459403 10772 raft_consensus.cc:2804] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.459962 10772 raft_consensus.cc:697] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:09.460907 10772 consensus_queue.cc:237] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.454367 10752 consensus_queue.cc:260] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.462118 10750 raft_consensus.cc:359] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.462965 10750 raft_consensus.cc:385] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.463413 10750 raft_consensus.cc:740] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.464617 10753 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.464294 10750 consensus_queue.cc:260] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.465574 10752 ts_tablet_manager.cc:1434] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:09.454618 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:09.466732 10752 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
W20260709 12:23:09.467918 10444 leader_election.cc:343] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.471004 10750 ts_tablet_manager.cc:1434] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 12:23:09.471983 10753 tablet_bootstrap.cc:654] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.472172 10749 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:09.472819 10750 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:09.480919 10750 tablet_bootstrap.cc:654] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.486765 10752 tablet_bootstrap.cc:654] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.488277 10749 tablet_bootstrap.cc:654] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.492362 10375 catalog_manager.cc:5697] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.499262 10753 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:09.499966 10753 ts_tablet_manager.cc:1403] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.008s
I20260709 12:23:09.495096 10375 catalog_manager.cc:5697] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.516527 10752 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:09.517241 10752 ts_tablet_manager.cc:1403] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 12:23:09.519282 10789 raft_consensus.cc:493] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.519991 10789 raft_consensus.cc:515] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.520795 10753 raft_consensus.cc:359] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.521771 10753 raft_consensus.cc:385] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.522114 10753 raft_consensus.cc:740] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.532050 10749 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:09.532724 10749 ts_tablet_manager.cc:1403] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.009s
I20260709 12:23:09.547120 10753 consensus_queue.cc:260] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.549405 10753 ts_tablet_manager.cc:1434] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.010s
I20260709 12:23:09.551823 10753 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.552544 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5986a6cceb0d4ee4ba760b56e3a47fab" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:09.552907 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5986a6cceb0d4ee4ba760b56e3a47fab" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:09.554184 10595 leader_election.cc:343] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.554867 10594 leader_election.cc:343] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.555400 10594 leader_election.cc:304] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:09.557183 10750 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.557753 10750 ts_tablet_manager.cc:1403] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.085s	user 0.033s	sys 0.018s
I20260709 12:23:09.557847 10789 leader_election.cc:290] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.558570 10753 tablet_bootstrap.cc:654] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.558921 10755 raft_consensus.cc:493] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.559077 10809 raft_consensus.cc:2749] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.559551 10755 raft_consensus.cc:515] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.552052 10374 catalog_manager.cc:5697] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:09.562992 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:09.565083 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.567203 10750 raft_consensus.cc:359] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.568022 10750 raft_consensus.cc:385] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.568408 10750 raft_consensus.cc:740] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.569346 10796 raft_consensus.cc:493] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.569255 10750 consensus_queue.cc:260] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.569847 10796 raft_consensus.cc:515] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.572042 10750 ts_tablet_manager.cc:1434] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 12:23:09.574059 10519 leader_election.cc:343] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.564284 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:09.575728 10477 raft_consensus.cc:2468] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.575198 10749 raft_consensus.cc:359] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.576340 10749 raft_consensus.cc:385] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.576932 10749 raft_consensus.cc:740] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.577996 10517 leader_election.cc:304] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:09.578388 10830 consensus_queue.cc:1048] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.578878 10847 raft_consensus.cc:2804] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.579509 10847 raft_consensus.cc:493] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.579988 10847 raft_consensus.cc:3060] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.580307 10796 leader_election.cc:290] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:09.582273 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af59f95c2f43cc9cd8093395b00e10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:09.582973 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af59f95c2f43cc9cd8093395b00e10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:09.584641 10666 leader_election.cc:343] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.585251 10755 leader_election.cc:290] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.589341 10750 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:09.557093 10752 raft_consensus.cc:359] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.592031 10752 raft_consensus.cc:385] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.592448 10752 raft_consensus.cc:740] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.593343 10752 consensus_queue.cc:260] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.578486 10749 consensus_queue.cc:260] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.600459 10555 raft_consensus.cc:2468] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:09.604166 10669 leader_election.cc:304] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:09.605398 10796 raft_consensus.cc:2804] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.605774 10796 raft_consensus.cc:493] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.606119 10796 raft_consensus.cc:3060] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.608392 10847 raft_consensus.cc:515] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.612275 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:09.613296 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:09.614214 10477 raft_consensus.cc:3060] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.615285 10519 leader_election.cc:343] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.620661 10847 leader_election.cc:290] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.624627 10752 ts_tablet_manager.cc:1434] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.107s	user 0.015s	sys 0.006s
I20260709 12:23:09.628183 10753 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:09.628293 10755 consensus_queue.cc:1048] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.628896 10753 ts_tablet_manager.cc:1403] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.077s	user 0.028s	sys 0.033s
I20260709 12:23:09.626716 10796 raft_consensus.cc:515] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.631428 10752 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:09.632182 10753 raft_consensus.cc:359] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.632997 10753 raft_consensus.cc:385] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.633322 10753 raft_consensus.cc:740] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.634095 10753 consensus_queue.cc:260] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.635406 10750 tablet_bootstrap.cc:654] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.636489 10753 ts_tablet_manager.cc:1434] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:09.637332 10796 leader_election.cc:290] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:09.637838 10753 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.638619 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af59f95c2f43cc9cd8093395b00e10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:09.642663 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af59f95c2f43cc9cd8093395b00e10" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:09.643338 10555 raft_consensus.cc:3060] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.645995 10753 tablet_bootstrap.cc:654] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.649072 10752 tablet_bootstrap.cc:654] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:09.650144 10666 leader_election.cc:343] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.659646 10814 consensus_queue.cc:1048] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.661005 10796 consensus_queue.cc:1048] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.665547 10477 raft_consensus.cc:2468] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.670186 10517 leader_election.cc:304] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:09.672043 10755 raft_consensus.cc:2804] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.672817 10755 raft_consensus.cc:697] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.674227 10755 consensus_queue.cc:237] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.677848 10847 raft_consensus.cc:493] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.664561 10749 ts_tablet_manager.cc:1434] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.131s	user 0.013s	sys 0.003s
I20260709 12:23:09.678905 10847 raft_consensus.cc:515] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.681597 10749 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:09.658910 10555 raft_consensus.cc:2468] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:09.683138 10847 leader_election.cc:290] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:09.683740 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0f84b23d4749ca89ce418105b87c0d" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.701917 10628 raft_consensus.cc:2468] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.684356 10841 raft_consensus.cc:493] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.702919 10841 raft_consensus.cc:515] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.703267 10520 leader_election.cc:304] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:09.704254 10847 raft_consensus.cc:2804] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.704639 10847 raft_consensus.cc:493] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.704993 10847 raft_consensus.cc:3060] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.705123 10841 leader_election.cc:290] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.685612 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0f84b23d4749ca89ce418105b87c0d" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:09.706399 10478 raft_consensus.cc:2468] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.692483 10812 consensus_queue.cc:1048] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.697468 10752 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:09.707643 10752 ts_tablet_manager.cc:1403] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.005s
I20260709 12:23:09.710518 10752 raft_consensus.cc:359] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.711849 10749 tablet_bootstrap.cc:654] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.714123 10669 leader_election.cc:304] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:09.697516 10753 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:09.717824 10753 ts_tablet_manager.cc:1403] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.029s
I20260709 12:23:09.718196 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.711213 10752 raft_consensus.cc:385] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.718869 10752 raft_consensus.cc:740] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.718921 10702 raft_consensus.cc:2468] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.719775 10752 consensus_queue.cc:260] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.720225 10519 leader_election.cc:304] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:09.720415 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:09.721101 10755 raft_consensus.cc:2804] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.721062 10479 raft_consensus.cc:2468] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:09.721594 10755 raft_consensus.cc:493] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.722043 10755 raft_consensus.cc:3060] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.726639 10880 raft_consensus.cc:2804] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.727197 10880 raft_consensus.cc:697] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:09.727825 10841 consensus_queue.cc:1048] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.728713 10753 raft_consensus.cc:359] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.731858 10753 raft_consensus.cc:385] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.738063 10753 raft_consensus.cc:740] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.739388 10753 consensus_queue.cc:260] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.740384 10789 raft_consensus.cc:493] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.742767 10789 raft_consensus.cc:515] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:09.745043 10753 ts_tablet_manager.cc:1434] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:23:09.748234 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.700543 10750 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.749096 10701 raft_consensus.cc:2393] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5703388aa4f747c280bf93e578f6bad7 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:09.749341 10750 ts_tablet_manager.cc:1403] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.000s
I20260709 12:23:09.748538 10753 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.745509 10789 leader_election.cc:290] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.751431 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:09.753204 10595 leader_election.cc:304] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:09.755092 10789 raft_consensus.cc:3060] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.756179 10479 raft_consensus.cc:3060] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.742324 10755 raft_consensus.cc:515] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.765756 10750 raft_consensus.cc:359] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.766659 10750 raft_consensus.cc:385] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.766999 10750 raft_consensus.cc:740] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.767053 10880 consensus_queue.cc:237] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.771256 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:09.790428 10701 raft_consensus.cc:3060] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.790647 10374 catalog_manager.cc:5697] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.793674 10755 leader_election.cc:290] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.794756 10812 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.795331 10812 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.797515 10812 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:09.799636 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.772287 10789 raft_consensus.cc:2749] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.776437 10753 tablet_bootstrap.cc:654] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.717103 10847 raft_consensus.cc:515] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.782200 10752 ts_tablet_manager.cc:1434] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.074s	user 0.016s	sys 0.013s
I20260709 12:23:09.781773 10830 consensus_queue.cc:1048] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.794642 10755 consensus_queue.cc:1048] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.807900 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.808686 10629 raft_consensus.cc:2468] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:09.810235 10752 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:09.810323 10445 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.811102 10830 consensus_queue.cc:1048] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.811533 10812 raft_consensus.cc:2804] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:09.811970 10812 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.812305 10812 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:09.815441 10444 leader_election.cc:343] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.825215 10750 consensus_queue.cc:260] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.830416 10749 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:09.831159 10749 ts_tablet_manager.cc:1403] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.150s	user 0.015s	sys 0.004s
I20260709 12:23:09.838963 10884 consensus_queue.cc:1048] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:23:09.849341 10750 ts_tablet_manager.cc:1434] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 12:23:09.851585 10750 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:09.853159 10749 raft_consensus.cc:359] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.853911 10749 raft_consensus.cc:385] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.854182 10749 raft_consensus.cc:740] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.854710 10847 leader_election.cc:290] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:09.855907 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0f84b23d4749ca89ce418105b87c0d" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:09.856560 10629 raft_consensus.cc:3060] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.856699 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:09.857412 10478 raft_consensus.cc:3060] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.863265 10755 consensus_queue.cc:1048] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.869014 10478 raft_consensus.cc:2468] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.869841 10629 raft_consensus.cc:2468] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.871192 10520 leader_election.cc:304] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:09.871628 10750 tablet_bootstrap.cc:654] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.872181 10755 raft_consensus.cc:2804] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.872756 10755 raft_consensus.cc:697] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.873706 10755 consensus_queue.cc:237] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.878620 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0f84b23d4749ca89ce418105b87c0d" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:09.874781 10701 raft_consensus.cc:2468] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.879792 10749 consensus_queue.cc:260] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.881531 10752 tablet_bootstrap.cc:654] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.883211 10517 leader_election.cc:304] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:09.884876 10809 raft_consensus.cc:493] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.885375 10809 raft_consensus.cc:515] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.882330 10477 raft_consensus.cc:3060] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.887755 10809 leader_election.cc:290] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.888453 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:09.889654 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:09.890046 10594 leader_election.cc:343] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:09.891445 10592 leader_election.cc:343] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:09.891950 10592 leader_election.cc:304] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:09.892774 10809 raft_consensus.cc:2749] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.903777 10749 ts_tablet_manager.cc:1434] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:23:09.908344 10753 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:09.908880 10753 ts_tablet_manager.cc:1403] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.161s	user 0.024s	sys 0.007s
I20260709 12:23:09.909444 10772 consensus_queue.cc:1048] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:09.906250 10847 raft_consensus.cc:2804] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.910682 10477 raft_consensus.cc:2468] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:09.911509 10847 raft_consensus.cc:697] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:09.912261 10881 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.915872 10753 raft_consensus.cc:359] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.916400 10812 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.922923 10847 consensus_queue.cc:237] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:09.923919 10881 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:09.926563 10881 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:09.923974 10753 raft_consensus.cc:385] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.928197 10753 raft_consensus.cc:740] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.929203 10753 consensus_queue.cc:260] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:09.928762 10517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 45472.4us
I20260709 12:23:09.934913 10749 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:09.936049 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:09.937028 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:09.940414 10372 catalog_manager.cc:5697] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:09.943068 10750 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:09.949944 10750 ts_tablet_manager.cc:1403] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.007s
I20260709 12:23:09.972728 10753 ts_tablet_manager.cc:1434] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 12:23:09.972947 10830 consensus_queue.cc:1048] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:09.975813 10666 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:09.977530 10881 raft_consensus.cc:2749] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:09.974660 10753 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:09.991750 10749 tablet_bootstrap.cc:654] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.982709 10750 raft_consensus.cc:359] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.992868 10750 raft_consensus.cc:385] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.993264 10750 raft_consensus.cc:740] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.994160 10750 consensus_queue.cc:260] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:09.999276 10750 ts_tablet_manager.cc:1434] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:23:10.004415 10752 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.005004 10752 ts_tablet_manager.cc:1403] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.002s
W20260709 12:23:09.997208 10594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 54059.5us
I20260709 12:23:10.017751 10703 raft_consensus.cc:3060] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.018744 10752 raft_consensus.cc:359] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.019526 10752 raft_consensus.cc:385] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.019805 10752 raft_consensus.cc:740] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.020506 10752 consensus_queue.cc:260] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.023741 10753 tablet_bootstrap.cc:654] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.028085 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:10.028743 10629 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.029052 10752 ts_tablet_manager.cc:1434] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:23:10.030437 10752 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.033447 10374 catalog_manager.cc:5697] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.054522 10752 tablet_bootstrap.cc:654] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.050619 10812 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.058846 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:10.060570 10750 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
W20260709 12:23:10.064067 10444 leader_election.cc:343] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.070591 10750 tablet_bootstrap.cc:654] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.070824 10830 raft_consensus.cc:493] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.073944 10830 raft_consensus.cc:515] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.076407 10881 raft_consensus.cc:493] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.076921 10881 raft_consensus.cc:515] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.078212 10830 leader_election.cc:290] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.079093 10881 leader_election.cc:290] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.079643 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:10.083330 10517 leader_election.cc:343] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.084220 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:10.084605 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.085177 10479 raft_consensus.cc:2393] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate becf98b94b704731a507d96d1a44737c in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:10.084970 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814d4d8348e448728625bdcbaf25f440" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.085373 10703 raft_consensus.cc:2468] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:10.086640 10519 leader_election.cc:304] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:10.086872 10669 leader_election.cc:304] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:10.073206 10812 consensus_queue.cc:1048] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:23:10.088071 10881 raft_consensus.cc:3060] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.088162 10830 raft_consensus.cc:2804] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.091221 10830 raft_consensus.cc:493] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.093595 10830 raft_consensus.cc:3060] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.090116 10749 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:10.071839 10629 raft_consensus.cc:2468] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:10.089118 10753 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:10.099365 10749 ts_tablet_manager.cc:1403] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.000s
I20260709 12:23:10.100157 10445 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.102022 10812 raft_consensus.cc:2804] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.102511 10812 raft_consensus.cc:697] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:10.102934 10749 raft_consensus.cc:359] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.103796 10749 raft_consensus.cc:385] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.103392 10812 consensus_queue.cc:237] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.104104 10749 raft_consensus.cc:740] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.105232 10753 ts_tablet_manager.cc:1403] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.002s
I20260709 12:23:10.105834 10749 consensus_queue.cc:260] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.106982 10752 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.107519 10752 ts_tablet_manager.cc:1403] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.003s
I20260709 12:23:10.108038 10749 ts_tablet_manager.cc:1434] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:10.109618 10749 tablet_bootstrap.cc:492] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:10.110378 10750 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.110908 10750 ts_tablet_manager.cc:1403] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.002s
I20260709 12:23:10.113790 10881 raft_consensus.cc:2749] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.115765 10749 tablet_bootstrap.cc:654] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.115870 10372 catalog_manager.cc:5697] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.113691 10750 raft_consensus.cc:359] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.117406 10750 raft_consensus.cc:385] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.117750 10750 raft_consensus.cc:740] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.116202 10752 raft_consensus.cc:359] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.118660 10752 raft_consensus.cc:385] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.119010 10752 raft_consensus.cc:740] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.119573 10750 consensus_queue.cc:260] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.108047 10753 raft_consensus.cc:359] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.121979 10753 raft_consensus.cc:385] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.122259 10753 raft_consensus.cc:740] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.122762 10750 ts_tablet_manager.cc:1434] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 12:23:10.123024 10753 consensus_queue.cc:260] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.124634 10752 consensus_queue.cc:260] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.126773 10752 ts_tablet_manager.cc:1434] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:23:10.127844 10752 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.123863 10750 tablet_bootstrap.cc:492] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:10.132718 10830 raft_consensus.cc:515] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.125072 10753 ts_tablet_manager.cc:1434] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:23:10.138876 10753 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:10.141188 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:10.141815 10703 raft_consensus.cc:3060] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.145861 10753 tablet_bootstrap.cc:654] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.147912 10830 leader_election.cc:290] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.148131 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
W20260709 12:23:10.149657 10517 leader_election.cc:343] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.151368 10752 tablet_bootstrap.cc:654] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.154346 10749 tablet_bootstrap.cc:492] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:10.154878 10749 ts_tablet_manager.cc:1403] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.003s
I20260709 12:23:10.154738 10372 catalog_manager.cc:5697] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.158154 10750 tablet_bootstrap.cc:654] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.157959 10749 raft_consensus.cc:359] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.159868 10749 raft_consensus.cc:385] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.160341 10749 raft_consensus.cc:740] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.161360 10749 consensus_queue.cc:260] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.163962 10749 ts_tablet_manager.cc:1434] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:23:10.165408 10749 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:10.171461 10812 raft_consensus.cc:493] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.172199 10749 tablet_bootstrap.cc:654] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.172086 10812 raft_consensus.cc:515] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.171538 10752 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.172909 10703 raft_consensus.cc:2468] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:10.173511 10752 ts_tablet_manager.cc:1403] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 12:23:10.174300 10812 leader_election.cc:290] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.174510 10519 leader_election.cc:304] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:10.175879 10830 raft_consensus.cc:2804] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.176497 10830 raft_consensus.cc:697] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:10.176409 10752 raft_consensus.cc:359] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.176822 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:10.177198 10752 raft_consensus.cc:385] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.178069 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.177620 10830 consensus_queue.cc:237] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.178788 10701 raft_consensus.cc:2468] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:10.181145 10750 tablet_bootstrap.cc:492] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.181667 10750 ts_tablet_manager.cc:1403] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.003s
I20260709 12:23:10.182301 10444 leader_election.cc:304] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:10.183331 10812 raft_consensus.cc:2804] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.183735 10812 raft_consensus.cc:493] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.184103 10812 raft_consensus.cc:3060] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.185263 10750 raft_consensus.cc:359] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.185981 10750 raft_consensus.cc:385] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.186254 10750 raft_consensus.cc:740] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.188931 10753 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:10.189491 10753 ts_tablet_manager.cc:1403] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.003s
I20260709 12:23:10.177501 10752 raft_consensus.cc:740] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.192185 10750 consensus_queue.cc:260] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.193421 10752 consensus_queue.cc:260] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.196995 10750 ts_tablet_manager.cc:1434] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:23:10.177467 10629 raft_consensus.cc:2468] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:10.202813 10376 catalog_manager.cc:5697] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.203743 10752 ts_tablet_manager.cc:1434] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:10.204969 10752 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.207159 10830 raft_consensus.cc:493] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.207804 10830 raft_consensus.cc:515] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.209275 10812 raft_consensus.cc:515] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.210886 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:10.195488 10753 raft_consensus.cc:359] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.212030 10753 raft_consensus.cc:385] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.212301 10753 raft_consensus.cc:740] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.213068 10753 consensus_queue.cc:260] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.213521 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:10.213959 10478 raft_consensus.cc:2468] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:10.214155 10703 raft_consensus.cc:3060] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.217326 10517 leader_election.cc:304] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:10.218204 10755 raft_consensus.cc:2804] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.218570 10755 raft_consensus.cc:493] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.218915 10755 raft_consensus.cc:3060] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.219429 10830 leader_election.cc:290] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:10.223992 10812 leader_election.cc:290] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.226999 10749 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:10.226676 10755 raft_consensus.cc:515] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.227113 10703 raft_consensus.cc:2468] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:10.228415 10444 leader_election.cc:304] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:10.228629 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:10.229298 10626 raft_consensus.cc:3060] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.229321 10812 raft_consensus.cc:2804] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.229708 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:10.230293 10478 raft_consensus.cc:3060] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.230211 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:10.230257 10812 raft_consensus.cc:697] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:10.230978 10627 raft_consensus.cc:2468] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:10.231446 10812 consensus_queue.cc:237] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.235272 10750 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:10.211184 10752 tablet_bootstrap.cc:654] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.245888 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:10.244045 10750 tablet_bootstrap.cc:654] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.246825 10627 raft_consensus.cc:3060] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.247282 10755 leader_election.cc:290] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:10.261518 10627 raft_consensus.cc:2468] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:10.253592 10626 raft_consensus.cc:2468] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:10.263175 10520 leader_election.cc:304] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:10.264124 10755 raft_consensus.cc:2804] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.253899 10749 ts_tablet_manager.cc:1403] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.012s
I20260709 12:23:10.264714 10755 raft_consensus.cc:697] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:10.261034 10376 catalog_manager.cc:5697] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.265645 10750 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.265563 10755 consensus_queue.cc:237] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.266407 10750 ts_tablet_manager.cc:1403] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 12:23:10.267540 10749 raft_consensus.cc:359] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.268239 10749 raft_consensus.cc:385] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.268501 10749 raft_consensus.cc:740] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.269099 10749 consensus_queue.cc:260] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.269765 10750 raft_consensus.cc:359] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.270397 10750 raft_consensus.cc:385] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.270637 10750 raft_consensus.cc:740] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.271186 10749 ts_tablet_manager.cc:1434] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:10.271561 10752 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.271286 10750 consensus_queue.cc:260] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.272249 10752 ts_tablet_manager.cc:1403] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.005s
I20260709 12:23:10.250145 10478 raft_consensus.cc:2468] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:10.273554 10750 ts_tablet_manager.cc:1434] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:10.274964 10750 tablet_bootstrap.cc:492] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:10.275898 10753 ts_tablet_manager.cc:1434] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 12:23:10.275290 10752 raft_consensus.cc:359] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.276310 10752 raft_consensus.cc:385] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.276623 10752 raft_consensus.cc:740] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.276911 10753 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:10.278074 10752 consensus_queue.cc:260] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.281800 10750 tablet_bootstrap.cc:654] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.284982 10749 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:10.291747 10839 raft_consensus.cc:493] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.292068 10752 ts_tablet_manager.cc:1434] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:10.292387 10839 raft_consensus.cc:515] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.293172 10752 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.294592 10839 leader_election.cc:290] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.299904 10752 tablet_bootstrap.cc:654] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.299758 10830 consensus_queue.cc:1048] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.292052 10753 tablet_bootstrap.cc:654] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.302556 10898 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.303072 10898 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.312243 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:10.313109 10626 raft_consensus.cc:2468] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:10.314322 10898 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.314220 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:10.317673 10669 leader_election.cc:304] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:10.318887 10839 raft_consensus.cc:2804] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.319131 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:10.319372 10839 raft_consensus.cc:493] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.319815 10839 raft_consensus.cc:3060] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:10.321823 10592 leader_election.cc:343] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.321691 10886 consensus_queue.cc:1048] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.325284 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:10.327518 10666 leader_election.cc:343] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.331009 10749 tablet_bootstrap.cc:654] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:10.332664 10595 leader_election.cc:343] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.333189 10595 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:10.333439 10750 tablet_bootstrap.cc:492] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.334136 10750 ts_tablet_manager.cc:1403] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.007s
I20260709 12:23:10.343077 10898 raft_consensus.cc:2749] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.348201 10880 raft_consensus.cc:493] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.349081 10880 raft_consensus.cc:515] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.352272 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:10.351953 10372 catalog_manager.cc:5697] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.352685 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.352866 10880 leader_election.cc:290] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.353675 10555 raft_consensus.cc:2468] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
W20260709 12:23:10.354465 10666 leader_election.cc:343] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.355170 10669 leader_election.cc:304] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:10.364924 10886 consensus_queue.cc:1048] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.368134 10880 raft_consensus.cc:2804] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.368634 10880 raft_consensus.cc:493] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.368958 10880 raft_consensus.cc:3060] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.368039 10881 consensus_queue.cc:1048] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:10.368081 10752 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.371445 10886 consensus_queue.cc:1048] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.372180 10752 ts_tablet_manager.cc:1403] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.007s
I20260709 12:23:10.375326 10752 raft_consensus.cc:359] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.376057 10752 raft_consensus.cc:385] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.375990 10750 raft_consensus.cc:359] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.376586 10752 raft_consensus.cc:740] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.376904 10750 raft_consensus.cc:385] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.377254 10750 raft_consensus.cc:740] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.377557 10752 consensus_queue.cc:260] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.377946 10750 consensus_queue.cc:260] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.380265 10752 ts_tablet_manager.cc:1434] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:10.357995 10839 raft_consensus.cc:515] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.389905 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:10.390573 10626 raft_consensus.cc:3060] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.390625 10812 raft_consensus.cc:493] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.391227 10812 raft_consensus.cc:515] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.392371 10750 ts_tablet_manager.cc:1434] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.003s
I20260709 12:23:10.393204 10753 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:10.393622 10750 tablet_bootstrap.cc:492] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:10.393759 10753 ts_tablet_manager.cc:1403] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.001s
I20260709 12:23:10.396744 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d6d3887b1d47638ed56acc7074311b" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.398554 10812 leader_election.cc:290] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.394932 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d6d3887b1d47638ed56acc7074311b" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:10.400179 10445 leader_election.cc:343] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.402002 10752 tablet_bootstrap.cc:492] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
W20260709 12:23:10.405393 10444 leader_election.cc:343] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.410194 10753 raft_consensus.cc:359] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.411746 10753 raft_consensus.cc:385] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.412045 10753 raft_consensus.cc:740] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.412322 10750 tablet_bootstrap.cc:654] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.405941 10444 leader_election.cc:304] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.415859 10839 leader_election.cc:290] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.416098 10753 consensus_queue.cc:260] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.420012 10812 raft_consensus.cc:2749] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.423352 10749 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:10.423907 10749 ts_tablet_manager.cc:1403] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.001s
I20260709 12:23:10.409240 10626 raft_consensus.cc:2468] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:10.430012 10753 ts_tablet_manager.cc:1434] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:23:10.433005 10753 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:10.437052 10755 consensus_queue.cc:1048] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.440418 10753 tablet_bootstrap.cc:654] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.440874 10669 leader_election.cc:304] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
W20260709 12:23:10.443729 10666 consensus_peers.cc:597] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:10.445449 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:10.446965 10749 raft_consensus.cc:359] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.451900 10749 raft_consensus.cc:385] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.452265 10749 raft_consensus.cc:740] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.453043 10749 consensus_queue.cc:260] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.454370 10752 tablet_bootstrap.cc:654] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.455467 10749 ts_tablet_manager.cc:1434] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 12:23:10.456733 10749 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:10.461969 10839 raft_consensus.cc:2804] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.462567 10839 raft_consensus.cc:697] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:10.463766 10839 consensus_queue.cc:237] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:10.464352 10666 leader_election.cc:343] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.465603 10789 raft_consensus.cc:493] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.466184 10789 raft_consensus.cc:515] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.469027 10789 leader_election.cc:290] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.471913 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c771f43203d841dd8d4f4e999b6d360e" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.472640 10555 raft_consensus.cc:2468] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:10.473007 10749 tablet_bootstrap.cc:654] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.490525 10750 tablet_bootstrap.cc:492] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.491071 10750 ts_tablet_manager.cc:1403] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.020s
I20260709 12:23:10.507638 10753 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:10.508440 10753 ts_tablet_manager.cc:1403] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.007s
I20260709 12:23:10.491699 10595 leader_election.cc:304] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:10.514886 10898 raft_consensus.cc:2804] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.515421 10898 raft_consensus.cc:493] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.515800 10898 raft_consensus.cc:3060] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.516908 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c771f43203d841dd8d4f4e999b6d360e" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:10.517896 10479 raft_consensus.cc:2468] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:10.512552 10880 raft_consensus.cc:515] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.526286 10880 leader_election.cc:290] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.528936 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:10.530121 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:10.530786 10555 raft_consensus.cc:3060] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.534338 10898 raft_consensus.cc:515] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.537562 10750 raft_consensus.cc:359] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.538502 10750 raft_consensus.cc:385] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.545765 10750 raft_consensus.cc:740] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.535122 10841 consensus_queue.cc:1048] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:23:10.540261 10666 leader_election.cc:343] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.551396 10750 consensus_queue.cc:260] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.540971 10789 raft_consensus.cc:493] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.554286 10789 raft_consensus.cc:515] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.555943 10555 raft_consensus.cc:2468] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:10.556490 10789 leader_election.cc:290] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.543907 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c771f43203d841dd8d4f4e999b6d360e" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:10.558354 10476 raft_consensus.cc:3060] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.562873 10753 raft_consensus.cc:359] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.567013 10703 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.545732 10898 leader_election.cc:290] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.581967 10841 raft_consensus.cc:493] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.582564 10841 raft_consensus.cc:515] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.584657 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.586236 10841 leader_election.cc:290] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
W20260709 12:23:10.586346 10594 leader_election.cc:343] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.587150 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.587512 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.587908 10554 raft_consensus.cc:2468] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
W20260709 12:23:10.589522 10519 leader_election.cc:343] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.590485 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:10.591130 10627 raft_consensus.cc:2468] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:10.591847 10752 tablet_bootstrap.cc:492] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.592108 10750 ts_tablet_manager.cc:1434] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 12:23:10.592453 10752 ts_tablet_manager.cc:1403] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.019s
I20260709 12:23:10.593719 10595 leader_election.cc:304] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.594796 10936 raft_consensus.cc:2804] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.595388 10936 raft_consensus.cc:493] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.595510 10520 leader_election.cc:304] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.594480 10750 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:10.595841 10936 raft_consensus.cc:3060] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.596246 10752 raft_consensus.cc:359] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.597045 10752 raft_consensus.cc:385] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.597338 10752 raft_consensus.cc:740] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.597651 10841 raft_consensus.cc:2804] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.598093 10841 raft_consensus.cc:493] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.598626 10841 raft_consensus.cc:3060] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.598068 10752 consensus_queue.cc:260] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.601150 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c771f43203d841dd8d4f4e999b6d360e" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:10.601853 10555 raft_consensus.cc:3060] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.602516 10669 leader_election.cc:304] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
W20260709 12:23:10.603736 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 46293.7us
I20260709 12:23:10.604818 10880 raft_consensus.cc:2804] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.605405 10880 raft_consensus.cc:697] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:10.607084 10880 consensus_queue.cc:237] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.564059 10753 raft_consensus.cc:385] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.610373 10753 raft_consensus.cc:740] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.620695 10936 raft_consensus.cc:515] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.626514 10936 leader_election.cc:290] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.627368 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:10.627619 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:10.618947 10476 raft_consensus.cc:2468] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:10.636431 10753 consensus_queue.cc:260] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:10.637030 10594 leader_election.cc:343] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.644935 10752 ts_tablet_manager.cc:1434] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.052s	user 0.018s	sys 0.014s
I20260709 12:23:10.646884 10752 tablet_bootstrap.cc:492] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.649693 10936 raft_consensus.cc:493] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.650293 10936 raft_consensus.cc:515] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.652801 10936 leader_election.cc:290] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.654763 10752 tablet_bootstrap.cc:654] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.656644 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99999f0404c846758d5ec30143015bc4" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.660329 10592 leader_election.cc:304] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:10.661298 10936 raft_consensus.cc:2804] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:10.661831 10595 leader_election.cc:343] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.663733 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99999f0404c846758d5ec30143015bc4" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.662089 10936 raft_consensus.cc:697] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
W20260709 12:23:10.665269 10594 leader_election.cc:343] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.665802 10594 leader_election.cc:304] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.666944 10898 raft_consensus.cc:2749] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.666124 10936 consensus_queue.cc:237] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.670305 10749 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:10.670820 10749 ts_tablet_manager.cc:1403] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.029s
I20260709 12:23:10.674106 10750 tablet_bootstrap.cc:654] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.673981 10749 raft_consensus.cc:359] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.674672 10749 raft_consensus.cc:385] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.675137 10749 raft_consensus.cc:740] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.675961 10749 consensus_queue.cc:260] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.678395 10555 raft_consensus.cc:2468] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:10.692404 10753 ts_tablet_manager.cc:1434] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.184s	user 0.011s	sys 0.000s
W20260709 12:23:10.694514 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.695281 10814 consensus_queue.cc:1048] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.699975 10749 ts_tablet_manager.cc:1434] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 12:23:10.708992 10905 consensus_queue.cc:1048] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:10.716579 10476 raft_consensus.cc:3060] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.721508 10905 consensus_queue.cc:1048] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.721211 10841 raft_consensus.cc:515] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.726428 10749 tablet_bootstrap.cc:492] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:10.730191 10753 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:10.732237 10554 raft_consensus.cc:2393] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5703388aa4f747c280bf93e578f6bad7 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:10.738111 10752 tablet_bootstrap.cc:492] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.740926 10371 catalog_manager.cc:5697] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.742415 10847 consensus_queue.cc:1048] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.744035 10752 ts_tablet_manager.cc:1403] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.009s
I20260709 12:23:10.744433 10753 tablet_bootstrap.cc:654] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.743358 10376 catalog_manager.cc:5697] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.762002 10752 raft_consensus.cc:359] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.762818 10752 raft_consensus.cc:385] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.763139 10752 raft_consensus.cc:740] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.765986 10752 consensus_queue.cc:260] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.773701 10847 consensus_queue.cc:1048] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.778332 10752 ts_tablet_manager.cc:1434] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:23:10.779459 10595 leader_election.cc:304] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.780936 10898 raft_consensus.cc:2749] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.786054 10752 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.787482 10847 consensus_queue.cc:1048] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.791563 10750 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.792203 10750 ts_tablet_manager.cc:1403] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.001s
I20260709 12:23:10.796094 10750 raft_consensus.cc:359] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.796907 10750 raft_consensus.cc:385] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.797221 10750 raft_consensus.cc:740] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.800436 10749 tablet_bootstrap.cc:654] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.802353 10750 consensus_queue.cc:260] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.817382 10750 ts_tablet_manager.cc:1434] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 12:23:10.821832 10841 leader_election.cc:290] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.823325 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:10.824046 10701 raft_consensus.cc:3060] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.829708 10752 tablet_bootstrap.cc:654] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.837435 10701 raft_consensus.cc:2468] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:10.838979 10519 leader_election.cc:304] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:10.840117 10841 raft_consensus.cc:2804] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.840721 10841 raft_consensus.cc:697] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:10.841590 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8577a637ba643f8a4061e59fe155f9f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:10.842432 10628 raft_consensus.cc:2393] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da3f34a85954a319ed87fd378e5e661 in current term 1: Already voted for candidate 5703388aa4f747c280bf93e578f6bad7 in this term.
I20260709 12:23:10.842273 10755 consensus_queue.cc:1048] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.849084 10376 catalog_manager.cc:5697] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.859375 10940 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.859810 10905 consensus_queue.cc:1048] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:10.859944 10940 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.861231 10841 consensus_queue.cc:237] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.863441 10898 raft_consensus.cc:493] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.863953 10898 raft_consensus.cc:515] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:10.868539 10750 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:10.876415 10814 raft_consensus.cc:493] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.877072 10814 raft_consensus.cc:515] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.879217 10814 leader_election.cc:290] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:10.881691 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.885167 10789 raft_consensus.cc:493] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.885730 10789 raft_consensus.cc:515] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.892263 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.893795 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:10.899487 10940 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.911608 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:10.912500 10595 leader_election.cc:343] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.916754 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:10.916877 10445 leader_election.cc:304] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.925264 10789 leader_election.cc:290] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:10.932436 10898 leader_election.cc:290] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.933789 10669 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:10.935225 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:10.938629 10592 leader_election.cc:343] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.938633 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.939705 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.941629 10752 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:10.942152 10752 ts_tablet_manager.cc:1403] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.156s	user 0.017s	sys 0.011s
I20260709 12:23:10.943506 10750 tablet_bootstrap.cc:654] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:10.948271 10594 leader_election.cc:343] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.948871 10594 leader_election.cc:304] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
W20260709 12:23:10.951161 10594 leader_election.cc:343] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.951740 10594 leader_election.cc:304] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:10.952028 10936 raft_consensus.cc:2749] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.954607 10789 raft_consensus.cc:2749] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.955389 10935 consensus_queue.cc:1048] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:10.962764 10752 raft_consensus.cc:359] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.972154 10752 raft_consensus.cc:385] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.964314 10753 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:10.972470 10752 raft_consensus.cc:740] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.972894 10753 ts_tablet_manager.cc:1403] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.247s	user 0.025s	sys 0.027s
I20260709 12:23:10.973356 10752 consensus_queue.cc:260] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.975072 10905 raft_consensus.cc:2749] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:10.975616 10752 ts_tablet_manager.cc:1434] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:23:10.976217 10753 raft_consensus.cc:359] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.977057 10753 raft_consensus.cc:385] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.977398 10753 raft_consensus.cc:740] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.978276 10753 consensus_queue.cc:260] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.980628 10753 ts_tablet_manager.cc:1434] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:10.976680 10752 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:10.986897 10753 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:10.985677 10886 raft_consensus.cc:493] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.990209 10886 raft_consensus.cc:515] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:10.993793 10940 raft_consensus.cc:493] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.994632 10749 tablet_bootstrap.cc:492] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:10.994315 10940 raft_consensus.cc:515] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:10.995213 10750 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:10.995864 10750 ts_tablet_manager.cc:1403] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.145s	user 0.013s	sys 0.002s
I20260709 12:23:10.996426 10940 leader_election.cc:290] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:10.997799 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d6d3887b1d47638ed56acc7074311b" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:10.998492 10701 raft_consensus.cc:2468] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:10.998610 10750 raft_consensus.cc:359] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:10.995152 10886 leader_election.cc:290] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:10.999445 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5986a6cceb0d4ee4ba760b56e3a47fab" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.000384 10519 leader_election.cc:304] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.000834 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5986a6cceb0d4ee4ba760b56e3a47fab" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.001514 10625 raft_consensus.cc:2468] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.003087 10750 raft_consensus.cc:385] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.006412 10669 leader_election.cc:304] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.004070 10750 raft_consensus.cc:740] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.004267 10749 ts_tablet_manager.cc:1403] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.025s
I20260709 12:23:11.007560 10935 raft_consensus.cc:2804] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.008623 10750 consensus_queue.cc:260] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.001509 10755 raft_consensus.cc:2804] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:11.007655 10669 leader_election.cc:343] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.019487 10750 ts_tablet_manager.cc:1434] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:23:11.017958 10839 raft_consensus.cc:2749] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:11.014215 10935 raft_consensus.cc:493] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.027774 10935 raft_consensus.cc:3060] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.017879 10755 raft_consensus.cc:493] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.029145 10755 raft_consensus.cc:3060] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.030280 10753 tablet_bootstrap.cc:654] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:11.035478 10666 consensus_peers.cc:597] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.018805 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d6d3887b1d47638ed56acc7074311b" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.037278 10477 raft_consensus.cc:2468] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:11.038218 10957 raft_consensus.cc:493] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.038869 10957 raft_consensus.cc:515] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.041502 10957 leader_election.cc:290] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:11.042585 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.043063 10880 consensus_queue.cc:1048] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:11.044377 10592 leader_election.cc:343] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.049821 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:11.052076 10595 leader_election.cc:343] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.052640 10595 leader_election.cc:304] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.053864 10935 raft_consensus.cc:515] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.058984 10935 leader_election.cc:290] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.056720 10957 raft_consensus.cc:2749] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.065984 10752 tablet_bootstrap.cc:654] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.072767 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5986a6cceb0d4ee4ba760b56e3a47fab" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.079442 10626 raft_consensus.cc:3060] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.080686 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5986a6cceb0d4ee4ba760b56e3a47fab" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:11.082974 10371 catalog_manager.cc:5697] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:11.084740 10666 consensus_peers.cc:597] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.094470 10626 raft_consensus.cc:2468] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:11.078871 10750 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.075860 10749 raft_consensus.cc:359] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.099946 10749 raft_consensus.cc:385] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.099974 10957 consensus_queue.cc:1048] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.105228 10749 raft_consensus.cc:740] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.106225 10749 consensus_queue.cc:260] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.107246 10555 raft_consensus.cc:3060] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.103165 10755 raft_consensus.cc:515] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.125034 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d6d3887b1d47638ed56acc7074311b" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:11.125909 10703 raft_consensus.cc:3060] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.104770 10750 tablet_bootstrap.cc:654] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.132097 10555 raft_consensus.cc:2468] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:11.134406 10669 leader_election.cc:304] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.138386 10935 raft_consensus.cc:2804] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.139017 10935 raft_consensus.cc:697] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:11.140219 10935 consensus_queue.cc:237] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.144524 10749 ts_tablet_manager.cc:1434] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.003s
I20260709 12:23:11.146169 10749 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.136227 10703 raft_consensus.cc:2468] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:11.149646 10519 leader_election.cc:304] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.150363 10750 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.150571 10841 raft_consensus.cc:2804] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.151119 10841 raft_consensus.cc:697] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:11.150944 10750 ts_tablet_manager.cc:1403] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 12:23:11.152395 10841 consensus_queue.cc:237] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.158553 10750 raft_consensus.cc:359] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.159554 10750 raft_consensus.cc:385] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.159896 10750 raft_consensus.cc:740] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.161055 10749 tablet_bootstrap.cc:654] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.162420 10752 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.163039 10752 ts_tablet_manager.cc:1403] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.010s
I20260709 12:23:11.163352 10750 consensus_queue.cc:260] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.165607 10750 ts_tablet_manager.cc:1434] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:11.166630 10752 raft_consensus.cc:359] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.167428 10752 raft_consensus.cc:385] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.167753 10752 raft_consensus.cc:740] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.168489 10752 consensus_queue.cc:260] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.170897 10750 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.171223 10752 ts_tablet_manager.cc:1434] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:23:11.173916 10752 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:11.171161 10958 consensus_queue.cc:1048] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:11.180719 10752 tablet_bootstrap.cc:654] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.195709 10749 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:11.196378 10749 ts_tablet_manager.cc:1403] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.006s
I20260709 12:23:11.200017 10749 raft_consensus.cc:359] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.200939 10749 raft_consensus.cc:385] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.201293 10749 raft_consensus.cc:740] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.203749 10749 consensus_queue.cc:260] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.204943 10752 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.205540 10752 ts_tablet_manager.cc:1403] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:23:11.205767 10755 leader_election.cc:290] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.207067 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d6d3887b1d47638ed56acc7074311b" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:11.207821 10478 raft_consensus.cc:3060] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.208963 10752 raft_consensus.cc:359] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.209692 10752 raft_consensus.cc:385] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.210031 10752 raft_consensus.cc:740] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.210986 10752 consensus_queue.cc:260] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.213497 10752 ts_tablet_manager.cc:1434] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:11.214646 10752 tablet_bootstrap.cc:492] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:11.215893 10478 raft_consensus.cc:2468] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:11.220635 10753 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:11.221312 10753 ts_tablet_manager.cc:1403] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.235s	user 0.059s	sys 0.060s
I20260709 12:23:11.224493 10753 raft_consensus.cc:359] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.225590 10753 raft_consensus.cc:385] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.226060 10753 raft_consensus.cc:740] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.227238 10753 consensus_queue.cc:260] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.230108 10749 ts_tablet_manager.cc:1434] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 12:23:11.230881 10750 tablet_bootstrap.cc:654] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.231276 10749 tablet_bootstrap.cc:492] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.231658 10752 tablet_bootstrap.cc:654] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.234472 10753 ts_tablet_manager.cc:1434] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:23:11.235626 10753 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:11.239835 10749 tablet_bootstrap.cc:654] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.242205 10753 tablet_bootstrap.cc:654] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.253363 10749 tablet_bootstrap.cc:492] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:11.254007 10749 ts_tablet_manager.cc:1403] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 12:23:11.257529 10753 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:11.257800 10749 raft_consensus.cc:359] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.258847 10749 raft_consensus.cc:385] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.259223 10749 raft_consensus.cc:740] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.258131 10753 ts_tablet_manager.cc:1403] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 12:23:11.260480 10749 consensus_queue.cc:260] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.263473 10749 ts_tablet_manager.cc:1434] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:23:11.265918 10753 raft_consensus.cc:359] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.266724 10753 raft_consensus.cc:385] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.267143 10753 raft_consensus.cc:740] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.267918 10753 consensus_queue.cc:260] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.265213 10749 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.273865 10753 ts_tablet_manager.cc:1434] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:23:11.274984 10753 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:11.282828 10749 tablet_bootstrap.cc:654] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.282939 10936 raft_consensus.cc:493] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.283540 10936 raft_consensus.cc:515] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.288085 10753 tablet_bootstrap.cc:654] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.288630 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b394c6b2e7544aa890058148e0ac514" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.288812 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b394c6b2e7544aa890058148e0ac514" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.289390 10703 raft_consensus.cc:2468] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:11.291528 10594 leader_election.cc:304] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
W20260709 12:23:11.292220 10592 leader_election.cc:343] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.292325 10957 raft_consensus.cc:2804] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.292876 10936 leader_election.cc:290] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.293418 10957 raft_consensus.cc:493] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.297369 10957 raft_consensus.cc:3060] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.302732 10750 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.303457 10750 ts_tablet_manager.cc:1403] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.133s	user 0.027s	sys 0.012s
I20260709 12:23:11.306964 10750 raft_consensus.cc:359] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.307919 10750 raft_consensus.cc:385] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.308266 10750 raft_consensus.cc:740] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.309245 10750 consensus_queue.cc:260] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.310537 10814 raft_consensus.cc:493] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.311089 10814 raft_consensus.cc:515] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.312789 10750 ts_tablet_manager.cc:1434] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:11.313321 10814 leader_election.cc:290] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:11.315280 10753 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:11.315057 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.316438 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.316763 10750 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.317749 10957 raft_consensus.cc:515] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.319823 10752 tablet_bootstrap.cc:492] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.320297 10445 leader_election.cc:304] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:11.320566 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b394c6b2e7544aa890058148e0ac514" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:11.321213 10703 raft_consensus.cc:3060] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.321223 10814 raft_consensus.cc:2749] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.320334 10752 ts_tablet_manager.cc:1403] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.106s	user 0.043s	sys 0.015s
I20260709 12:23:11.323668 10750 tablet_bootstrap.cc:654] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.325583 10752 raft_consensus.cc:359] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.326296 10752 raft_consensus.cc:385] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.326494 10753 ts_tablet_manager.cc:1403] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.003s
I20260709 12:23:11.326664 10752 raft_consensus.cc:740] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.327576 10752 consensus_queue.cc:260] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.328714 10703 raft_consensus.cc:2468] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:11.329384 10753 raft_consensus.cc:359] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.330154 10753 raft_consensus.cc:385] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.330013 10594 leader_election.cc:304] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.330633 10753 raft_consensus.cc:740] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.331422 10936 raft_consensus.cc:2804] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.331979 10936 raft_consensus.cc:697] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:11.333379 10752 ts_tablet_manager.cc:1434] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 12:23:11.332933 10936 consensus_queue.cc:237] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.334472 10752 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:11.331539 10753 consensus_queue.cc:260] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.340276 10750 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.315758 10372 catalog_manager.cc:5697] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.340914 10753 ts_tablet_manager.cc:1434] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:11.341369 10750 ts_tablet_manager.cc:1403] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 12:23:11.342418 10753 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:11.343312 10752 tablet_bootstrap.cc:654] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.348346 10750 raft_consensus.cc:359] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.349280 10750 raft_consensus.cc:385] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.349700 10750 raft_consensus.cc:740] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.350571 10750 consensus_queue.cc:260] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.351483 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b394c6b2e7544aa890058148e0ac514" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
W20260709 12:23:11.353160 10592 leader_election.cc:343] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.351101 10753 tablet_bootstrap.cc:654] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.340714 10749 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:11.354238 10749 ts_tablet_manager.cc:1403] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.004s
I20260709 12:23:11.354854 10750 ts_tablet_manager.cc:1434] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:23:11.357525 10749 raft_consensus.cc:359] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.358338 10749 raft_consensus.cc:385] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.358389 10750 tablet_bootstrap.cc:492] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.358727 10749 raft_consensus.cc:740] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.359966 10957 leader_election.cc:290] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.366142 10749 consensus_queue.cc:260] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.372164 10750 tablet_bootstrap.cc:654] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.373450 10749 ts_tablet_manager.cc:1434] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:23:11.376322 10749 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.379829 10935 raft_consensus.cc:493] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.380645 10935 raft_consensus.cc:515] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.383877 10749 tablet_bootstrap.cc:654] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.387167 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99999f0404c846758d5ec30143015bc4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.388222 10553 raft_consensus.cc:2468] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.389763 10814 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.390365 10814 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.391471 10750 tablet_bootstrap.cc:492] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.392112 10750 ts_tablet_manager.cc:1403] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.005s
I20260709 12:23:11.392721 10814 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.398579 10841 raft_consensus.cc:493] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.399420 10841 raft_consensus.cc:515] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.400341 10750 raft_consensus.cc:359] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.401307 10750 raft_consensus.cc:385] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.401654 10750 raft_consensus.cc:740] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.405481 10750 consensus_queue.cc:260] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.408636 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.409569 10750 ts_tablet_manager.cc:1434] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:23:11.409444 10553 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:11.411185 10445 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:11.412617 10905 raft_consensus.cc:2804] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.413026 10905 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.413411 10905 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.416729 10669 leader_election.cc:304] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.417799 10839 raft_consensus.cc:2804] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.418217 10839 raft_consensus.cc:493] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.418588 10839 raft_consensus.cc:3060] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.421978 10905 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.424898 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.425323 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:11.425980 10553 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:11.426755 10517 leader_election.cc:343] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.427832 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:11.429418 10519 leader_election.cc:343] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.429922 10519 leader_election.cc:304] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:11.430744 10936 raft_consensus.cc:493] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.431734 10886 raft_consensus.cc:2749] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.431516 10936 raft_consensus.cc:515] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.435642 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.436609 10935 leader_election.cc:290] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.409333 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
W20260709 12:23:11.437700 10594 leader_election.cc:343] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.438242 10626 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:11.439069 10841 leader_election.cc:290] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.439404 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99999f0404c846758d5ec30143015bc4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.440029 10629 raft_consensus.cc:2468] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.441828 10886 consensus_queue.cc:1048] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.442942 10935 raft_consensus.cc:493] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.443512 10935 raft_consensus.cc:515] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.444250 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.445030 10839 raft_consensus.cc:515] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:11.446255 10592 leader_election.cc:343] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.446798 10592 leader_election.cc:304] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:11.447791 10957 raft_consensus.cc:2749] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.451079 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99999f0404c846758d5ec30143015bc4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:11.442266 10936 leader_election.cc:290] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.451901 10552 raft_consensus.cc:3060] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.475095 10841 consensus_queue.cc:1048] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.454154 10839 leader_election.cc:290] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.411172 10750 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.459952 10477 raft_consensus.cc:3060] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.455595 10376 catalog_manager.cc:5697] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.479940 10552 raft_consensus.cc:2468] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:11.481407 10669 leader_election.cc:304] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.482380 10839 raft_consensus.cc:2804] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.482898 10839 raft_consensus.cc:697] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:11.484277 10750 tablet_bootstrap.cc:654] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.484642 10839 consensus_queue.cc:237] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.451231 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:11.488435 10666 leader_election.cc:343] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.461337 10753 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:11.490167 10373 catalog_manager.cc:5697] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.462241 10752 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.493068 10752 ts_tablet_manager.cc:1403] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.039s
I20260709 12:23:11.492588 10753 ts_tablet_manager.cc:1403] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.151s	user 0.039s	sys 0.036s
I20260709 12:23:11.496461 10752 raft_consensus.cc:359] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.470216 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.502843 10752 raft_consensus.cc:385] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.503006 10629 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.503229 10752 raft_consensus.cc:740] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.452975 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.504518 10626 raft_consensus.cc:2468] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.462410 10935 leader_election.cc:290] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.501935 10750 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.506517 10750 ts_tablet_manager.cc:1403] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.017s
I20260709 12:23:11.470657 10905 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.508996 10669 leader_election.cc:304] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.509367 10750 raft_consensus.cc:359] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.464588 10749 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:11.510658 10749 ts_tablet_manager.cc:1403] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.135s	user 0.012s	sys 0.029s
I20260709 12:23:11.515676 10839 raft_consensus.cc:2804] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.516134 10839 raft_consensus.cc:493] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.516502 10839 raft_consensus.cc:3060] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.526615 10839 raft_consensus.cc:515] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.531181 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:11.531373 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.532282 10626 raft_consensus.cc:3060] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:11.532621 10666 leader_election.cc:343] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.533813 10839 leader_election.cc:290] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.540670 10749 raft_consensus.cc:359] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.541482 10749 raft_consensus.cc:385] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.541755 10749 raft_consensus.cc:740] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.542464 10749 consensus_queue.cc:260] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.463721 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99999f0404c846758d5ec30143015bc4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.543984 10625 raft_consensus.cc:3060] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.546530 10376 catalog_manager.cc:5697] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.555200 10940 consensus_queue.cc:1048] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.556057 10749 ts_tablet_manager.cc:1434] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:23:11.557127 10749 tablet_bootstrap.cc:492] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.559840 10477 raft_consensus.cc:3060] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.574002 10936 raft_consensus.cc:493] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.574651 10936 raft_consensus.cc:515] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.576344 10629 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:11.501911 10553 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:11.504093 10752 consensus_queue.cc:260] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.577704 10445 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:11.577831 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.578519 10814 raft_consensus.cc:2804] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.579015 10814 raft_consensus.cc:697] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:11.510090 10750 raft_consensus.cc:385] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.579512 10750 raft_consensus.cc:740] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.579953 10814 consensus_queue.cc:237] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.580221 10750 consensus_queue.cc:260] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.581791 10839 consensus_queue.cc:1048] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:11.582229 10594 leader_election.cc:343] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.582520 10750 ts_tablet_manager.cc:1434] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.000s
I20260709 12:23:11.496918 10753 raft_consensus.cc:359] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.583225 10753 raft_consensus.cc:385] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.583636 10753 raft_consensus.cc:740] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.579144 10752 ts_tablet_manager.cc:1434] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 12:23:11.584302 10753 consensus_queue.cc:260] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.585255 10750 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.586434 10753 ts_tablet_manager.cc:1434] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.000s
I20260709 12:23:11.584756 10752 tablet_bootstrap.cc:492] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:11.594700 10936 leader_election.cc:290] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.596060 10753 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:11.596347 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:11.598495 10592 leader_election.cc:343] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.598693 10750 tablet_bootstrap.cc:654] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.598975 10592 leader_election.cc:304] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:11.600235 10789 raft_consensus.cc:2749] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.600795 10625 raft_consensus.cc:2468] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:11.602944 10753 tablet_bootstrap.cc:654] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.609742 10752 tablet_bootstrap.cc:654] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.612916 10749 tablet_bootstrap.cc:654] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.621296 10755 consensus_queue.cc:1048] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.621917 10752 tablet_bootstrap.cc:492] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.622740 10752 ts_tablet_manager.cc:1403] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.001s
I20260709 12:23:11.626801 10749 tablet_bootstrap.cc:492] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:11.626619 10752 raft_consensus.cc:359] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.627565 10749 ts_tablet_manager.cc:1403] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.001s
I20260709 12:23:11.627779 10752 raft_consensus.cc:385] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.628217 10752 raft_consensus.cc:740] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.628437 10626 raft_consensus.cc:2468] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:11.629179 10752 consensus_queue.cc:260] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.629899 10669 leader_election.cc:304] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.631098 10935 raft_consensus.cc:2804] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.631585 10935 raft_consensus.cc:697] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:11.632295 10750 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.632849 10750 ts_tablet_manager.cc:1403] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:23:11.632447 10935 consensus_queue.cc:237] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.632637 10749 raft_consensus.cc:359] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.633603 10749 raft_consensus.cc:385] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.633891 10749 raft_consensus.cc:740] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.637073 10749 consensus_queue.cc:260] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.637712 10752 ts_tablet_manager.cc:1434] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:23:11.638736 10752 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:11.639786 10372 catalog_manager.cc:5697] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.642395 10749 ts_tablet_manager.cc:1434] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:11.643759 10749 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.644871 10752 tablet_bootstrap.cc:654] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.651750 10830 consensus_queue.cc:1048] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.653177 10749 tablet_bootstrap.cc:654] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.661263 10752 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.661329 10755 raft_consensus.cc:493] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.661788 10752 ts_tablet_manager.cc:1403] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 12:23:11.662153 10755 raft_consensus.cc:515] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.666128 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.662817 10753 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:11.667047 10625 raft_consensus.cc:2468] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:11.667165 10753 ts_tablet_manager.cc:1403] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.011s
I20260709 12:23:11.667616 10752 raft_consensus.cc:359] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.668370 10752 raft_consensus.cc:385] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.668637 10752 raft_consensus.cc:740] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.669016 10520 leader_election.cc:304] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:11.669292 10752 consensus_queue.cc:260] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.670136 10750 raft_consensus.cc:359] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.671651 10841 raft_consensus.cc:2804] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.677380 10750 raft_consensus.cc:385] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.677567 10841 raft_consensus.cc:493] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.677739 10750 raft_consensus.cc:740] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.678220 10841 raft_consensus.cc:3060] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.678700 10750 consensus_queue.cc:260] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.680487 10755 leader_election.cc:290] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:11.681448 10750 ts_tablet_manager.cc:1434] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:23:11.682737 10935 raft_consensus.cc:493] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.683873 10750 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.683866 10935 raft_consensus.cc:515] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.674669 10839 raft_consensus.cc:493] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.694916 10839 raft_consensus.cc:515] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.697047 10839 leader_election.cc:290] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.703961 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.703951 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.705360 10625 raft_consensus.cc:2468] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.706579 10669 leader_election.cc:304] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:11.707448 10839 raft_consensus.cc:2804] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.707818 10839 raft_consensus.cc:493] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.708137 10839 raft_consensus.cc:3060] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.708977 10376 catalog_manager.cc:5697] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.711580 10940 raft_consensus.cc:493] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.712127 10940 raft_consensus.cc:515] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.672596 10753 raft_consensus.cc:359] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.676699 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.713872 10753 raft_consensus.cc:385] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.714246 10940 leader_election.cc:290] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:11.716059 10753 raft_consensus.cc:740] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.716302 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.715016 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.717689 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.720487 10936 raft_consensus.cc:493] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.721441 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.722044 10839 raft_consensus.cc:515] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.731631 10702 raft_consensus.cc:2393] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2da3f34a85954a319ed87fd378e5e661 in current term 1: Already voted for candidate becf98b94b704731a507d96d1a44737c in this term.
I20260709 12:23:11.728880 10753 consensus_queue.cc:260] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.732671 10839 leader_election.cc:290] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.690743 10750 tablet_bootstrap.cc:654] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.728224 10841 raft_consensus.cc:515] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:11.729935 10666 leader_election.cc:343] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.734306 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
W20260709 12:23:11.734587 10666 leader_election.cc:343] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.736161 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.736786 10629 raft_consensus.cc:3060] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.737043 10753 ts_tablet_manager.cc:1434] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.002s
I20260709 12:23:11.738052 10753 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:11.739080 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.740406 10553 raft_consensus.cc:2393] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate becf98b94b704731a507d96d1a44737c in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:11.741904 10841 leader_election.cc:290] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:11.742233 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c174a58645b464782b247e7837bb5ff" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:11.743218 10702 raft_consensus.cc:2393] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da3f34a85954a319ed87fd378e5e661 in current term 1: Already voted for candidate becf98b94b704731a507d96d1a44737c in this term.
I20260709 12:23:11.744295 10669 leader_election.cc:304] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:11.745185 10839 raft_consensus.cc:2749] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.747762 10753 tablet_bootstrap.cc:654] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.749181 10629 raft_consensus.cc:2468] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:11.730406 10552 raft_consensus.cc:2468] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.730957 10626 raft_consensus.cc:2468] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:11.730659 10936 raft_consensus.cc:515] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.753930 10936 leader_election.cc:290] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:11.755272 10669 leader_election.cc:304] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.755589 10520 leader_election.cc:304] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: becf98b94b704731a507d96d1a44737c
I20260709 12:23:11.756429 10669 leader_election.cc:304] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.757062 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc42f485018420e94dafb287e1f73b5" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.757553 10940 raft_consensus.cc:2804] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.758117 10940 raft_consensus.cc:493] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.758546 10940 raft_consensus.cc:3060] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.759104 10841 raft_consensus.cc:2804] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.759915 10841 raft_consensus.cc:697] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:11.760877 10841 consensus_queue.cc:237] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:11.763530 10814 raft_consensus.cc:493] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.764374 10814 raft_consensus.cc:515] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.765467 10839 raft_consensus.cc:2804] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.766287 10839 raft_consensus.cc:493] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.767102 10839 raft_consensus.cc:3060] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.767503 10905 raft_consensus.cc:493] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.768265 10905 raft_consensus.cc:515] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.769955 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc42f485018420e94dafb287e1f73b5" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.775239 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.775993 10626 raft_consensus.cc:2468] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:11.776382 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.777345 10445 leader_election.cc:304] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:11.777722 10814 leader_election.cc:290] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:11.729971 10935 leader_election.cc:290] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:11.778561 10814 raft_consensus.cc:2804] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.779142 10814 raft_consensus.cc:493] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.676501 10752 ts_tablet_manager.cc:1434] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:23:11.777431 10552 raft_consensus.cc:2468] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:11.819217 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:11.758778 10595 leader_election.cc:343] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:11.821390 10594 leader_election.cc:343] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.823100 10750 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.823803 10750 ts_tablet_manager.cc:1403] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.141s	user 0.026s	sys 0.023s
I20260709 12:23:11.813616 10940 raft_consensus.cc:515] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.790436 10905 leader_election.cc:290] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:11.798012 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.812165 10752 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:11.808509 10814 raft_consensus.cc:3060] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.825802 10594 leader_election.cc:304] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
W20260709 12:23:11.834060 10594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 62192.2us
I20260709 12:23:11.834275 10936 raft_consensus.cc:2749] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.826975 10750 raft_consensus.cc:359] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:11.781215 10592 consensus_peers.cc:597] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:11.837424 10592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 56330.2us
I20260709 12:23:11.838277 10936 raft_consensus.cc:493] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.838796 10936 raft_consensus.cc:515] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.841894 10750 raft_consensus.cc:385] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.841959 10789 consensus_queue.cc:1048] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.842447 10750 raft_consensus.cc:740] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.844408 10750 consensus_queue.cc:260] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.853334 10749 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:11.853951 10749 ts_tablet_manager.cc:1403] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.211s	user 0.046s	sys 0.062s
W20260709 12:23:11.854796 10595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 96050.4us
I20260709 12:23:11.856086 10789 raft_consensus.cc:493] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.856525 10839 raft_consensus.cc:515] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.856922 10749 raft_consensus.cc:359] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.857836 10749 raft_consensus.cc:385] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.858124 10749 raft_consensus.cc:740] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.860406 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:11.856576 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:11.864902 10626 raft_consensus.cc:3060] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.866966 10936 leader_election.cc:290] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:11.867218 11003 raft_consensus.cc:493] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.878398 11003 raft_consensus.cc:515] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.873871 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab2d2836c0834b29a9007f5c0c4469fe" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:11.873765 10444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 61306.1us
I20260709 12:23:11.869963 10940 leader_election.cc:290] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:11.861722 10666 leader_election.cc:343] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.882056 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab2d2836c0834b29a9007f5c0c4469fe" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.883117 10814 raft_consensus.cc:515] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.884315 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
W20260709 12:23:11.923143 10666 leader_election.cc:343] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.898923 10750 ts_tablet_manager.cc:1434] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:23:11.884608 10444 leader_election.cc:304] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
W20260709 12:23:11.924785 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:11.925005 10750 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:11.926064 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:11.923004 10839 leader_election.cc:290] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:11.926064 11004 raft_consensus.cc:2749] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.856557 10789 raft_consensus.cc:515] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.930940 10789 leader_election.cc:290] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:11.926452 10371 catalog_manager.cc:5697] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.932238 10750 tablet_bootstrap.cc:654] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.932626 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:11.896490 11003 leader_election.cc:290] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
W20260709 12:23:11.934741 10595 leader_election.cc:343] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:11.882120 10592 leader_election.cc:343] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:11.894413 10753 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:11.936211 10753 ts_tablet_manager.cc:1403] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.198s	user 0.010s	sys 0.007s
I20260709 12:23:11.940052 10753 raft_consensus.cc:359] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.869318 10752 tablet_bootstrap.cc:654] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:11.945986 10592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 63911.8us
I20260709 12:23:11.904703 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:11.858830 10749 consensus_queue.cc:260] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:11.888019 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff41525191314521b655a8d37cb1a242" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:11.947382 10552 raft_consensus.cc:2468] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:11.948088 10629 raft_consensus.cc:2393] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate becf98b94b704731a507d96d1a44737c in this term.
I20260709 12:23:11.949445 10553 raft_consensus.cc:3060] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.952477 10749 ts_tablet_manager.cc:1434] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.003s
I20260709 12:23:11.953897 10749 tablet_bootstrap.cc:492] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:11.956284 10595 leader_election.cc:304] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.966301 10750 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:11.966899 10750 ts_tablet_manager.cc:1403] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.008s
I20260709 12:23:11.966444 10839 consensus_queue.cc:1048] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.895939 10626 raft_consensus.cc:2468] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:11.974063 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:11.974610 10669 leader_election.cc:304] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:11.976432 10789 raft_consensus.cc:2804] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.976894 10789 raft_consensus.cc:493] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.977185 10752 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:11.977219 10789 raft_consensus.cc:3060] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.977679 10839 raft_consensus.cc:2804] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.977875 10752 ts_tablet_manager.cc:1403] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.009s
I20260709 12:23:11.995785 10752 raft_consensus.cc:359] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:11.996498 10752 raft_consensus.cc:385] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.996771 10752 raft_consensus.cc:740] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.997408 10752 consensus_queue.cc:260] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.001235 10752 ts_tablet_manager.cc:1434] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:12.002249 10752 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.005887 11004 consensus_queue.cc:1048] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.978792 10839 raft_consensus.cc:697] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:12.008375 10752 tablet_bootstrap.cc:654] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.008229 10839 consensus_queue.cc:237] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:11.981135 10753 raft_consensus.cc:385] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.033413 10753 raft_consensus.cc:740] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.985888 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:11.988598 10750 raft_consensus.cc:359] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.034417 10753 consensus_queue.cc:260] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.034597 10750 raft_consensus.cc:385] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.083765 10750 raft_consensus.cc:740] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
W20260709 12:23:12.040390 10592 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.3.7.190:35777, user_credentials={real_user=slave}} blocked reactor thread for 50765.1us
I20260709 12:23:12.084780 10750 consensus_queue.cc:260] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
W20260709 12:23:12.087035 10985 log.cc:927] Time spent T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: Append to log took a long time: real 0.059s	user 0.007s	sys 0.010s
I20260709 12:23:12.088457 10752 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.088944 10752 ts_tablet_manager.cc:1403] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.004s
I20260709 12:23:12.088996 10753 ts_tablet_manager.cc:1434] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.152s	user 0.009s	sys 0.004s
I20260709 12:23:12.076112 10749 tablet_bootstrap.cc:654] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.034404 10551 raft_consensus.cc:3060] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.091804 10752 raft_consensus.cc:359] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.092516 10752 raft_consensus.cc:385] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.092775 10752 raft_consensus.cc:740] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.093425 10752 consensus_queue.cc:260] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.094305 10753 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:12.096035 10752 ts_tablet_manager.cc:1434] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:12.097165 10752 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.103994 10752 tablet_bootstrap.cc:654] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.107448 10814 leader_election.cc:290] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:12.109303 10753 tablet_bootstrap.cc:654] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.116252 10750 ts_tablet_manager.cc:1434] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.149s	user 0.012s	sys 0.004s
I20260709 12:23:12.080727 10477 raft_consensus.cc:3060] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.124119 10752 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.124706 10752 ts_tablet_manager.cc:1403] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.007s
I20260709 12:23:12.127650 10752 raft_consensus.cc:359] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.128644 10752 raft_consensus.cc:385] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.129133 10752 raft_consensus.cc:740] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.132794 10750 tablet_bootstrap.cc:492] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:12.129905 10752 consensus_queue.cc:260] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.037529 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:12.120664 10814 consensus_queue.cc:1048] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:23:12.145934 10551 raft_consensus.cc:2468] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
W20260709 12:23:12.148658 10592 leader_election.cc:343] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.149230 10592 leader_election.cc:304] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.150058 10752 ts_tablet_manager.cc:1434] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:23:12.133524 10940 consensus_queue.cc:1048] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:12.139705 10626 raft_consensus.cc:3060] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.129664 10789 raft_consensus.cc:515] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.157289 10752 tablet_bootstrap.cc:492] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.162067 11007 raft_consensus.cc:2749] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.163233 10789 leader_election.cc:290] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:12.158164 10445 leader_election.cc:304] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:12.170289 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab2d2836c0834b29a9007f5c0c4469fe" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:12.171068 10551 raft_consensus.cc:3060] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.171258 10814 raft_consensus.cc:2804] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.171887 10814 raft_consensus.cc:697] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:12.172884 10814 consensus_queue.cc:237] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
W20260709 12:23:12.176019 10444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 249613us
I20260709 12:23:12.164899 10553 raft_consensus.cc:2468] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:12.182220 10669 leader_election.cc:304] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.183730 10935 raft_consensus.cc:2804] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.184244 10935 raft_consensus.cc:697] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:12.185101 10935 consensus_queue.cc:237] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.187065 10936 raft_consensus.cc:493] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.187649 10936 raft_consensus.cc:515] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.188649 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab2d2836c0834b29a9007f5c0c4469fe" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:12.190022 10749 tablet_bootstrap.cc:492] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:12.190438 10936 leader_election.cc:290] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:12.190546 10749 ts_tablet_manager.cc:1403] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.237s	user 0.019s	sys 0.007s
I20260709 12:23:12.192968 10753 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:12.194669 10753 ts_tablet_manager.cc:1403] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.020s
I20260709 12:23:12.202296 10749 raft_consensus.cc:359] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.203158 10749 raft_consensus.cc:385] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.203655 10749 raft_consensus.cc:740] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.208439 10749 consensus_queue.cc:260] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.206075 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:12.213737 10594 leader_election.cc:343] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.214958 10478 raft_consensus.cc:3060] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.216943 10750 tablet_bootstrap.cc:654] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.235708 10749 ts_tablet_manager.cc:1434] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
W20260709 12:23:12.234614 10592 leader_election.cc:343] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.237195 10749 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:12.237778 10752 tablet_bootstrap.cc:654] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.221458 10881 raft_consensus.cc:493] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.239868 10881 raft_consensus.cc:515] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.220674 10626 raft_consensus.cc:2468] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:12.248677 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:12.224243 10444 leader_election.cc:304] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:12.253141 11017 consensus_queue.cc:1048] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.255416 10830 consensus_queue.cc:1048] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.264513 10881 leader_election.cc:290] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:12.265990 10753 raft_consensus.cc:359] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
W20260709 12:23:12.266535 10592 leader_election.cc:343] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.266880 10753 raft_consensus.cc:385] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.267208 10753 raft_consensus.cc:740] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.267555 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:12.267951 10753 consensus_queue.cc:260] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.269625 10753 ts_tablet_manager.cc:1434] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.000s
I20260709 12:23:12.269683 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:12.270709 10753 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
W20260709 12:23:12.271581 10666 leader_election.cc:343] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.267042 10592 leader_election.cc:304] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:12.274225 10936 raft_consensus.cc:2749] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:12.294631 10669 leader_election.cc:343] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.309602 10669 leader_election.cc:304] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.310323 10749 tablet_bootstrap.cc:654] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.311163 10881 raft_consensus.cc:2749] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.317062 10551 raft_consensus.cc:2468] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:12.318378 10595 leader_election.cc:304] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.319572 10789 raft_consensus.cc:2804] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.320047 10789 raft_consensus.cc:697] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:12.320849 10789 consensus_queue.cc:237] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.329394 10373 catalog_manager.cc:5697] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.330525 10750 tablet_bootstrap.cc:492] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:12.331043 10841 consensus_queue.cc:1048] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.331975 10812 raft_consensus.cc:2749] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.335817 10752 tablet_bootstrap.cc:492] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.336396 10752 ts_tablet_manager.cc:1403] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.185s	user 0.029s	sys 0.031s
I20260709 12:23:12.338387 10881 consensus_queue.cc:1048] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.344647 10750 ts_tablet_manager.cc:1403] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.215s	user 0.008s	sys 0.012s
I20260709 12:23:12.344435 10752 raft_consensus.cc:359] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.347116 10752 raft_consensus.cc:385] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.325860 10371 catalog_manager.cc:5697] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.347507 10752 raft_consensus.cc:740] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.371640 10881 raft_consensus.cc:493] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.372236 10881 raft_consensus.cc:515] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.374428 10881 leader_election.cc:290] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:12.357179 10752 consensus_queue.cc:260] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.378439 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:12.382344 10752 ts_tablet_manager.cc:1434] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
W20260709 12:23:12.383971 10666 leader_election.cc:343] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.386830 10750 raft_consensus.cc:359] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.388034 10750 raft_consensus.cc:385] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.388273 10750 raft_consensus.cc:740] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.389350 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:12.391238 10669 leader_election.cc:343] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.391781 10669 leader_election.cc:304] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.388919 10750 consensus_queue.cc:260] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.395941 10752 tablet_bootstrap.cc:492] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.395668 11017 raft_consensus.cc:2749] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.407127 10752 tablet_bootstrap.cc:654] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.415215 10753 tablet_bootstrap.cc:654] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.416802 10789 raft_consensus.cc:493] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.417327 10789 raft_consensus.cc:515] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.420265 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb2769bf67740918d65b198cc6cac17" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:12.421870 10789 leader_election.cc:290] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
W20260709 12:23:12.422115 10595 leader_election.cc:343] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.423457 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb2769bf67740918d65b198cc6cac17" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:12.424697 10594 leader_election.cc:343] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.425123 10594 leader_election.cc:304] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:12.426241 10789 raft_consensus.cc:2749] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.431838 10749 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:12.432472 10373 catalog_manager.cc:5697] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.434309 10789 raft_consensus.cc:493] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.437640 10789 raft_consensus.cc:515] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.439910 10789 leader_election.cc:290] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:12.440555 10752 tablet_bootstrap.cc:492] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.441099 10752 ts_tablet_manager.cc:1403] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.007s
I20260709 12:23:12.442128 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:12.442561 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:12.443571 10592 leader_election.cc:343] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.446494 10753 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:12.446657 10752 raft_consensus.cc:359] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.447880 10752 raft_consensus.cc:385] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.448155 10752 raft_consensus.cc:740] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.448869 10752 consensus_queue.cc:260] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.450804 10752 ts_tablet_manager.cc:1434] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:23:12.451807 10752 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
W20260709 12:23:12.452087 10595 leader_election.cc:343] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.452611 10595 leader_election.cc:304] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.446998 10753 ts_tablet_manager.cc:1403] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.005s
I20260709 12:23:12.454722 10936 raft_consensus.cc:2749] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.455969 10755 raft_consensus.cc:493] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.456498 10755 raft_consensus.cc:515] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.458597 10755 leader_election.cc:290] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:12.458076 10371 catalog_manager.cc:5697] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.460834 10752 tablet_bootstrap.cc:654] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.461608 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc42f485018420e94dafb287e1f73b5" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.462253 10625 raft_consensus.cc:2468] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:12.465674 10520 leader_election.cc:304] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:12.466728 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc42f485018420e94dafb287e1f73b5" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:12.467402 10703 raft_consensus.cc:2468] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:12.475239 10755 raft_consensus.cc:2804] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.475756 10755 raft_consensus.cc:493] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.455976 10753 raft_consensus.cc:359] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.477075 10753 raft_consensus.cc:385] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.477329 10753 raft_consensus.cc:740] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.478058 10753 consensus_queue.cc:260] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.480856 10755 raft_consensus.cc:3060] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.487526 10881 raft_consensus.cc:493] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.488129 10881 raft_consensus.cc:515] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.491425 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb2769bf67740918d65b198cc6cac17" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:12.492770 10669 leader_election.cc:343] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.494279 10881 leader_election.cc:290] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:12.432471 10749 ts_tablet_manager.cc:1403] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.001s
I20260709 12:23:12.495643 10752 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.496152 10752 ts_tablet_manager.cc:1403] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.016s
I20260709 12:23:12.496253 10812 raft_consensus.cc:493] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.496784 10812 raft_consensus.cc:515] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.497475 10749 raft_consensus.cc:359] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.498136 10749 raft_consensus.cc:385] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.498390 10749 raft_consensus.cc:740] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.498670 10752 raft_consensus.cc:359] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.499323 10752 raft_consensus.cc:385] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.499577 10752 raft_consensus.cc:740] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.499782 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb2769bf67740918d65b198cc6cac17" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.500123 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:12.498695 10812 leader_election.cc:290] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:12.500452 10625 raft_consensus.cc:2468] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:12.503475 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:12.503589 10669 leader_election.cc:304] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:12.504242 10552 raft_consensus.cc:2393] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate becf98b94b704731a507d96d1a44737c in this term.
I20260709 12:23:12.504509 10940 raft_consensus.cc:2804] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.504946 10940 raft_consensus.cc:493] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.505302 10940 raft_consensus.cc:3060] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.500214 10752 consensus_queue.cc:260] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.505807 10445 leader_election.cc:304] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:12.507412 10752 ts_tablet_manager.cc:1434] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:12.507522 10812 raft_consensus.cc:3060] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.508590 10752 tablet_bootstrap.cc:492] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.515853 10812 raft_consensus.cc:2749] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.516428 10752 tablet_bootstrap.cc:654] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.521649 10940 raft_consensus.cc:515] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.524302 10753 ts_tablet_manager.cc:1434] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:23:12.524915 10814 raft_consensus.cc:493] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.525612 10753 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:12.525478 10814 raft_consensus.cc:515] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.433815 10750 ts_tablet_manager.cc:1434] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.001s
I20260709 12:23:12.530272 10750 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:12.537295 10755 raft_consensus.cc:515] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.560453 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab2d2836c0834b29a9007f5c0c4469fe" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:12.571004 10551 raft_consensus.cc:2393] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate 5703388aa4f747c280bf93e578f6bad7 in this term.
I20260709 12:23:12.560806 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab2d2836c0834b29a9007f5c0c4469fe" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.572887 10935 consensus_queue.cc:1048] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.563102 11017 raft_consensus.cc:493] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.574877 11017 raft_consensus.cc:515] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.577096 10445 leader_election.cc:304] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:12.578310 11008 raft_consensus.cc:3060] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.597467 11017 leader_election.cc:290] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:12.598341 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.599121 10629 raft_consensus.cc:2468] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:12.569564 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb2769bf67740918d65b198cc6cac17" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:12.569890 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb2769bf67740918d65b198cc6cac17" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
W20260709 12:23:12.554204 10666 consensus_peers.cc:597] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.600880 10625 raft_consensus.cc:3060] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.601397 10666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 47346.6us
I20260709 12:23:12.545917 10814 leader_election.cc:290] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:12.604933 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:12.606362 10666 leader_election.cc:343] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:12.607895 10669 leader_election.cc:343] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.608878 10669 leader_election.cc:304] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.611289 10935 raft_consensus.cc:2804] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.611738 10935 raft_consensus.cc:493] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.611872 10752 tablet_bootstrap.cc:492] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.612166 10935 raft_consensus.cc:3060] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.612489 10752 ts_tablet_manager.cc:1403] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.104s	user 0.036s	sys 0.020s
I20260709 12:23:12.565172 10749 consensus_queue.cc:260] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.617846 10841 raft_consensus.cc:493] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.618340 10841 raft_consensus.cc:515] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.621392 10749 ts_tablet_manager.cc:1434] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.000s
I20260709 12:23:12.624549 10841 leader_election.cc:290] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:12.624814 10752 raft_consensus.cc:359] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.629750 11008 raft_consensus.cc:2749] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.630107 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:12.662259 10752 raft_consensus.cc:385] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.662591 10752 raft_consensus.cc:740] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.663359 10752 consensus_queue.cc:260] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:12.663738 10517 leader_election.cc:343] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.665578 10752 ts_tablet_manager.cc:1434] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:23:12.667236 10752 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.567505 10940 leader_election.cc:290] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:12.642957 10814 raft_consensus.cc:493] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.667946 10814 raft_consensus.cc:515] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.645504 10750 tablet_bootstrap.cc:654] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.672772 10814 leader_election.cc:290] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:12.676821 10749 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:12.680055 10752 tablet_bootstrap.cc:654] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.680527 10755 leader_election.cc:290] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:12.681219 10935 raft_consensus.cc:515] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.682498 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.684134 10629 raft_consensus.cc:2468] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:12.685777 10445 leader_election.cc:304] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:12.686290 10935 leader_election.cc:290] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:12.686949 11008 raft_consensus.cc:2804] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.687369 11008 raft_consensus.cc:493] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.687608 10749 tablet_bootstrap.cc:654] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.687731 11008 raft_consensus.cc:3060] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.688992 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:12.659073 10625 raft_consensus.cc:2468] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:12.660521 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:12.661408 10753 tablet_bootstrap.cc:654] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.703145 10703 raft_consensus.cc:2468] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:12.708154 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:12.710323 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc42f485018420e94dafb287e1f73b5" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:12.710994 10750 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:12.711621 10750 ts_tablet_manager.cc:1403] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.002s
I20260709 12:23:12.710966 10629 raft_consensus.cc:3060] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:12.713918 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 103857us
I20260709 12:23:12.721462 10519 leader_election.cc:304] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.722484 10755 raft_consensus.cc:2804] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.722880 10755 raft_consensus.cc:493] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.723284 10755 raft_consensus.cc:3060] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.725584 10669 leader_election.cc:304] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:12.726760 10881 raft_consensus.cc:2804] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.727275 10881 raft_consensus.cc:697] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:12.728206 10881 consensus_queue.cc:237] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.735400 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:12.736184 10625 raft_consensus.cc:3060] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.739818 10814 consensus_queue.cc:1048] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:12.741086 10755 raft_consensus.cc:515] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.745926 10749 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:12.746624 10749 ts_tablet_manager.cc:1403] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.004s
I20260709 12:23:12.749755 11003 consensus_queue.cc:1048] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.752753 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc42f485018420e94dafb287e1f73b5" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:12.753492 10703 raft_consensus.cc:3060] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.753334 10750 raft_consensus.cc:359] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.754330 10750 raft_consensus.cc:385] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.754637 10750 raft_consensus.cc:740] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.756778 10753 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:12.758777 10753 ts_tablet_manager.cc:1403] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.233s	user 0.015s	sys 0.012s
I20260709 12:23:12.762245 10629 raft_consensus.cc:2468] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:12.764166 10755 leader_election.cc:290] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:12.763546 10749 raft_consensus.cc:359] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.765513 10750 consensus_queue.cc:260] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.767311 11042 consensus_queue.cc:1048] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:12.767484 10445 leader_election.cc:343] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.768309 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:12.766592 10749 raft_consensus.cc:385] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.769999 10749 raft_consensus.cc:740] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
W20260709 12:23:12.770320 10517 leader_election.cc:343] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.770733 10749 consensus_queue.cc:260] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.765784 10753 raft_consensus.cc:359] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.769073 11008 raft_consensus.cc:515] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.772804 10753 raft_consensus.cc:385] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.773166 10753 raft_consensus.cc:740] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.774215 10750 ts_tablet_manager.cc:1434] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260709 12:23:12.774041 10753 consensus_queue.cc:260] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.784336 10750 tablet_bootstrap.cc:492] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:12.787225 10753 ts_tablet_manager.cc:1434] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
W20260709 12:23:12.774634 10666 leader_election.cc:343] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.802191 10479 raft_consensus.cc:3060] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.808666 10789 consensus_queue.cc:1048] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.788930 10749 ts_tablet_manager.cc:1434] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.004s
I20260709 12:23:12.790324 11008 leader_election.cc:290] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:12.772954 10703 raft_consensus.cc:2468] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:12.809939 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:12.811766 10629 raft_consensus.cc:3060] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.819448 10749 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:12.820811 10753 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:12.825256 10629 raft_consensus.cc:2468] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:12.827708 10625 raft_consensus.cc:2468] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:12.828795 10749 tablet_bootstrap.cc:654] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.828267 11042 consensus_queue.cc:1048] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:12.828454 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:12.831246 10669 leader_election.cc:304] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:12.834704 11042 raft_consensus.cc:2804] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.835245 11042 raft_consensus.cc:697] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:12.838701 11042 consensus_queue.cc:237] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.834697 10703 raft_consensus.cc:3060] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.830652 10519 leader_election.cc:304] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:12.844766 10752 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:12.846853 10750 tablet_bootstrap.cc:654] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.850382 10753 tablet_bootstrap.cc:654] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.852998 10371 catalog_manager.cc:5697] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:12.855768 10752 ts_tablet_manager.cc:1403] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.189s	user 0.024s	sys 0.017s
I20260709 12:23:12.854511 10445 leader_election.cc:304] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:12.865878 10812 raft_consensus.cc:2804] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.866430 10812 raft_consensus.cc:697] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:12.867120 10881 raft_consensus.cc:493] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.867313 10812 consensus_queue.cc:237] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.867806 10881 raft_consensus.cc:515] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:12.869907 10881 leader_election.cc:290] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:12.873265 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.875481 10755 raft_consensus.cc:2804] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.876019 10755 raft_consensus.cc:697] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:12.876788 10755 consensus_queue.cc:237] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:12.877584 10553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:12.878379 10553 raft_consensus.cc:3060] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.883427 10625 raft_consensus.cc:2468] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:12.894217 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:12.890070 10519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 59526.8us
I20260709 12:23:12.953881 10789 raft_consensus.cc:493] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.954505 10789 raft_consensus.cc:515] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.956638 10789 leader_election.cc:290] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:12.957418 10669 leader_election.cc:304] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:12.950744 10752 raft_consensus.cc:359] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.959376 10752 raft_consensus.cc:385] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.959700 10752 raft_consensus.cc:740] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.960562 10752 consensus_queue.cc:260] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:12.962528 10752 ts_tablet_manager.cc:1434] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.106s	user 0.003s	sys 0.001s
I20260709 12:23:12.962543 10839 raft_consensus.cc:2804] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.964524 10839 raft_consensus.cc:493] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.965051 10839 raft_consensus.cc:3060] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.965658 10749 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:12.966315 10749 ts_tablet_manager.cc:1403] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.147s	user 0.025s	sys 0.010s
W20260709 12:23:12.971498 10666 leader_election.cc:343] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.973543 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:12.975010 10749 raft_consensus.cc:359] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.975976 10749 raft_consensus.cc:385] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.976325 10749 raft_consensus.cc:740] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.977223 10749 consensus_queue.cc:260] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:12.977659 10935 raft_consensus.cc:493] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.978505 10752 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:12.939412 10553 raft_consensus.cc:2468] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
W20260709 12:23:12.983872 10592 leader_election.cc:343] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.993016 10749 ts_tablet_manager.cc:1434] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 12:23:12.981638 10935 raft_consensus.cc:515] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.004446 10749 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:13.009636 10935 leader_election.cc:290] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:13.013602 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:13.015380 10789 consensus_queue.cc:1048] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.015628 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:12.994791 10703 raft_consensus.cc:2468] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
W20260709 12:23:13.017185 10669 leader_election.cc:343] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:13.018776 10595 leader_election.cc:343] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.019284 10595 leader_election.cc:304] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.021013 10789 raft_consensus.cc:2749] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.023289 10750 tablet_bootstrap.cc:492] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:13.023833 10750 ts_tablet_manager.cc:1403] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.240s	user 0.021s	sys 0.020s
I20260709 12:23:13.023041 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:13.026611 10750 raft_consensus.cc:359] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:13.028035 10669 leader_election.cc:343] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.031772 10669 leader_election.cc:304] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:13.032928 11041 raft_consensus.cc:2749] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.030344 10750 raft_consensus.cc:385] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.033504 10519 leader_election.cc:304] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.034723 10755 raft_consensus.cc:2804] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.035175 10755 raft_consensus.cc:697] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:13.033716 10750 raft_consensus.cc:740] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.038980 10750 consensus_queue.cc:260] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.036020 10755 consensus_queue.cc:237] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.061592 10752 tablet_bootstrap.cc:654] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.042470 10839 raft_consensus.cc:515] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.064810 10750 ts_tablet_manager.cc:1434] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:23:13.066082 10750 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:13.072512 10749 tablet_bootstrap.cc:654] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.073398 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:13.074180 10625 raft_consensus.cc:3060] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.080534 10753 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:13.081259 10753 ts_tablet_manager.cc:1403] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.263s	user 0.014s	sys 0.003s
I20260709 12:23:13.080430 10373 catalog_manager.cc:5697] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.084208 10753 raft_consensus.cc:359] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.087872 10753 raft_consensus.cc:385] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.088213 10753 raft_consensus.cc:740] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.090027 10753 consensus_queue.cc:260] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.098153 10753 ts_tablet_manager.cc:1434] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:23:13.114153 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:13.114621 11042 raft_consensus.cc:493] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.115788 11042 raft_consensus.cc:515] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.120307 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:13.122277 10669 leader_election.cc:343] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.124264 11042 leader_election.cc:290] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:13.127060 10372 catalog_manager.cc:5697] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.127807 10841 raft_consensus.cc:493] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.128453 10841 raft_consensus.cc:515] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:13.130589 10841 leader_election.cc:290] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:13.126511 10371 catalog_manager.cc:5697] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.131716 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:13.132344 10629 raft_consensus.cc:2468] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:13.133512 10520 leader_election.cc:304] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:13.134002 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:13.134447 10841 raft_consensus.cc:2804] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.134905 10841 raft_consensus.cc:493] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:13.135144 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:13.135246 10841 raft_consensus.cc:3060] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:13.135654 10517 leader_election.cc:343] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:13.137493 10666 leader_election.cc:343] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.137809 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:13.139225 10839 leader_election.cc:290] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:13.139257 10666 leader_election.cc:343] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.139947 10666 leader_election.cc:304] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.145570 10625 raft_consensus.cc:2468] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:13.145656 10841 raft_consensus.cc:515] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:13.148304 10750 tablet_bootstrap.cc:654] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:13.152227 10669 consensus_peers.cc:597] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.152993 10669 leader_election.cc:304] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.153332 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:13.154827 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:13.154956 11041 raft_consensus.cc:2804] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:13.154820 10517 leader_election.cc:343] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.156787 10841 leader_election.cc:290] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:13.156744 10935 raft_consensus.cc:2749] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.157992 10625 raft_consensus.cc:3060] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.159811 11041 raft_consensus.cc:697] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:13.173601 11041 consensus_queue.cc:237] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.202606 10753 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:13.220396 10750 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:13.221057 10750 ts_tablet_manager.cc:1403] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.013s
I20260709 12:23:13.225683 10749 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:13.226260 10749 ts_tablet_manager.cc:1403] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.222s	user 0.021s	sys 0.007s
I20260709 12:23:13.233053 10750 raft_consensus.cc:359] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:13.233847 10750 raft_consensus.cc:385] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.231735 10749 raft_consensus.cc:359] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.235121 10749 raft_consensus.cc:385] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.235426 10749 raft_consensus.cc:740] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.235852 10935 consensus_queue.cc:1048] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.236279 10936 raft_consensus.cc:493] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.236119 10749 consensus_queue.cc:260] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.236793 10936 raft_consensus.cc:515] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.237802 10749 ts_tablet_manager.cc:1434] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:13.238770 10749 tablet_bootstrap.cc:492] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:13.234134 10750 raft_consensus.cc:740] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.246062 10753 tablet_bootstrap.cc:654] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.247350 10750 consensus_queue.cc:260] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:13.249646 10752 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:13.250232 10752 ts_tablet_manager.cc:1403] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.272s	user 0.014s	sys 0.004s
I20260709 12:23:13.239192 10936 leader_election.cc:290] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:13.254819 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:13.258798 10703 raft_consensus.cc:2468] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:13.242480 10625 raft_consensus.cc:2468] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:13.267933 10371 catalog_manager.cc:5697] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.264045 10372 catalog_manager.cc:5697] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.273330 10750 ts_tablet_manager.cc:1434] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 12:23:13.281634 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:13.284045 10594 leader_election.cc:304] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
W20260709 12:23:13.287568 10595 leader_election.cc:343] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.289278 11069 raft_consensus.cc:2804] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.289851 11069 raft_consensus.cc:493] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.290307 11069 raft_consensus.cc:3060] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.291931 10520 leader_election.cc:304] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.293720 10841 raft_consensus.cc:2804] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.294281 10841 raft_consensus.cc:697] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:13.295639 10841 consensus_queue.cc:237] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:13.300000 10752 raft_consensus.cc:359] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.301275 10750 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:13.300920 10752 raft_consensus.cc:385] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.302409 10752 raft_consensus.cc:740] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.303253 10752 consensus_queue.cc:260] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.305578 10752 ts_tablet_manager.cc:1434] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.002s
I20260709 12:23:13.306587 10752 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:13.310961 10749 tablet_bootstrap.cc:654] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.315196 10750 tablet_bootstrap.cc:654] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.328159 10812 consensus_queue.cc:1048] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.336185 10935 consensus_queue.cc:1048] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.337369 10371 catalog_manager.cc:5697] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.338095 10752 tablet_bootstrap.cc:654] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.348145 10753 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:13.348842 10753 ts_tablet_manager.cc:1403] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.007s
I20260709 12:23:13.352631 11069 raft_consensus.cc:515] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.352680 10753 raft_consensus.cc:359] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.357401 10753 raft_consensus.cc:385] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.358155 10753 raft_consensus.cc:740] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.362063 10753 consensus_queue.cc:260] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.366608 10752 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:13.367381 10752 ts_tablet_manager.cc:1403] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.004s
I20260709 12:23:13.369305 10749 tablet_bootstrap.cc:492] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:13.370064 10749 ts_tablet_manager.cc:1403] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.010s
I20260709 12:23:13.372430 11069 leader_election.cc:290] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:13.371788 10752 raft_consensus.cc:359] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.373209 10752 raft_consensus.cc:385] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.373556 10752 raft_consensus.cc:740] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.374853 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:13.375550 10703 raft_consensus.cc:3060] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.379971 10753 ts_tablet_manager.cc:1434] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:23:13.374390 10812 raft_consensus.cc:493] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.384048 10812 raft_consensus.cc:515] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.393251 10703 raft_consensus.cc:2468] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:13.400430 10753 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:13.395390 10752 consensus_queue.cc:260] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.401394 10594 leader_election.cc:304] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:13.402506 10936 raft_consensus.cc:2804] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.402989 10936 raft_consensus.cc:697] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:13.403865 10936 consensus_queue.cc:237] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.401028 10812 leader_election.cc:290] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:13.381611 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:13.431896 10752 ts_tablet_manager.cc:1434] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:23:13.433018 10752 tablet_bootstrap.cc:492] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:13.434338 10750 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:13.435091 10750 ts_tablet_manager.cc:1403] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.012s
I20260709 12:23:13.438392 10750 raft_consensus.cc:359] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.439208 10750 raft_consensus.cc:385] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.440505 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:13.442209 10750 raft_consensus.cc:740] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
W20260709 12:23:13.443511 10595 leader_election.cc:343] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.450439 10749 raft_consensus.cc:359] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.451521 10749 raft_consensus.cc:385] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.451910 10749 raft_consensus.cc:740] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.452778 10749 consensus_queue.cc:260] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.459625 10812 consensus_queue.cc:1048] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.465741 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:13.467243 10841 consensus_queue.cc:1048] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.474324 10750 consensus_queue.cc:260] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.467257 10444 leader_election.cc:304] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:13.480816 11008 raft_consensus.cc:493] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.481496 11008 raft_consensus.cc:515] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.472163 10753 tablet_bootstrap.cc:654] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.489018 10749 ts_tablet_manager.cc:1434] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.002s
I20260709 12:23:13.493213 10750 ts_tablet_manager.cc:1434] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260709 12:23:13.491974 10812 raft_consensus.cc:2749] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.500415 10755 raft_consensus.cc:493] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.500960 10755 raft_consensus.cc:515] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.501756 10936 raft_consensus.cc:493] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.502681 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:13.504853 10702 raft_consensus.cc:2393] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:13.506912 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:13.508430 10517 leader_election.cc:343] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.489576 11008 leader_election.cc:290] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:13.502839 10755 leader_election.cc:290] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:13.503742 11036 consensus_queue.cc:1048] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.512737 10376 catalog_manager.cc:5697] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.516844 10749 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:13.517772 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:13.521360 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:13.522076 10702 raft_consensus.cc:2468] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:13.524550 10755 consensus_queue.cc:1048] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.530680 10752 tablet_bootstrap.cc:654] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.508605 10936 raft_consensus.cc:515] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:13.539723 10555 raft_consensus.cc:3060] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.546604 10478 raft_consensus.cc:3060] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.547453 10519 leader_election.cc:304] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.550242 11036 raft_consensus.cc:2804] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.550658 11036 raft_consensus.cc:493] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.555666 10445 leader_election.cc:304] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:13.550999 11036 raft_consensus.cc:3060] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.581751 10479 raft_consensus.cc:3060] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.588431 10789 raft_consensus.cc:493] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.589175 10789 raft_consensus.cc:515] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.576517 11017 raft_consensus.cc:493] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.590122 11017 raft_consensus.cc:515] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.593775 10749 tablet_bootstrap.cc:654] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.597560 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483a0bc6f3d945efaabbad914d574e84" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:13.599431 11017 leader_election.cc:290] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:13.600481 10594 leader_election.cc:343] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.602254 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c862ff91f7484100b8a72ae26d09b8c1" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:13.604442 10666 leader_election.cc:343] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.605042 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:13.606982 10936 leader_election.cc:290] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:13.609766 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c862ff91f7484100b8a72ae26d09b8c1" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:13.616391 10592 leader_election.cc:343] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:13.623736 10669 leader_election.cc:343] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.624837 10789 leader_election.cc:290] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:13.634408 10669 leader_election.cc:304] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.626587 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483a0bc6f3d945efaabbad914d574e84" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:13.617470 10666 consensus_peers.cc:597] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.638106 11041 raft_consensus.cc:2749] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:13.640349 10592 leader_election.cc:343] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.640906 10592 leader_election.cc:304] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:13.642015 10936 raft_consensus.cc:2749] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.642741 11008 raft_consensus.cc:2749] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.647509 10750 tablet_bootstrap.cc:492] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:13.644457 11041 consensus_queue.cc:1048] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:13.657430 11036 raft_consensus.cc:515] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.664108 10753 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:13.664775 10753 ts_tablet_manager.cc:1403] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.270s	user 0.044s	sys 0.060s
I20260709 12:23:13.665248 10755 consensus_queue.cc:1048] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.666227 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:13.666908 10700 raft_consensus.cc:3060] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:13.672541 10666 consensus_peers.cc:597] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.683233 10750 tablet_bootstrap.cc:654] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.694464 10753 raft_consensus.cc:359] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.695564 10753 raft_consensus.cc:385] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.695912 10753 raft_consensus.cc:740] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.696653 10753 consensus_queue.cc:260] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.700691 10753 ts_tablet_manager.cc:1434] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 12:23:13.700811 11036 leader_election.cc:290] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:13.704782 10753 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:13.707556 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:13.708320 10476 raft_consensus.cc:3060] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.718773 10753 tablet_bootstrap.cc:654] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.719422 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:13.721189 10517 consensus_peers.cc:597] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.739651 10700 raft_consensus.cc:2468] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:13.748031 10519 leader_election.cc:304] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:13.751521 11037 raft_consensus.cc:2804] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.771394 10750 tablet_bootstrap.cc:492] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:13.771966 10750 ts_tablet_manager.cc:1403] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.000s
I20260709 12:23:13.765007 11037 raft_consensus.cc:697] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:13.775720 10750 raft_consensus.cc:359] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.776465 10750 raft_consensus.cc:385] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.776927 10750 raft_consensus.cc:740] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.832166 11040 raft_consensus.cc:493] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.832782 11040 raft_consensus.cc:515] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.834934 11040 leader_election.cc:290] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:13.837100 10595 leader_election.cc:343] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.837613 10595 leader_election.cc:304] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.839936 10936 raft_consensus.cc:2749] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.841535 10750 consensus_queue.cc:260] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.845662 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:13.846593 10752 tablet_bootstrap.cc:492] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:13.847188 10752 ts_tablet_manager.cc:1403] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.414s	user 0.014s	sys 0.006s
I20260709 12:23:13.846946 11037 consensus_queue.cc:237] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.847146 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:13.850227 10666 leader_election.cc:343] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.852527 10476 raft_consensus.cc:2468] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:13.856244 10750 ts_tablet_manager.cc:1434] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.084s	user 0.021s	sys 0.005s
I20260709 12:23:13.857316 10750 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:13.851740 10749 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:13.863214 10749 ts_tablet_manager.cc:1403] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.347s	user 0.015s	sys 0.009s
I20260709 12:23:13.864946 10752 raft_consensus.cc:359] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.865691 10752 raft_consensus.cc:385] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.865983 10752 raft_consensus.cc:740] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.866607 10752 consensus_queue.cc:260] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:13.881670 10752 ts_tablet_manager.cc:1434] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 12:23:13.869673 11036 consensus_queue.cc:1048] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:23:13.893085 10752 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:13.899837 10752 tablet_bootstrap.cc:654] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.901928 10753 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:13.908324 10753 ts_tablet_manager.cc:1403] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.204s	user 0.016s	sys 0.019s
W20260709 12:23:13.887805 10669 leader_election.cc:343] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.912094 10750 tablet_bootstrap.cc:654] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.913276 10669 leader_election.cc:304] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:13.917337 10752 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:13.917797 10752 ts_tablet_manager.cc:1403] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:23:13.921159 10839 raft_consensus.cc:2749] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.920696 10372 catalog_manager.cc:5697] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.926460 10753 raft_consensus.cc:359] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.927182 10753 raft_consensus.cc:385] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.927211 10752 raft_consensus.cc:359] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.927968 10752 raft_consensus.cc:385] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.927587 10753 raft_consensus.cc:740] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.928915 10753 consensus_queue.cc:260] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.930572 10752 raft_consensus.cc:740] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.931218 10753 ts_tablet_manager.cc:1434] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:23:13.931288 10752 consensus_queue.cc:260] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.933022 10752 ts_tablet_manager.cc:1434] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:13.933957 10752 tablet_bootstrap.cc:492] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:13.936342 10753 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
W20260709 12:23:13.941036 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 53746.9us
I20260709 12:23:13.942564 10752 tablet_bootstrap.cc:654] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.943055 10749 raft_consensus.cc:359] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.948439 10749 raft_consensus.cc:385] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.948773 10749 raft_consensus.cc:740] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
W20260709 12:23:13.947824 10595 consensus_peers.cc:597] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:13.950846 11078 consensus_queue.cc:1048] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.965533 10750 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:13.966478 10750 ts_tablet_manager.cc:1403] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.003s
I20260709 12:23:13.980667 10750 raft_consensus.cc:359] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.981455 10750 raft_consensus.cc:385] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.981739 10750 raft_consensus.cc:740] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.982388 10750 consensus_queue.cc:260] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:13.977389 10749 consensus_queue.cc:260] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.990536 10753 tablet_bootstrap.cc:654] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.996114 11036 raft_consensus.cc:493] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.996667 11036 raft_consensus.cc:515] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:13.997437 10749 ts_tablet_manager.cc:1434] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.000s
I20260709 12:23:13.998664 10749 tablet_bootstrap.cc:492] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:13.999791 11036 leader_election.cc:290] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.003103 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:14.004129 10750 ts_tablet_manager.cc:1434] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
W20260709 12:23:14.004736 10517 leader_election.cc:343] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.005296 10750 tablet_bootstrap.cc:492] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:14.009431 10749 tablet_bootstrap.cc:654] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.011339 10750 tablet_bootstrap.cc:654] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.023243 10749 tablet_bootstrap.cc:492] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:14.023777 10749 ts_tablet_manager.cc:1403] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 12:23:14.026634 10749 raft_consensus.cc:359] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.033320 10750 tablet_bootstrap.cc:492] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:14.033646 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.034154 10750 ts_tablet_manager.cc:1403] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
I20260709 12:23:14.034332 10703 raft_consensus.cc:2468] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:14.036281 10519 leader_election.cc:304] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:14.037213 11036 raft_consensus.cc:2804] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.037657 11036 raft_consensus.cc:493] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.038030 11036 raft_consensus.cc:3060] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.039461 10749 raft_consensus.cc:385] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.039809 10749 raft_consensus.cc:740] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.037149 10750 raft_consensus.cc:359] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.041081 10750 raft_consensus.cc:385] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.041359 10750 raft_consensus.cc:740] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.041441 10753 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:14.042321 10753 ts_tablet_manager.cc:1403] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.020s
I20260709 12:23:14.042124 10750 consensus_queue.cc:260] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.043551 10749 consensus_queue.cc:260] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.045518 10753 raft_consensus.cc:359] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.046281 10753 raft_consensus.cc:385] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.046200 11036 raft_consensus.cc:515] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.046806 10753 raft_consensus.cc:740] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.047816 10753 consensus_queue.cc:260] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.049705 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:14.050840 10750 ts_tablet_manager.cc:1434] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
W20260709 12:23:14.051438 10517 leader_election.cc:343] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.052211 10750 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:14.052152 11036 leader_election.cc:290] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.055490 10749 ts_tablet_manager.cc:1434] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:23:14.056427 10749 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:14.057164 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:14.057844 10702 raft_consensus.cc:3060] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:14.060413 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 44616.6us
I20260709 12:23:14.063148 10753 ts_tablet_manager.cc:1434] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:23:14.065745 10753 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:14.072328 10750 tablet_bootstrap.cc:654] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.074631 10753 tablet_bootstrap.cc:654] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.074856 10702 raft_consensus.cc:2468] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:14.079476 10519 leader_election.cc:304] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:14.080679 11036 raft_consensus.cc:2804] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.081322 11036 raft_consensus.cc:697] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:14.082155 11036 consensus_queue.cc:237] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.082916 10749 tablet_bootstrap.cc:654] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.090799 10753 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:14.091437 10753 ts_tablet_manager.cc:1403] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 12:23:14.094153 10753 raft_consensus.cc:359] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.095013 10753 raft_consensus.cc:385] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.100697 11038 raft_consensus.cc:493] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.101395 11038 raft_consensus.cc:515] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.096611 10753 raft_consensus.cc:740] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.106568 11038 leader_election.cc:290] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:14.107616 10839 raft_consensus.cc:493] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.108111 10839 raft_consensus.cc:515] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.109355 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.110834 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc875de41c5440e78f3da51713684d46" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.111141 10839 leader_election.cc:290] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.112695 10519 leader_election.cc:304] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:14.113431 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:14.114245 11038 raft_consensus.cc:2749] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.104255 10753 consensus_queue.cc:260] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.116641 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.117100 10752 tablet_bootstrap.cc:492] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:14.117352 10624 raft_consensus.cc:2468] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:14.117784 10752 ts_tablet_manager.cc:1403] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.002s
I20260709 12:23:14.118157 10753 ts_tablet_manager.cc:1434] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:23:14.119277 10753 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:14.121803 10752 raft_consensus.cc:359] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.122679 10752 raft_consensus.cc:385] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.125489 10753 tablet_bootstrap.cc:654] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.123001 10752 raft_consensus.cc:740] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.129449 10752 consensus_queue.cc:260] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.132979 10752 ts_tablet_manager.cc:1434] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:23:14.134418 10752 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:14.140939 10476 raft_consensus.cc:3060] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.123006 10669 leader_election.cc:304] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:14.150017 10839 raft_consensus.cc:2804] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:14.150194 10666 leader_election.cc:343] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.150461 10839 raft_consensus.cc:493] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.150873 10839 raft_consensus.cc:3060] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.174199 10839 raft_consensus.cc:515] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.176437 10839 leader_election.cc:290] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.177304 10749 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:14.177842 10749 ts_tablet_manager.cc:1403] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.020s
I20260709 12:23:14.180691 10749 raft_consensus.cc:359] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.183049 10749 raft_consensus.cc:385] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.183305 10749 raft_consensus.cc:740] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.185424 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:14.185295 10749 consensus_queue.cc:260] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.189361 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:14.190862 10624 raft_consensus.cc:3060] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:14.195914 10666 leader_election.cc:343] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.202173 10479 raft_consensus.cc:3060] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.188205 10373 catalog_manager.cc:5697] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.208051 10752 tablet_bootstrap.cc:654] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.209416 10749 ts_tablet_manager.cc:1434] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:23:14.211530 10750 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:14.212069 10750 ts_tablet_manager.cc:1403] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.160s	user 0.024s	sys 0.030s
I20260709 12:23:14.214924 10750 raft_consensus.cc:359] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.215607 10750 raft_consensus.cc:385] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.215875 10750 raft_consensus.cc:740] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.216535 10750 consensus_queue.cc:260] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.218636 10750 ts_tablet_manager.cc:1434] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:14.219676 10750 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:14.225019 10750 tablet_bootstrap.cc:654] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.231226 10749 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:14.234663 10624 raft_consensus.cc:2468] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:14.236100 10669 leader_election.cc:304] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:14.237212 10839 raft_consensus.cc:2804] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.237702 10839 raft_consensus.cc:697] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:14.247320 10749 tablet_bootstrap.cc:654] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.238543 10839 consensus_queue.cc:237] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:14.262162 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:14.268383 10749 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:14.270428 10749 ts_tablet_manager.cc:1403] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 12:23:14.273808 10753 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:14.274489 10753 ts_tablet_manager.cc:1403] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.155s	user 0.009s	sys 0.023s
I20260709 12:23:14.273932 10749 raft_consensus.cc:359] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.278100 10749 raft_consensus.cc:385] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.278774 10749 raft_consensus.cc:740] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.280268 10749 consensus_queue.cc:260] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.283980 10753 raft_consensus.cc:359] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.293586 10749 ts_tablet_manager.cc:1434] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:23:14.299332 11008 raft_consensus.cc:493] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader becf98b94b704731a507d96d1a44737c)
I20260709 12:23:14.299479 10936 raft_consensus.cc:493] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.301970 10749 tablet_bootstrap.cc:492] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:14.300383 10752 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:14.301654 10936 raft_consensus.cc:515] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.303036 10752 ts_tablet_manager.cc:1403] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.022s
I20260709 12:23:14.306073 10752 raft_consensus.cc:359] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.306417 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3175d59583845a9aa8e63d4982cf0c0" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:14.306901 10752 raft_consensus.cc:385] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.307260 10752 raft_consensus.cc:740] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.308022 10752 consensus_queue.cc:260] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.308647 10749 tablet_bootstrap.cc:654] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.301409 11008 raft_consensus.cc:515] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.309757 10752 ts_tablet_manager.cc:1434] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
W20260709 12:23:14.308365 10595 leader_election.cc:343] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.311687 10936 leader_election.cc:290] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:14.312631 10555 raft_consensus.cc:3060] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.301119 10753 raft_consensus.cc:385] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.313474 10753 raft_consensus.cc:740] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.314263 10753 consensus_queue.cc:260] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.316522 10753 ts_tablet_manager.cc:1434] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 12:23:14.318378 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.318898 10753 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:14.317622 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab9491812e14055a4628f9b82270f73" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.321501 10444 leader_election.cc:304] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:14.322921 11081 raft_consensus.cc:2749] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:14.325167 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3175d59583845a9aa8e63d4982cf0c0" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.325507 10753 tablet_bootstrap.cc:654] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.326056 10703 raft_consensus.cc:2468] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 0.
I20260709 12:23:14.328830 10594 leader_election.cc:304] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:14.329859 10936 raft_consensus.cc:2804] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.330330 10936 raft_consensus.cc:493] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.330713 10936 raft_consensus.cc:3060] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.334612 10839 raft_consensus.cc:493] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.335251 10839 raft_consensus.cc:515] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.339659 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f415c2c9243428aacae2dc707b9d1" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:14.341543 10752 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
W20260709 12:23:14.343660 10669 leader_election.cc:343] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.347230 10814 raft_consensus.cc:493] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.348178 10814 raft_consensus.cc:515] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.351341 11078 raft_consensus.cc:493] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.355157 10752 tablet_bootstrap.cc:654] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.334095 11008 leader_election.cc:290] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:14.380545 10936 raft_consensus.cc:515] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.373055 10839 leader_election.cc:290] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:14.370054 11078 raft_consensus.cc:515] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.390394 10753 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:14.390828 10753 ts_tablet_manager.cc:1403] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.072s	user 0.038s	sys 0.020s
I20260709 12:23:14.374342 11038 consensus_queue.cc:1048] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:14.388082 10373 catalog_manager.cc:5697] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.382076 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f415c2c9243428aacae2dc707b9d1" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.393639 10749 tablet_bootstrap.cc:492] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:14.395525 10749 ts_tablet_manager.cc:1403] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.015s
I20260709 12:23:14.395154 11008 raft_consensus.cc:493] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.454634 11008 raft_consensus.cc:515] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.456827 11008 leader_election.cc:290] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:14.449591 10755 raft_consensus.cc:493] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.460676 10628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.461632 10936 leader_election.cc:290] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:14.462994 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.466089 10444 leader_election.cc:304] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:14.467214 11008 raft_consensus.cc:2749] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.463001 10750 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:14.397533 10624 raft_consensus.cc:2468] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:14.468511 10750 ts_tablet_manager.cc:1403] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.249s	user 0.058s	sys 0.056s
I20260709 12:23:14.459990 10755 raft_consensus.cc:515] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.472558 10755 leader_election.cc:290] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.472783 10749 raft_consensus.cc:359] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.473588 10749 raft_consensus.cc:385] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.472913 11078 leader_election.cc:290] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:14.473863 10749 raft_consensus.cc:740] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.474529 10749 consensus_queue.cc:260] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.476410 10749 ts_tablet_manager.cc:1434] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.081s	user 0.000s	sys 0.005s
I20260709 12:23:14.473140 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.475639 10750 raft_consensus.cc:359] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.476511 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567db905aed4ca3af769c4464b8aa2f" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:14.482169 10554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:14.482707 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3175d59583845a9aa8e63d4982cf0c0" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:14.481300 10669 leader_election.cc:304] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:14.476255 10814 leader_election.cc:290] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:14.490300 10750 raft_consensus.cc:385] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.491400 10749 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:14.497121 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567db905aed4ca3af769c4464b8aa2f" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:14.494264 10750 raft_consensus.cc:740] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.503695 10702 raft_consensus.cc:2393] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
W20260709 12:23:14.503580 10595 leader_election.cc:343] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.502502 10750 consensus_queue.cc:260] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:14.508512 10592 leader_election.cc:343] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.508958 10592 leader_election.cc:304] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:14.512869 10444 leader_election.cc:304] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:14.514711 11008 raft_consensus.cc:3060] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.519755 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3175d59583845a9aa8e63d4982cf0c0" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:14.520605 10700 raft_consensus.cc:3060] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.521109 10936 raft_consensus.cc:2749] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.495216 11041 raft_consensus.cc:2804] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.535692 11041 raft_consensus.cc:493] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.536068 11041 raft_consensus.cc:3060] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.538559 10700 raft_consensus.cc:2468] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:14.495669 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c862ff91f7484100b8a72ae26d09b8c1" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:14.540841 10517 leader_election.cc:343] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:14.542423 10595 leader_election.cc:343] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.547602 10755 raft_consensus.cc:493] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.548162 10755 raft_consensus.cc:515] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.550113 10755 leader_election.cc:290] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:14.554967 10749 tablet_bootstrap.cc:654] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.558902 10750 ts_tablet_manager.cc:1434] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.004s
I20260709 12:23:14.562700 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.563452 10629 raft_consensus.cc:2468] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:14.571394 10520 leader_election.cc:304] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:14.572228 10755 raft_consensus.cc:2804] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.572587 10755 raft_consensus.cc:493] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.572857 10755 raft_consensus.cc:3060] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.577894 10750 tablet_bootstrap.cc:492] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:14.561488 10479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:14.605662 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 92821.5us
I20260709 12:23:14.612296 10478 raft_consensus.cc:3060] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.631641 10752 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:14.632218 10752 ts_tablet_manager.cc:1403] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.291s	user 0.018s	sys 0.000s
I20260709 12:23:14.633447 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c862ff91f7484100b8a72ae26d09b8c1" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:14.634136 10703 raft_consensus.cc:2468] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:14.690538 10753 raft_consensus.cc:359] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.691066 10755 raft_consensus.cc:515] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.691910 10753 raft_consensus.cc:385] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.692245 10753 raft_consensus.cc:740] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.667018 11124 raft_consensus.cc:493] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.693527 10753 consensus_queue.cc:260] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.670758 11119 raft_consensus.cc:493] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.702437 10752 raft_consensus.cc:359] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.723521 10752 raft_consensus.cc:385] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.723948 10752 raft_consensus.cc:740] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
W20260709 12:23:14.704015 11121 log.cc:927] Time spent T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:23:14.707381 10479 raft_consensus.cc:2468] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:14.724731 10752 consensus_queue.cc:260] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.744848 10755 leader_election.cc:290] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:14.717119 11008 raft_consensus.cc:2749] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.718604 10594 leader_election.cc:304] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661
I20260709 12:23:14.754942 11042 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.755568 11042 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:14.758997 10750 tablet_bootstrap.cc:654] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.759500 11041 raft_consensus.cc:515] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.762178 10753 ts_tablet_manager.cc:1434] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.371s	user 0.004s	sys 0.012s
I20260709 12:23:14.762557 10752 ts_tablet_manager.cc:1434] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.002s
I20260709 12:23:14.722081 11124 raft_consensus.cc:515] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.743798 11119 raft_consensus.cc:515] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:14.774683 10594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 56161.2us
I20260709 12:23:14.775399 11125 raft_consensus.cc:2804] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:14.789765 10666 consensus_peers.cc:597] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:14.795332 10753 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:14.804623 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:14.806815 10666 leader_election.cc:343] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.814036 10752 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
W20260709 12:23:14.817119 10520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 107221us
I20260709 12:23:14.807915 11125 raft_consensus.cc:697] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
W20260709 12:23:14.837033 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 68858.7us
I20260709 12:23:14.848007 11041 leader_election.cc:290] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:14.848393 10475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:14.849059 10475 raft_consensus.cc:3060] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.850716 11131 consensus_queue.cc:1048] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:14.856582 11125 consensus_queue.cc:237] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.858469 10749 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:14.859014 10749 ts_tablet_manager.cc:1403] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.368s	user 0.022s	sys 0.020s
I20260709 12:23:14.860323 11124 leader_election.cc:290] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.862567 10839 consensus_queue.cc:1048] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:14.870262 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f415c2c9243428aacae2dc707b9d1" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:14.871007 10627 raft_consensus.cc:3060] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.871915 11119 leader_election.cc:290] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.875262 10473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:14.876526 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:14.876734 10592 leader_election.cc:343] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.877579 10626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483a0bc6f3d945efaabbad914d574e84" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:14.878255 10626 raft_consensus.cc:2468] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:14.878547 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9f415c2c9243428aacae2dc707b9d1" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:14.879101 10555 raft_consensus.cc:3060] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.887871 10555 raft_consensus.cc:2468] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:14.883034 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:14.894294 10624 raft_consensus.cc:3060] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.890200 10669 leader_election.cc:304] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:14.899067 10839 raft_consensus.cc:2804] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:14.899484 10839 raft_consensus.cc:493] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.899866 10839 raft_consensus.cc:3060] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.902160 11042 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:14.905367 10627 raft_consensus.cc:2468] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
W20260709 12:23:14.906662 10594 leader_election.cc:343] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.907192 10594 leader_election.cc:304] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:14.908790 10752 tablet_bootstrap.cc:654] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.909271 11078 raft_consensus.cc:2749] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:14.912861 10750 tablet_bootstrap.cc:492] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:14.912863 10473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483a0bc6f3d945efaabbad914d574e84" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:14.913470 10750 ts_tablet_manager.cc:1403] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.349s	user 0.021s	sys 0.001s
I20260709 12:23:14.917615 10750 raft_consensus.cc:359] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.918249 10750 raft_consensus.cc:385] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.918512 10750 raft_consensus.cc:740] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
W20260709 12:23:14.923789 10666 leader_election.cc:343] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.924522 10669 leader_election.cc:304] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:14.929589 10753 tablet_bootstrap.cc:654] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:14.931752 11130 raft_consensus.cc:2804] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.931562 10750 consensus_queue.cc:260] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.932289 10749 raft_consensus.cc:359] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.933161 10749 raft_consensus.cc:385] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:14.933452 10749 raft_consensus.cc:740] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:14.934167 10839 raft_consensus.cc:515] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:14.934391 10749 consensus_queue.cc:260] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.932308 11130 raft_consensus.cc:697] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:14.940399 10475 raft_consensus.cc:2468] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:14.940282 11130 consensus_queue.cc:237] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:14.941702 10749 ts_tablet_manager.cc:1434] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 12:23:14.943964 10750 ts_tablet_manager.cc:1434] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:23:14.949775 10750 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:14.956604 10839 leader_election.cc:290] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:14.960119 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483a0bc6f3d945efaabbad914d574e84" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:14.960798 10629 raft_consensus.cc:3060] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:14.962253 10517 leader_election.cc:304] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:14.967880 10749 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:14.899893 10519 leader_election.cc:304] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:14.980794 10371 catalog_manager.cc:5697] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.985445 10472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "483a0bc6f3d945efaabbad914d574e84" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:14.985530 11132 raft_consensus.cc:2804] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:14.988312 11132 raft_consensus.cc:697] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:14.989187 11132 consensus_queue.cc:237] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:14.994366 10629 raft_consensus.cc:2468] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
W20260709 12:23:14.996029 10666 leader_election.cc:343] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:14.998174 10669 leader_election.cc:304] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.003283 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:14.994536 11037 raft_consensus.cc:2804] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:14.994383 10519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 97860.5us
I20260709 12:23:15.029219 10749 tablet_bootstrap.cc:654] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.021852 11037 raft_consensus.cc:493] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.029235 11128 raft_consensus.cc:2804] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.042987 10841 consensus_queue.cc:1048] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:15.046167 10750 tablet_bootstrap.cc:654] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:15.061836 10669 leader_election.cc:343] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.062466 10669 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.082918 10839 raft_consensus.cc:2749] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.034703 11037 raft_consensus.cc:3060] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.102298 10750 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:15.102885 10750 ts_tablet_manager.cc:1403] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.033s
W20260709 12:23:15.112386 11142 log.cc:927] Time spent T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
I20260709 12:23:15.112848 10752 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:15.113399 10752 ts_tablet_manager.cc:1403] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.319s	user 0.044s	sys 0.031s
I20260709 12:23:15.058893 10624 raft_consensus.cc:2468] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
W20260709 12:23:15.086128 10595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 48099.5us
I20260709 12:23:15.089236 11128 raft_consensus.cc:697] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:15.135937 10750 raft_consensus.cc:359] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.137315 10750 raft_consensus.cc:385] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.137579 10750 raft_consensus.cc:740] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.139045 10750 consensus_queue.cc:260] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.141458 10750 ts_tablet_manager.cc:1434] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:23:15.141332 11128 consensus_queue.cc:237] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.142467 10750 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7: Bootstrap starting.
I20260709 12:23:15.156782 10750 tablet_bootstrap.cc:654] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.169281 10752 raft_consensus.cc:359] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.170046 10752 raft_consensus.cc:385] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.170331 10752 raft_consensus.cc:740] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.171731 10752 consensus_queue.cc:260] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.175856 10752 ts_tablet_manager.cc:1434] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 12:23:15.190184 10841 consensus_queue.cc:1048] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:15.190925 10752 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:15.203997 10752 tablet_bootstrap.cc:654] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.206554 10753 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.207507 10753 ts_tablet_manager.cc:1403] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.412s	user 0.020s	sys 0.020s
I20260709 12:23:15.206179 11037 raft_consensus.cc:515] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.213528 10753 raft_consensus.cc:359] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.214216 10753 raft_consensus.cc:385] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.214489 10753 raft_consensus.cc:740] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.214766 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c862ff91f7484100b8a72ae26d09b8c1" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:15.215168 10753 consensus_queue.cc:260] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.216593 10476 raft_consensus.cc:3060] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.217805 10749 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:15.218170 10753 ts_tablet_manager.cc:1434] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:15.218349 10749 ts_tablet_manager.cc:1403] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.251s	user 0.010s	sys 0.005s
I20260709 12:23:15.222368 10753 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.224910 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c862ff91f7484100b8a72ae26d09b8c1" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:15.225553 10701 raft_consensus.cc:3060] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.236933 10749 raft_consensus.cc:359] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.238039 10749 raft_consensus.cc:385] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.238386 10749 raft_consensus.cc:740] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.242311 10701 raft_consensus.cc:2468] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:15.248256 10519 leader_election.cc:304] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:15.248870 11125 raft_consensus.cc:493] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.249279 11131 raft_consensus.cc:2804] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.249867 11131 raft_consensus.cc:697] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:15.249578 11125 raft_consensus.cc:515] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.250805 11131 consensus_queue.cc:237] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.218140 11037 leader_election.cc:290] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.257189 10749 consensus_queue.cc:260] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.264891 10749 ts_tablet_manager.cc:1434] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:23:15.265599 10750 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7: No bootstrap required, opened a new log
I20260709 12:23:15.266144 10750 ts_tablet_manager.cc:1403] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.006s
I20260709 12:23:15.268705 11125 leader_election.cc:290] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:15.270428 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204fe73f2004e518c32b6310ee18b82" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:15.272909 10750 raft_consensus.cc:359] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.273653 10750 raft_consensus.cc:385] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.273936 10750 raft_consensus.cc:740] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.273149 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204fe73f2004e518c32b6310ee18b82" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:15.274567 10750 consensus_queue.cc:260] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:15.275343 10594 leader_election.cc:343] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:15.276356 10595 consensus_peers.cc:597] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:15.277276 10595 leader_election.cc:343] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.277880 10476 raft_consensus.cc:2468] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:15.277843 10595 leader_election.cc:304] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:15.281088 11078 raft_consensus.cc:2749] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.287468 10750 ts_tablet_manager.cc:1434] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
W20260709 12:23:15.299706 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:15.303074 10749 tablet_bootstrap.cc:492] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:15.303332 10753 tablet_bootstrap.cc:654] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.302009 11038 raft_consensus.cc:493] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.308689 11038 raft_consensus.cc:515] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.309741 10752 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:15.310246 10752 ts_tablet_manager.cc:1403] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.020s
I20260709 12:23:15.311937 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:15.313388 10517 leader_election.cc:343] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.313032 10752 raft_consensus.cc:359] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.315165 10752 raft_consensus.cc:385] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.315475 10752 raft_consensus.cc:740] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.315824 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:15.316443 10629 raft_consensus.cc:2468] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:15.317759 10520 leader_election.cc:304] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.318521 11038 leader_election.cc:290] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:15.319185 11125 raft_consensus.cc:493] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.319717 11125 raft_consensus.cc:515] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.320416 10752 consensus_queue.cc:260] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.319406 11038 raft_consensus.cc:2804] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.321910 11125 leader_election.cc:290] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:15.322301 11038 raft_consensus.cc:493] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.322705 10752 ts_tablet_manager.cc:1434] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:15.322652 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.322731 11038 raft_consensus.cc:3060] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.323920 10752 tablet_bootstrap.cc:492] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:15.324033 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
W20260709 12:23:15.324241 10592 leader_election.cc:343] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:15.325790 10595 leader_election.cc:343] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.326231 10595 leader_election.cc:304] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.320096 10749 tablet_bootstrap.cc:654] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.327371 11078 raft_consensus.cc:2749] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.331243 11078 raft_consensus.cc:493] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.331717 11078 raft_consensus.cc:515] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.332113 11128 raft_consensus.cc:493] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.332614 11128 raft_consensus.cc:515] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.332317 10373 catalog_manager.cc:5697] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.333326 10752 tablet_bootstrap.cc:654] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.333894 11078 leader_election.cc:290] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.334762 11128 leader_election.cc:290] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.337495 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:15.336841 10376 catalog_manager.cc:5697] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:15.342891 10594 leader_election.cc:343] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becf98b94b704731a507d96d1a44737c (127.3.7.132:42917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.339823 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.344025 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:15.344918 10629 raft_consensus.cc:2468] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:15.346505 10669 leader_election.cc:304] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:15.347267 11124 raft_consensus.cc:2804] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.347671 11124 raft_consensus.cc:493] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.348023 11124 raft_consensus.cc:3060] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:15.352399 10666 leader_election.cc:343] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.355249 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
W20260709 12:23:15.357621 10592 leader_election.cc:343] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.358053 10592 leader_election.cc:304] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:15.358433 11124 raft_consensus.cc:515] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.358632 11125 consensus_queue.cc:1048] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.360201 11125 raft_consensus.cc:2749] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.360730 11124 leader_election.cc:290] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.367969 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:15.368683 10627 raft_consensus.cc:3060] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.370937 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
W20260709 12:23:15.372476 10666 leader_election.cc:343] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.377911 10627 raft_consensus.cc:2468] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:15.380968 10669 leader_election.cc:304] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.381791 11124 raft_consensus.cc:2804] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.382231 11124 raft_consensus.cc:697] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:15.382977 11124 consensus_queue.cc:237] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.384100 11038 raft_consensus.cc:515] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.397480 10753 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.398192 10753 ts_tablet_manager.cc:1403] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.001s
I20260709 12:23:15.407171 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
W20260709 12:23:15.410745 10517 leader_election.cc:343] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.416460 10753 raft_consensus.cc:359] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.417436 10753 raft_consensus.cc:385] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.417816 10753 raft_consensus.cc:740] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.418749 10753 consensus_queue.cc:260] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.431602 11130 consensus_queue.cc:1048] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:15.434176 10749 tablet_bootstrap.cc:492] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:15.434691 10749 ts_tablet_manager.cc:1403] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.018s
I20260709 12:23:15.437505 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:15.438110 10629 raft_consensus.cc:3060] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.438274 10749 raft_consensus.cc:359] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.438977 10749 raft_consensus.cc:385] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.442660 11132 consensus_queue.cc:1048] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.429693 11038 leader_election.cc:290] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:15.439227 10749 raft_consensus.cc:740] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.447118 10629 raft_consensus.cc:2468] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:15.447573 10753 ts_tablet_manager.cc:1434] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:23:15.445753 10749 consensus_queue.cc:260] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.458601 10752 tablet_bootstrap.cc:492] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:15.448948 11038 raft_consensus.cc:493] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.474851 10752 ts_tablet_manager.cc:1403] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.151s	user 0.005s	sys 0.015s
I20260709 12:23:15.475044 11038 raft_consensus.cc:515] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.477845 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:15.478438 10703 raft_consensus.cc:2468] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:15.477612 10752 raft_consensus.cc:359] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.482064 10752 raft_consensus.cc:385] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.482442 10752 raft_consensus.cc:740] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.483235 10519 leader_election.cc:304] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:15.464500 10520 leader_election.cc:304] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.484934 11123 raft_consensus.cc:2804] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.485430 11123 raft_consensus.cc:697] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:15.486245 11123 consensus_queue.cc:237] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.487951 10841 raft_consensus.cc:2804] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.488472 10841 raft_consensus.cc:493] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.488874 10841 raft_consensus.cc:3060] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.489943 11038 leader_election.cc:290] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.455693 10753 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.500635 11131 consensus_queue.cc:1048] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.503006 10841 raft_consensus.cc:515] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.504273 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.504966 10476 raft_consensus.cc:2468] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:15.505446 10839 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.505918 10839 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.505992 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:15.468247 10749 ts_tablet_manager.cc:1434] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 12:23:15.506821 10703 raft_consensus.cc:3060] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.507658 10749 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:15.507876 10839 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:15.514120 10749 tablet_bootstrap.cc:654] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.506438 10753 tablet_bootstrap.cc:654] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.483235 10752 consensus_queue.cc:260] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.516652 10841 leader_election.cc:290] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.514014 10703 raft_consensus.cc:2468] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:15.520345 10519 leader_election.cc:304] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:15.520916 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:15.521590 11130 consensus_queue.cc:1048] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.517344 10752 ts_tablet_manager.cc:1434] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.042s	user 0.001s	sys 0.005s
I20260709 12:23:15.517860 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:15.522539 10478 raft_consensus.cc:3060] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.517014 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.523470 11123 raft_consensus.cc:2804] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.523974 11123 raft_consensus.cc:697] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:15.462939 10372 catalog_manager.cc:5697] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.524789 11123 consensus_queue.cc:237] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:15.531334 10666 leader_election.cc:343] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.532133 10752 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: Bootstrap starting.
I20260709 12:23:15.532685 10749 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:15.533214 10749 ts_tablet_manager.cc:1403] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 12:23:15.530766 10478 raft_consensus.cc:2468] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:15.521994 10753 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.537053 10753 ts_tablet_manager.cc:1403] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.082s	user 0.004s	sys 0.008s
I20260709 12:23:15.538826 10373 catalog_manager.cc:5697] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.540063 10753 raft_consensus.cc:359] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.540762 10753 raft_consensus.cc:385] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.541018 10753 raft_consensus.cc:740] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.540620 10373 catalog_manager.cc:5697] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:15.541919 10669 leader_election.cc:343] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.545506 10752 tablet_bootstrap.cc:654] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.548481 10753 consensus_queue.cc:260] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.542354 10669 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.550983 10753 ts_tablet_manager.cc:1434] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:23:15.552039 10753 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.552199 10839 raft_consensus.cc:2749] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.562925 10752 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: No bootstrap required, opened a new log
I20260709 12:23:15.561100 10753 tablet_bootstrap.cc:654] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.563532 10752 ts_tablet_manager.cc:1403] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.004s
I20260709 12:23:15.566263 10752 raft_consensus.cc:359] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.566951 10752 raft_consensus.cc:385] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.567246 10752 raft_consensus.cc:740] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.567965 10752 consensus_queue.cc:260] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.569587 10749 raft_consensus.cc:359] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.570169 10752 ts_tablet_manager.cc:1434] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:15.579352 10749 raft_consensus.cc:385] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.581207 10749 raft_consensus.cc:740] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.582052 10749 consensus_queue.cc:260] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.586550 10749 ts_tablet_manager.cc:1434] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.000s
I20260709 12:23:15.588145 10749 tablet_bootstrap.cc:492] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:15.594916 10749 tablet_bootstrap.cc:654] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.600117 10753 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.600638 10753 ts_tablet_manager.cc:1403] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.012s
I20260709 12:23:15.603586 10753 raft_consensus.cc:359] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.604349 10753 raft_consensus.cc:385] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.604614 10753 raft_consensus.cc:740] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.605289 10753 consensus_queue.cc:260] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.607123 10753 ts_tablet_manager.cc:1434] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:15.612695 10373 catalog_manager.cc:5697] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.614459 10373 catalog_manager.cc:5697] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.617051 10753 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.624011 10753 tablet_bootstrap.cc:654] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.637451 10753 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.637948 10753 ts_tablet_manager.cc:1403] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.001s
I20260709 12:23:15.640776 10753 raft_consensus.cc:359] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.641431 10753 raft_consensus.cc:385] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.641697 10753 raft_consensus.cc:740] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.642331 10753 consensus_queue.cc:260] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.644542 10753 ts_tablet_manager.cc:1434] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:15.645553 10753 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.653643 10753 tablet_bootstrap.cc:654] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.659145 10753 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.659736 10753 ts_tablet_manager.cc:1403] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:23:15.662186 11038 consensus_queue.cc:1048] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.662426 10753 raft_consensus.cc:359] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.663237 10753 raft_consensus.cc:385] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.663563 10753 raft_consensus.cc:740] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.664283 10753 consensus_queue.cc:260] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.666513 10753 ts_tablet_manager.cc:1434] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:15.667325 10749 tablet_bootstrap.cc:492] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:15.667516 10753 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.667855 10749 ts_tablet_manager.cc:1403] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.033s
I20260709 12:23:15.670614 10749 raft_consensus.cc:359] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.671257 10749 raft_consensus.cc:385] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.671564 10749 raft_consensus.cc:740] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.672379 10749 consensus_queue.cc:260] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.674809 10753 tablet_bootstrap.cc:654] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.680517 10749 ts_tablet_manager.cc:1434] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:23:15.681969 10749 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:15.691018 10749 tablet_bootstrap.cc:654] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.701517 11130 consensus_queue.cc:1048] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:15.707670 10476 raft_consensus.cc:3060] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.751406 11131 consensus_queue.cc:1048] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:15.752871 10749 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:15.752871 10753 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.753466 10749 ts_tablet_manager.cc:1403] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.040s
I20260709 12:23:15.753815 10753 ts_tablet_manager.cc:1403] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.044s
I20260709 12:23:15.758698 10753 raft_consensus.cc:359] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.758728 10749 raft_consensus.cc:359] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.759464 10753 raft_consensus.cc:385] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.761154 10749 raft_consensus.cc:385] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.761210 10753 raft_consensus.cc:740] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.761480 10749 raft_consensus.cc:740] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.762025 10753 consensus_queue.cc:260] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.762161 10749 consensus_queue.cc:260] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.764439 10753 ts_tablet_manager.cc:1434] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:15.765431 10753 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.766778 10749 ts_tablet_manager.cc:1434] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:15.767810 10749 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:15.770895 10814 raft_consensus.cc:493] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.771407 10753 tablet_bootstrap.cc:654] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.771446 10814 raft_consensus.cc:515] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.773783 10814 leader_election.cc:290] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:15.774228 10749 tablet_bootstrap.cc:654] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.778955 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:15.788093 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c0dd6625ef4c2099f58370e62c08d8" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:15.789098 10629 raft_consensus.cc:2393] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:15.791275 10445 leader_election.cc:304] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:15.794812 10814 raft_consensus.cc:3060] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.799820 11130 raft_consensus.cc:493] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.800493 11130 raft_consensus.cc:515] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.802829 11130 leader_election.cc:290] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.803623 11008 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.804214 11008 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.806267 11008 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:15.808758 10476 raft_consensus.cc:3060] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.810165 10473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.812112 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:15.813098 10703 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:15.814963 10444 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:15.816136 11008 raft_consensus.cc:2804] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.816648 11008 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.818068 10555 raft_consensus.cc:3060] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.817693 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:15.817075 11008 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.819101 10550 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
W20260709 12:23:15.824019 10666 leader_election.cc:343] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.824595 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:15.825626 10625 raft_consensus.cc:2468] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
W20260709 12:23:15.803340 10519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 60940.5us
I20260709 12:23:15.831910 10669 leader_election.cc:304] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.833040 11130 raft_consensus.cc:2804] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.833441 11130 raft_consensus.cc:493] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.833786 11130 raft_consensus.cc:3060] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.840113 11042 consensus_queue.cc:1048] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:15.870417 11038 raft_consensus.cc:493] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.863233 11130 raft_consensus.cc:515] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.893427 11038 raft_consensus.cc:515] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.895288 11130 leader_election.cc:290] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:15.895677 11038 leader_election.cc:290] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:15.870744 10753 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:15.896462 10476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:15.896692 10753 ts_tablet_manager.cc:1403] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.131s	user 0.038s	sys 0.044s
I20260709 12:23:15.896593 10473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567db905aed4ca3af769c4464b8aa2f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.878782 11124 consensus_queue.cc:1048] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 12:23:15.898244 10666 leader_election.cc:343] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:15.897370 10473 raft_consensus.cc:2468] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:15.899593 10753 raft_consensus.cc:359] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.882767 10749 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:15.900362 10753 raft_consensus.cc:385] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.900719 10753 raft_consensus.cc:740] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.900830 10749 ts_tablet_manager.cc:1403] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.053s
I20260709 12:23:15.901659 10753 consensus_queue.cc:260] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.871982 11008 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.903733 10753 ts_tablet_manager.cc:1434] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:15.905750 10749 raft_consensus.cc:359] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.906404 10753 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:15.906458 10749 raft_consensus.cc:385] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:15.907013 10749 raft_consensus.cc:740] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:15.907667 10749 consensus_queue.cc:260] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.904398 11008 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:15.911443 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567db905aed4ca3af769c4464b8aa2f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:15.912297 10627 raft_consensus.cc:2468] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:15.915635 10753 tablet_bootstrap.cc:654] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:15.916083 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:15.916697 10629 raft_consensus.cc:3060] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.924575 10814 raft_consensus.cc:2749] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:15.925288 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:15.930142 10703 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.931027 11038 raft_consensus.cc:493] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.931578 11038 raft_consensus.cc:515] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.933768 11038 leader_election.cc:290] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:15.934827 10749 ts_tablet_manager.cc:1434] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:23:15.936192 10749 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: Bootstrap starting.
I20260709 12:23:15.904898 10517 leader_election.cc:304] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:15.952787 10839 raft_consensus.cc:493] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.956177 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:15.956809 10550 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.957504 10629 raft_consensus.cc:2468] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:15.953263 10839 raft_consensus.cc:515] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:15.961797 10703 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
W20260709 12:23:15.963119 10517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 58312.1us
I20260709 12:23:15.975359 10444 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:15.976388 10669 leader_election.cc:304] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:15.977530 11124 raft_consensus.cc:2804] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.977741 11008 raft_consensus.cc:2804] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:15.978243 11124 raft_consensus.cc:697] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:15.978365 11008 raft_consensus.cc:697] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:15.980182 10478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:15.980858 10478 raft_consensus.cc:2468] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:15.980681 11008 consensus_queue.cc:237] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:15.981945 11124 consensus_queue.cc:237] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:15.985133 11132 raft_consensus.cc:2804] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:15.985600 11132 raft_consensus.cc:493] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.985998 11132 raft_consensus.cc:3060] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:15.995385 11132 raft_consensus.cc:515] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:15.985864 10749 tablet_bootstrap.cc:654] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.002038 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:16.002848 10625 raft_consensus.cc:2468] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:16.004323 11132 leader_election.cc:290] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:16.009266 10517 leader_election.cc:304] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:16.010191 11038 raft_consensus.cc:2804] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.010645 11038 raft_consensus.cc:493] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.028092 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567db905aed4ca3af769c4464b8aa2f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:16.028954 10629 raft_consensus.cc:3060] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:16.041060 10666 consensus_peers.cc:597] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:16.035023 10839 leader_election.cc:290] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:16.011045 11038 raft_consensus.cc:3060] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.073141 10841 consensus_queue.cc:1048] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:23:16.042634 10629 raft_consensus.cc:2468] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:16.065322 10477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2567db905aed4ca3af769c4464b8aa2f" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:16.088840 10477 raft_consensus.cc:3060] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.123690 10477 raft_consensus.cc:2468] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:16.118680 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204fe73f2004e518c32b6310ee18b82" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:16.156036 11131 raft_consensus.cc:493] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5703388aa4f747c280bf93e578f6bad7)
I20260709 12:23:16.139092 10624 raft_consensus.cc:2468] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:16.156695 11131 raft_consensus.cc:515] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:16.141916 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204fe73f2004e518c32b6310ee18b82" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:16.158404 10669 leader_election.cc:304] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:16.136036 10520 leader_election.cc:304] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:16.163936 11132 raft_consensus.cc:2804] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.169780 10753 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:16.170351 10753 ts_tablet_manager.cc:1403] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.264s	user 0.027s	sys 0.108s
I20260709 12:23:16.171226 10749 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: No bootstrap required, opened a new log
I20260709 12:23:16.175032 10749 ts_tablet_manager.cc:1403] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: Time spent bootstrapping tablet: real 0.239s	user 0.024s	sys 0.027s
I20260709 12:23:16.175824 11132 raft_consensus.cc:697] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:16.179126 11132 consensus_queue.cc:237] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:16.160449 10552 raft_consensus.cc:2468] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 0.
I20260709 12:23:16.204685 10749 raft_consensus.cc:359] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.206051 10749 raft_consensus.cc:385] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.168473 11124 raft_consensus.cc:2804] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:16.207374 11195 log.cc:927] Time spent T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:23:16.207662 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3175d59583845a9aa8e63d4982cf0c0" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:16.211076 11124 raft_consensus.cc:493] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.175007 10550 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 1.
I20260709 12:23:16.215155 11124 raft_consensus.cc:3060] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.206055 11131 leader_election.cc:290] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:16.219353 10753 raft_consensus.cc:359] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:16.220175 10753 raft_consensus.cc:385] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:16.221371 10445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 173421us
I20260709 12:23:16.207450 10749 raft_consensus.cc:740] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.221902 10753 raft_consensus.cc:740] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.233631 10749 consensus_queue.cc:260] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.225175 10753 consensus_queue.cc:260] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:16.225162 11131 consensus_queue.cc:1048] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:23:16.260070 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3175d59583845a9aa8e63d4982cf0c0" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:16.310519 11194 raft_consensus.cc:493] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.428416 11194 raft_consensus.cc:515] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:16.430656 11194 leader_election.cc:290] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
W20260709 12:23:16.386937 10517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 127789us
W20260709 12:23:16.396840 10519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 159064us
I20260709 12:23:16.398742 11038 raft_consensus.cc:515] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:16.435913 11038 leader_election.cc:290] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:16.406816 10753 ts_tablet_manager.cc:1434] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.236s	user 0.008s	sys 0.000s
I20260709 12:23:16.221138 11037 consensus_queue.cc:1048] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 12:23:16.439247 10595 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 157580us
I20260709 12:23:16.443411 11123 consensus_queue.cc:1048] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:16.440295 10753 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:16.447853 10749 ts_tablet_manager.cc:1434] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: Time spent starting tablet: real 0.272s	user 0.017s	sys 0.013s
I20260709 12:23:16.463119 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:16.475124 10473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:16.475787 10473 raft_consensus.cc:3060] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.481526 11124 raft_consensus.cc:515] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
W20260709 12:23:16.487025 10666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 86502.5us
I20260709 12:23:16.492966 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204fe73f2004e518c32b6310ee18b82" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:16.493613 10552 raft_consensus.cc:3060] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.500845 11124 leader_election.cc:290] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:16.503269 10473 raft_consensus.cc:2468] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:16.504796 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a978264a6a14ca296d74a58c7d58705" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:16.518023 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8204fe73f2004e518c32b6310ee18b82" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:16.518664 10629 raft_consensus.cc:3060] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.521169 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:16.521953 10624 raft_consensus.cc:3060] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.522231 10552 raft_consensus.cc:2468] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:16.524279 10669 leader_election.cc:304] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:16.527232 10517 leader_election.cc:304] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:16.528014 10841 raft_consensus.cc:2804] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.528539 10841 raft_consensus.cc:697] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:16.529313 10841 consensus_queue.cc:237] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:16.528000 11207 raft_consensus.cc:2804] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.535526 11207 raft_consensus.cc:697] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:16.536347 10629 raft_consensus.cc:2468] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:16.536358 11207 consensus_queue.cc:237] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:16.549867 10371 catalog_manager.cc:5697] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.550700 11130 consensus_queue.cc:1048] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:16.556674 10666 consensus_peers.cc:597] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:16.572683 10445 leader_election.cc:304] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:16.577795 10520 leader_election.cc:304] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
I20260709 12:23:16.578732 10814 raft_consensus.cc:2749] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.582337 10753 tablet_bootstrap.cc:654] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.618425 10753 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:16.620774 10753 ts_tablet_manager.cc:1403] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.003s
I20260709 12:23:16.622881 11210 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.623550 11210 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.583444 11147 raft_consensus.cc:2749] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:16.646345 10474 raft_consensus.cc:3060] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:16.649991 10425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:16.650890 11210 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:16.652937 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:16.660778 10753 raft_consensus.cc:359] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.664165 10753 raft_consensus.cc:385] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.664245 10701 raft_consensus.cc:2468] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 0.
I20260709 12:23:16.664537 10753 raft_consensus.cc:740] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.665364 10753 consensus_queue.cc:260] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.667584 10753 ts_tablet_manager.cc:1434] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:23:16.674456 10753 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:16.686007 10753 tablet_bootstrap.cc:654] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:16.688097 11200 consensus_queue.cc:1048] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:16.692830 10814 consensus_queue.cc:1048] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:16.690564 10519 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:16.705039 11200 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.705647 11200 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.711380 10841 raft_consensus.cc:2804] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.711750 10841 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.712056 10841 raft_consensus.cc:3060] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.717892 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:16.718649 10702 raft_consensus.cc:2468] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 0.
I20260709 12:23:16.720804 10444 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:16.725258 10841 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.728827 10841 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:16.730782 11200 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:16.738633 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:16.744398 11202 raft_consensus.cc:2804] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:16.804950 11202 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.805261 10550 raft_consensus.cc:2393] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:16.805433 11202 raft_consensus.cc:3060] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.753705 10473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:16.764899 11038 consensus_queue.cc:1048] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:16.810350 11132 consensus_queue.cc:1048] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:16.758006 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:16.813984 10702 raft_consensus.cc:3060] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.755216 10624 raft_consensus.cc:2468] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:16.793817 10472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:16.833139 11202 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.834896 10473 raft_consensus.cc:2393] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2da3f34a85954a319ed87fd378e5e661 in current term 1: Already voted for candidate bb8b600238cd49d29a1bd59a571ab995 in this term.
I20260709 12:23:16.839532 11202 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:16.840691 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:16.841698 10550 raft_consensus.cc:2393] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8b600238cd49d29a1bd59a571ab995 in current term 1: Already voted for candidate 2da3f34a85954a319ed87fd378e5e661 in this term.
I20260709 12:23:16.844336 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:16.846017 10444 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:16.850274 11200 raft_consensus.cc:2749] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:16.867835 10702 raft_consensus.cc:2468] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:16.871893 10519 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:16.873118 11131 raft_consensus.cc:2804] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:16.873600 11131 raft_consensus.cc:697] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:16.874373 11131 consensus_queue.cc:237] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:16.895748 10753 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: No bootstrap required, opened a new log
I20260709 12:23:16.896281 10753 ts_tablet_manager.cc:1403] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.222s	user 0.014s	sys 0.008s
I20260709 12:23:16.910665 10753 raft_consensus.cc:359] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:16.911432 10753 raft_consensus.cc:385] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:16.911698 10753 raft_consensus.cc:740] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:16.913578 10753 consensus_queue.cc:260] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:16.919368 10372 catalog_manager.cc:5697] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.921682 10473 raft_consensus.cc:3060] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:16.922605 10753 ts_tablet_manager.cc:1434] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:23:16.936619 10374 catalog_manager.cc:5697] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.947127 10373 catalog_manager.cc:5697] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 0 to 1, leader changed from <none> to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 1 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.963084 10374 catalog_manager.cc:5697] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:16.965215 10374 catalog_manager.cc:5697] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.009728 11132 consensus_queue.cc:1048] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.022017 11132 consensus_queue.cc:1048] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.028872 11042 consensus_queue.cc:1048] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.060683 11207 consensus_queue.cc:1048] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:17.299908 11210 consensus_queue.cc:1048] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.312137 11132 consensus_queue.cc:1048] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.973384  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
W20260709 12:23:19.013697 10517 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 210 similar messages]
W20260709 12:23:19.200300 10517 consensus_peers.cc:597] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.202209 10517 consensus_peers.cc:597] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.203191 10517 consensus_peers.cc:597] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.204834 10517 consensus_peers.cc:597] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.205440 10517 consensus_peers.cc:597] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.206182 10517 consensus_peers.cc:597] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.212312 10445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 52881.7us
W20260709 12:23:19.207036 10517 consensus_peers.cc:597] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.220830 10517 consensus_peers.cc:597] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.221369 10517 consensus_peers.cc:597] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.221999 10517 consensus_peers.cc:597] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.222587 10517 consensus_peers.cc:597] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.230085 10666 consensus_peers.cc:597] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.231345 10592 consensus_peers.cc:597] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.231614 10666 consensus_peers.cc:597] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.232067 10592 consensus_peers.cc:597] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.232322 10666 consensus_peers.cc:597] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.232928 10666 consensus_peers.cc:597] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.243619 10666 consensus_peers.cc:597] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.247931 10666 consensus_peers.cc:597] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.248554 10666 consensus_peers.cc:597] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.249109 10666 consensus_peers.cc:597] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.249681 10666 consensus_peers.cc:597] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.255784 10666 consensus_peers.cc:597] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.255946 10517 consensus_peers.cc:597] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.259703  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:19.260728  3102 tablet_replica.cc:333] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.261662  3102 raft_consensus.cc:2243] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.262724  3102 raft_consensus.cc:2272] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.267184  3102 tablet_replica.cc:333] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.268188  3102 raft_consensus.cc:2243] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.269666  3102 raft_consensus.cc:2272] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.273257  3102 tablet_replica.cc:333] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.273963  3102 raft_consensus.cc:2243] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.274430  3102 raft_consensus.cc:2272] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.276577  3102 tablet_replica.cc:333] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.277258  3102 raft_consensus.cc:2243] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.277985  3102 raft_consensus.cc:2272] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.280915  3102 tablet_replica.cc:333] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.281937  3102 raft_consensus.cc:2243] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.282809  3102 raft_consensus.cc:2272] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.285828  3102 tablet_replica.cc:333] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.286461  3102 raft_consensus.cc:2243] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.287035  3102 raft_consensus.cc:2272] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.289464  3102 tablet_replica.cc:333] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.290123  3102 raft_consensus.cc:2243] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.290638  3102 raft_consensus.cc:2272] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.293825  3102 tablet_replica.cc:333] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.294868  3102 raft_consensus.cc:2243] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.295666  3102 raft_consensus.cc:2272] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.299050  3102 tablet_replica.cc:333] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.300215  3102 raft_consensus.cc:2243] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.301054  3102 raft_consensus.cc:2272] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.303736  3102 tablet_replica.cc:333] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.304436  3102 raft_consensus.cc:2243] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.305291  3102 raft_consensus.cc:2272] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.309126  3102 tablet_replica.cc:333] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.310070  3102 raft_consensus.cc:2243] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.310959  3102 raft_consensus.cc:2272] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.314829  3102 tablet_replica.cc:333] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.315802  3102 raft_consensus.cc:2243] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.316471  3102 raft_consensus.cc:2272] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.319483  3102 tablet_replica.cc:333] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.320188  3102 raft_consensus.cc:2243] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.320654  3102 raft_consensus.cc:2272] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.322731  3102 tablet_replica.cc:333] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.323470  3102 raft_consensus.cc:2243] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.324307  3102 raft_consensus.cc:2272] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.326977  3102 tablet_replica.cc:333] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.328068  3102 raft_consensus.cc:2243] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.328850  3102 raft_consensus.cc:2272] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.331964  3102 tablet_replica.cc:333] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.332803  3102 raft_consensus.cc:2243] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.333379  3102 raft_consensus.cc:2272] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.335882  3102 tablet_replica.cc:333] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.336720  3102 raft_consensus.cc:2243] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.337492  3102 raft_consensus.cc:2272] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.341056  3102 tablet_replica.cc:333] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.341624  3102 raft_consensus.cc:2243] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.342144  3102 raft_consensus.cc:2272] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.345367  3102 tablet_replica.cc:333] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.346392  3102 raft_consensus.cc:2243] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.347864  3102 raft_consensus.cc:2272] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.348922 10666 consensus_peers.cc:597] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.350634  3102 tablet_replica.cc:333] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.351862  3102 raft_consensus.cc:2243] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.352411  3102 raft_consensus.cc:2272] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.355504  3102 tablet_replica.cc:333] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.356518  3102 raft_consensus.cc:2243] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.357278  3102 raft_consensus.cc:2272] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.357657 10666 consensus_peers.cc:597] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.360273  3102 tablet_replica.cc:333] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
W20260709 12:23:19.360550 10517 consensus_peers.cc:597] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.361112  3102 raft_consensus.cc:2243] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.361783  3102 raft_consensus.cc:2272] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.364074  3102 tablet_replica.cc:333] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.364720  3102 raft_consensus.cc:2243] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.365640  3102 raft_consensus.cc:2272] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.368571  3102 tablet_replica.cc:333] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.369465  3102 raft_consensus.cc:2243] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.370397  3102 raft_consensus.cc:2272] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.372078 10517 consensus_peers.cc:597] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.372228 10666 consensus_peers.cc:597] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.373541  3102 tablet_replica.cc:333] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.374212  3102 raft_consensus.cc:2243] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.375008  3102 raft_consensus.cc:2272] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.378074  3102 tablet_replica.cc:333] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.378721  3102 raft_consensus.cc:2243] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.379235  3102 raft_consensus.cc:2272] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.381840  3102 tablet_replica.cc:333] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.382454  3102 raft_consensus.cc:2243] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.382939  3102 raft_consensus.cc:2272] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.385344  3102 tablet_replica.cc:333] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.385890  3102 raft_consensus.cc:2243] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.386408  3102 raft_consensus.cc:2272] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.389612  3102 tablet_replica.cc:333] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.390456  3102 raft_consensus.cc:2243] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.391259  3102 raft_consensus.cc:2272] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.392637 10517 consensus_peers.cc:597] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.394567  3102 tablet_replica.cc:333] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.395260  3102 raft_consensus.cc:2243] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.395910  3102 raft_consensus.cc:2272] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.399466  3102 tablet_replica.cc:333] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.400297  3102 raft_consensus.cc:2243] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.401710  3102 raft_consensus.cc:2272] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.404294 10517 consensus_peers.cc:597] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.404937  3102 tablet_replica.cc:333] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
W20260709 12:23:19.405439 10517 consensus_peers.cc:597] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.405840  3102 raft_consensus.cc:2243] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.406682  3102 raft_consensus.cc:2272] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.407853 10517 consensus_peers.cc:597] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:19.409293 10517 consensus_peers.cc:597] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.409904  3102 tablet_replica.cc:333] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.410842  3102 raft_consensus.cc:2243] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.411552  3102 raft_consensus.cc:2272] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.414475  3102 tablet_replica.cc:333] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.415084  3102 raft_consensus.cc:2243] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.415732  3102 raft_consensus.cc:2272] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.418655  3102 tablet_replica.cc:333] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.419263  3102 raft_consensus.cc:2243] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.419919  3102 raft_consensus.cc:2272] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.423297  3102 tablet_replica.cc:333] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.424057  3102 raft_consensus.cc:2243] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.425381  3102 raft_consensus.cc:2272] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.426358 10592 consensus_peers.cc:597] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.428695  3102 tablet_replica.cc:333] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.429422  3102 raft_consensus.cc:2243] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.430631  3102 raft_consensus.cc:2272] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.432837  3102 tablet_replica.cc:333] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.433660  3102 raft_consensus.cc:2243] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:19.434763  3102 raft_consensus.cc:2272] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.437395 10592 consensus_peers.cc:597] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.437711  3102 tablet_replica.cc:333] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.438364  3102 raft_consensus.cc:2243] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.438866  3102 raft_consensus.cc:2272] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.440915  3102 tablet_replica.cc:333] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.441450  3102 raft_consensus.cc:2243] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.441883  3102 raft_consensus.cc:2272] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.443814  3102 tablet_replica.cc:333] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.444393  3102 raft_consensus.cc:2243] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.444871  3102 raft_consensus.cc:2272] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.447784  3102 tablet_replica.cc:333] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.448593  3102 raft_consensus.cc:2243] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.449918  3102 raft_consensus.cc:2272] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.452739  3102 tablet_replica.cc:333] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.453435  3102 raft_consensus.cc:2243] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.453934  3102 raft_consensus.cc:2272] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.457448  3102 tablet_replica.cc:333] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.458319  3102 raft_consensus.cc:2243] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.458880  3102 raft_consensus.cc:2272] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:19.461339  3102 tablet_replica.cc:333] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: stopping tablet replica
I20260709 12:23:19.461870  3102 raft_consensus.cc:2243] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:19.462332  3102 raft_consensus.cc:2272] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:19.602483 10517 connection.cc:573] client connection to 127.3.7.129:45267 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:23:19.607043  3102 connection.cc:466] server connection from 127.0.0.1:44662 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44662 (request call id 331) could send its response
I20260709 12:23:19.630792  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
I20260709 12:23:19.753862  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:19.763149 11258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:19.765638 11259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:19.767566  3102 server_base.cc:1061] running on GCE node
W20260709 12:23:19.767860 11261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:19.771883  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:19.772157  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:19.772359  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599799772345 us; error 0 us; skew 500 ppm
I20260709 12:23:19.773056  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:19.780961  3102 webserver.cc:533] Webserver started at http://127.3.7.129:38985/ using document root <none> and password file <none>
I20260709 12:23:19.781725  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:19.781976  3102 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:23:19.789207  3102 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:23:19.804235 11266 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:19.805270  3102 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:19.805753  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "bb8b600238cd49d29a1bd59a571ab995"
format_stamp: "Formatted at 2026-07-09 12:23:05 on dist-test-slave-6qf7"
I20260709 12:23:19.806490  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:19.839955  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:19.844962  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:19.852442  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:19.866839 11273 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:23:20.156899  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:23:20.157294  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.297s	user 0.008s	sys 0.001s
I20260709 12:23:20.157689  3102 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:23:20.163641 11273 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.182979 11273 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.184125 11273 tablet_bootstrap.cc:492] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.184903 11273 ts_tablet_manager.cc:1403] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:23:20.188269 11273 raft_consensus.cc:359] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.189404 11273 raft_consensus.cc:740] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.190362 11273 consensus_queue.cc:260] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.193655 11273 ts_tablet_manager.cc:1434] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:23:20.194487 11273 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.212191 11273 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.213109 11273 tablet_bootstrap.cc:492] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.213778 11273 ts_tablet_manager.cc:1403] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 12:23:20.216336 11273 raft_consensus.cc:359] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.217029 11273 raft_consensus.cc:740] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.217712 11273 consensus_queue.cc:260] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.219595 11273 ts_tablet_manager.cc:1434] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:23:20.220399 11273 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.235186 11273 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.236193 11273 tablet_bootstrap.cc:492] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.236835 11273 ts_tablet_manager.cc:1403] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:23:20.239238 11273 raft_consensus.cc:359] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.239959 11273 raft_consensus.cc:740] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.240772 11273 consensus_queue.cc:260] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.242542 11273 ts_tablet_manager.cc:1434] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:20.243547 11273 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.259723 11273 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.260728 11273 tablet_bootstrap.cc:492] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.261413 11273 ts_tablet_manager.cc:1403] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:23:20.263985 11273 raft_consensus.cc:359] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.264706 11273 raft_consensus.cc:740] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.265534 11273 consensus_queue.cc:260] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.267544 11273 ts_tablet_manager.cc:1434] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:20.268359 11273 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.284060 11273 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.285055 11273 tablet_bootstrap.cc:492] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.285727 11273 ts_tablet_manager.cc:1403] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:23:20.288378 11273 raft_consensus.cc:359] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.289086 11273 raft_consensus.cc:740] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.289867 11273 consensus_queue.cc:260] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.292002 11273 ts_tablet_manager.cc:1434] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:20.292830 11273 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.311753 11273 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.312638 11273 tablet_bootstrap.cc:492] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.313344 11273 ts_tablet_manager.cc:1403] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:23:20.316139 11273 raft_consensus.cc:359] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.316907 11273 raft_consensus.cc:740] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.317657 11273 consensus_queue.cc:260] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.320202 11273 ts_tablet_manager.cc:1434] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:20.320948 11273 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.339314 11273 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.340366 11273 tablet_bootstrap.cc:492] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.341043 11273 ts_tablet_manager.cc:1403] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:23:20.343698 11273 raft_consensus.cc:359] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.344440 11273 raft_consensus.cc:740] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.345274 11273 consensus_queue.cc:260] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.347618 11273 ts_tablet_manager.cc:1434] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:20.348531 11273 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.364986 11273 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.366037 11273 tablet_bootstrap.cc:492] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.366760 11273 ts_tablet_manager.cc:1403] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:23:20.369397 11273 raft_consensus.cc:359] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.370139 11273 raft_consensus.cc:740] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.370850 11273 consensus_queue.cc:260] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.373036 11273 ts_tablet_manager.cc:1434] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:20.373878 11273 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.389286 11273 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.390297 11273 tablet_bootstrap.cc:492] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.390966 11273 ts_tablet_manager.cc:1403] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:23:20.393653 11273 raft_consensus.cc:359] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.394353 11273 raft_consensus.cc:740] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.395107 11273 consensus_queue.cc:260] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.397830 11273 ts_tablet_manager.cc:1434] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.010s	sys 0.000s
I20260709 12:23:20.398747 11273 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.427253 11273 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.428349 11273 tablet_bootstrap.cc:492] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.429050 11273 ts_tablet_manager.cc:1403] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 12:23:20.431811 11273 raft_consensus.cc:359] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.432566 11273 raft_consensus.cc:740] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.433441 11273 consensus_queue.cc:260] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.435706 11273 ts_tablet_manager.cc:1434] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:20.436532 11273 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.451076  3102 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:23:20.451532  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.294s	user 0.286s	sys 0.008s
I20260709 12:23:20.451674 11273 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.452711 11273 tablet_bootstrap.cc:492] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.453274 11273 ts_tablet_manager.cc:1403] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:23:20.455685 11273 raft_consensus.cc:359] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.456406 11273 raft_consensus.cc:740] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.457144 11273 consensus_queue.cc:260] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.459134 11273 ts_tablet_manager.cc:1434] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:20.459478 11207 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.460107 11273 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.460022 11207 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.462533 11207 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.467393 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:20.478798 11244 raft_consensus.cc:493] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.479611 11244 raft_consensus.cc:515] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.482635 11244 leader_election.cc:290] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.490185 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:20.500787 10666 leader_election.cc:336] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.501643 10666 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.502866 11207 raft_consensus.cc:2749] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:20.504101 10592 leader_election.cc:336] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.509680 10594 leader_election.cc:304] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:20.512215 11209 raft_consensus.cc:2749] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:20.513163 11209 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.513842 11209 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.522250 11209 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:20.548902 10520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 59862.7us
W20260709 12:23:20.554977 10592 leader_election.cc:336] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.558521 11273 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.559605 11273 tablet_bootstrap.cc:492] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.560360 11273 ts_tablet_manager.cc:1403] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.052s
I20260709 12:23:20.563352 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:20.564815 11273 raft_consensus.cc:359] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.565579 11273 raft_consensus.cc:740] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.566296 11273 consensus_queue.cc:260] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.568349 11273 ts_tablet_manager.cc:1434] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:20.569134 11273 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.571949 10595 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.573804 11244 raft_consensus.cc:2749] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:20.588088 11273 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.589185 11273 tablet_bootstrap.cc:492] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.589879 11273 ts_tablet_manager.cc:1403] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:23:20.592600 11273 raft_consensus.cc:359] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.593336 11273 raft_consensus.cc:740] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.594050 11273 consensus_queue.cc:260] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.595901 11273 ts_tablet_manager.cc:1434] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:20.596563 11273 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.617214 11292 raft_consensus.cc:493] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.617889 11292 raft_consensus.cc:515] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.619030 11296 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.619705 11296 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.620203 11292 leader_election.cc:290] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.620851 11273 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.621359 11132 raft_consensus.cc:493] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.621940 11132 raft_consensus.cc:515] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.621960 11273 tablet_bootstrap.cc:492] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.623644 11273 ts_tablet_manager.cc:1403] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.004s
I20260709 12:23:20.624254 11132 leader_election.cc:290] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:20.626556 11273 raft_consensus.cc:359] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.627424 11273 raft_consensus.cc:740] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.628448 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:20.629182 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
W20260709 12:23:20.630972 10517 leader_election.cc:336] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.630851 11244 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.631819 11244 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.628192 11273 consensus_queue.cc:260] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.632206 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:20.636559 11273 ts_tablet_manager.cc:1434] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:20.637504 11273 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.633006 11296 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:20.638697 10517 leader_election.cc:336] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.639140 10517 leader_election.cc:304] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.637426 10520 leader_election.cc:304] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.639887 11292 raft_consensus.cc:2749] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:20.640097 11251 raft_consensus.cc:2749] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:20.640658 10592 leader_election.cc:336] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.641003 11209 raft_consensus.cc:493] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.641583 11209 raft_consensus.cc:515] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
W20260709 12:23:20.643445 10517 leader_election.cc:336] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.644308 11209 leader_election.cc:290] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.644994 11242 raft_consensus.cc:493] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.643903 10517 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:20.645592 11242 raft_consensus.cc:515] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.647277 11296 raft_consensus.cc:2749] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:20.652900 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:20.647850 11242 leader_election.cc:290] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.653715 10550 raft_consensus.cc:2468] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:20.641563 11244 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.652313 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:20.656335 10595 leader_election.cc:304] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:20.657172 11244 raft_consensus.cc:2804] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.657548 11244 raft_consensus.cc:493] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.657893 11244 raft_consensus.cc:3060] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:20.660701 10592 leader_election.cc:336] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.661311 10592 leader_election.cc:304] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.664479 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:20.667836 10592 leader_election.cc:336] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.667917 11273 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.667932 11242 raft_consensus.cc:2749] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:20.669431 10702 raft_consensus.cc:2468] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:20.669713 11273 tablet_bootstrap.cc:492] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.670475 11273 ts_tablet_manager.cc:1403] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.000s
I20260709 12:23:20.672489 11296 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.673023 11296 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.673393 11273 raft_consensus.cc:359] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.674171 11273 raft_consensus.cc:740] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.674072 10594 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.675350 11242 raft_consensus.cc:2804] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.675146 11273 consensus_queue.cc:260] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.675591 11296 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.675786 11242 raft_consensus.cc:493] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.669001 11244 raft_consensus.cc:515] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.676290 11242 raft_consensus.cc:3060] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.678412 11273 ts_tablet_manager.cc:1434] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:20.678756 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea516217c42649acb0675e458549a1be" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:20.679430 10552 raft_consensus.cc:3060] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.683601 11132 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.684084 11132 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
W20260709 12:23:20.684607 10592 leader_election.cc:336] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.685412 11273 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.686014 11132 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:20.686427 11242 raft_consensus.cc:515] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:20.688737 10517 leader_election.cc:336] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.689805 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:20.690455 10625 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
W20260709 12:23:20.691547 10517 leader_election.cc:336] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.696192 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:20.698519 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5480174671f54c06a686c1598f36a6e6" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:20.699100 10703 raft_consensus.cc:3060] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.701304 10520 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.702587 11296 raft_consensus.cc:2804] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.703917 11296 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.704403 11296 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.706321 11242 leader_election.cc:290] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:20.707118 10592 leader_election.cc:336] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.717226 11273 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.718358 11273 tablet_bootstrap.cc:492] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.718818 10519 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:20.719075 11273 ts_tablet_manager.cc:1403] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.006s
I20260709 12:23:20.729133 11247 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.729929 11247 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.730419 11251 raft_consensus.cc:2749] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:20.732291 11273 raft_consensus.cc:359] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.733124 11273 raft_consensus.cc:740] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.734061 11273 consensus_queue.cc:260] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.734843 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:20.735831 10551 raft_consensus.cc:2468] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:20.736595 11273 ts_tablet_manager.cc:1434] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:20.736935 11247 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.737560 11273 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.726528 11242 raft_consensus.cc:493] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.738734 11242 raft_consensus.cc:515] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.737591 10669 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:20.741839 11242 leader_election.cc:290] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.719254 10552 raft_consensus.cc:2468] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:20.724855 11244 leader_election.cc:290] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.746807 10595 leader_election.cc:304] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.748343 11296 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.749614 11207 raft_consensus.cc:2804] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.750164 11207 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.750588 11207 raft_consensus.cc:3060] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:20.751952 10592 leader_election.cc:336] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.754249 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:20.726137 10703 raft_consensus.cc:2468] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:20.755642 10552 raft_consensus.cc:2468] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:20.757583 11296 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
W20260709 12:23:20.758708 10517 leader_election.cc:336] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.762910 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:20.763031 10595 leader_election.cc:304] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.764165 10625 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.764564 11242 raft_consensus.cc:2804] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.765293 11242 raft_consensus.cc:697] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:20.768297 11209 raft_consensus.cc:2804] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.768935 11209 raft_consensus.cc:493] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.769493 11209 raft_consensus.cc:3060] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.766691 11242 consensus_queue.cc:237] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.783465 10625 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 2.
I20260709 12:23:20.786814 11342 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.787412 11342 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.790771 11247 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.791527 11247 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:20.794783 10592 leader_election.cc:336] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.796413 11247 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.798098 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:20.800422 10552 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:20.801692 10669 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:20.803695 11247 raft_consensus.cc:2804] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.804126 11247 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.804966 11247 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.807188 10520 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.816583 11132 raft_consensus.cc:493] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.817768 11251 raft_consensus.cc:2804] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.817397 11247 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.818527 11251 raft_consensus.cc:697] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:20.819890 11251 consensus_queue.cc:237] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.821729 11342 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.822242 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:20.823031 10552 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.817456 11132 raft_consensus.cc:515] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.829931 11132 leader_election.cc:290] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:20.832787 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:20.833673 10625 raft_consensus.cc:2468] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 1.
I20260709 12:23:20.835430 10520 leader_election.cc:304] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:20.839573 11247 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.840718 11296 raft_consensus.cc:2804] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.841369 11296 raft_consensus.cc:493] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.841706 10552 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 2.
I20260709 12:23:20.841877 11296 raft_consensus.cc:3060] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.847965 10669 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:20.849171 11247 raft_consensus.cc:2804] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.850023 11247 raft_consensus.cc:697] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:20.851389 11247 consensus_queue.cc:237] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.856101 10373 catalog_manager.cc:5697] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:20.889281 10374 catalog_manager.cc:5697] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.895961 11209 raft_consensus.cc:515] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.901461 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3aa16e74031433c95a793a2a839503b" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:20.902189 10552 raft_consensus.cc:3060] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:20.904898 10517 leader_election.cc:336] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.910449 11207 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.918226 11247 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.918815 11247 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.919974 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:20.920574 10551 raft_consensus.cc:3060] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.920940 11273 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:20.913312 11333 raft_consensus.cc:493] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.915575 10594 leader_election.cc:304] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.922355 11342 raft_consensus.cc:2804] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.923170 11273 tablet_bootstrap.cc:492] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:20.922869 11342 raft_consensus.cc:697] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:20.922822 11333 raft_consensus.cc:515] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.924017 11273 ts_tablet_manager.cc:1403] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.187s	user 0.035s	sys 0.053s
I20260709 12:23:20.924261 11342 consensus_queue.cc:237] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.927117 11207 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.929832 10552 raft_consensus.cc:2468] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
W20260709 12:23:20.926788 10592 leader_election.cc:336] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.931269 11209 leader_election.cc:290] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:20.933255 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:20.933833 10703 raft_consensus.cc:2468] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 1.
I20260709 12:23:20.936605 11247 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.937319 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:20.938100 10625 raft_consensus.cc:2468] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:20.925645 11296 raft_consensus.cc:515] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:20.930814 11333 leader_election.cc:290] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:20.930682 11273 raft_consensus.cc:359] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.942145 11273 raft_consensus.cc:740] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:20.943603 10595 leader_election.cc:304] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.946269 10551 raft_consensus.cc:2468] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 2.
I20260709 12:23:20.942866 11273 consensus_queue.cc:260] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:20.947902 10669 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:20.948909 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e217311b654a3999a76cac4fed6129" candidate_uuid: "2da3f34a85954a319ed87fd378e5e661" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:20.949549 10624 raft_consensus.cc:3060] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.950817 11273 ts_tablet_manager.cc:1434] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:23:20.951857 11273 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:20.951684 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:20.952385 10629 raft_consensus.cc:2468] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 1.
I20260709 12:23:20.953683 11247 raft_consensus.cc:2804] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.954136 11247 raft_consensus.cc:697] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:20.954999 11247 consensus_queue.cc:237] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:20.957967 10669 leader_election.cc:304] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:20.961323 10669 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:20.962045 10594 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:20.967795 11207 raft_consensus.cc:2804] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.968468 11207 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.969022 11207 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.947106 11296 leader_election.cc:290] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 election: Requested vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:20.974555 11242 raft_consensus.cc:2804] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:20.983412 11242 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:20.983933 11242 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:20.985210 10666 leader_election.cc:336] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:20.986220 10666 leader_election.cc:336] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.993829 11339 raft_consensus.cc:2804] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.994428 11339 raft_consensus.cc:697] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:20.995580 10624 raft_consensus.cc:2468] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da3f34a85954a319ed87fd378e5e661 in term 2.
I20260709 12:23:20.995323 11339 consensus_queue.cc:237] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:21.002414 10666 leader_election.cc:336] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:20.999118 10520 leader_election.cc:304] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:21.004045 11292 raft_consensus.cc:2804] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.004601 11292 raft_consensus.cc:697] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Becoming Leader. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
W20260709 12:23:21.004243 10517 leader_election.cc:336] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:21.005493 11292 consensus_queue.cc:237] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
W20260709 12:23:21.006265 10666 leader_election.cc:336] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:21.007985 10666 leader_election.cc:336] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:21.009671 11352 raft_consensus.cc:2804] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:21.010169 11352 raft_consensus.cc:493] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:21.010568 11352 raft_consensus.cc:3060] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:21.008793 10666 leader_election.cc:336] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:21.023449 10519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 48468.6us
I20260709 12:23:21.025660 11207 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.029700 11207 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:21.036399 10372 catalog_manager.cc:5697] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 2 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.072293 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:21.103366 11273 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:23:21.108600 10520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 69814us
I20260709 12:23:21.089027 11242 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:21.116284 10666 leader_election.cc:336] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:21.117255 10625 raft_consensus.cc:2393] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate becf98b94b704731a507d96d1a44737c in current term 2: Already voted for candidate 5703388aa4f747c280bf93e578f6bad7 in this term.
I20260709 12:23:21.116250 11242 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:21.138970 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:21.139871 10702 raft_consensus.cc:2393] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5703388aa4f747c280bf93e578f6bad7 in current term 2: Already voted for candidate becf98b94b704731a507d96d1a44737c in this term.
I20260709 12:23:21.111234 11352 raft_consensus.cc:515] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.142671 10669 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
W20260709 12:23:21.151990 10592 leader_election.cc:336] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:21.152691 10592 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7; no voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c
I20260709 12:23:21.154213 11242 raft_consensus.cc:2749] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:21.156606 11352 leader_election.cc:290] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:21.157785 11273 tablet_bootstrap.cc:492] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:21.158834 11273 ts_tablet_manager.cc:1403] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.207s	user 0.025s	sys 0.015s
I20260709 12:23:21.166659 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "516058c81d8243688175010331c582ee" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:21.167083 11207 raft_consensus.cc:2749] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:21.167394 10627 raft_consensus.cc:3060] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:21.170666 10666 leader_election.cc:336] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:21.177139 10627 raft_consensus.cc:2468] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becf98b94b704731a507d96d1a44737c in term 2.
I20260709 12:23:21.179759 10669 leader_election.cc:304] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:21.182651 11352 raft_consensus.cc:2804] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.183461 11352 raft_consensus.cc:697] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Becoming Leader. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:21.185938 11352 consensus_queue.cc:237] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:21.187446 10592 consensus_peers.cc:597] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.162597 11273 raft_consensus.cc:359] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.194352 11273 raft_consensus.cc:740] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.196328 11273 consensus_queue.cc:260] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.203720 11273 ts_tablet_manager.cc:1434] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:23:21.210757 11273 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:21.225425 10372 catalog_manager.cc:5697] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.228506 10372 catalog_manager.cc:5697] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.233115 10551 raft_consensus.cc:1275] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.234757 11242 consensus_queue.cc:1048] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.239289 10374 catalog_manager.cc:5697] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "2da3f34a85954a319ed87fd378e5e661" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.258615 10627 raft_consensus.cc:1275] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer 2da3f34a85954a319ed87fd378e5e661: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:21.261382 10517 consensus_peers.cc:597] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.261613 11366 consensus_queue.cc:1048] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:21.279242 10517 consensus_peers.cc:597] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.285915 10519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 261508us
I20260709 12:23:21.368418 10374 catalog_manager.cc:5697] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 2 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.382210 10374 catalog_manager.cc:5697] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c reported cstate change: term changed from 1 to 2, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to becf98b94b704731a507d96d1a44737c (127.3.7.132). New cstate: current_term: 2 leader_uuid: "becf98b94b704731a507d96d1a44737c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:21.385779 10592 consensus_peers.cc:597] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:21.394891 10666 consensus_peers.cc:597] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.408203 11273 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:21.420198 11273 tablet_bootstrap.cc:492] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:21.421003 11273 ts_tablet_manager.cc:1403] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.016s
I20260709 12:23:21.434387 10551 raft_consensus.cc:1275] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer becf98b94b704731a507d96d1a44737c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.436102 11207 consensus_queue.cc:1048] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.437189 11273 raft_consensus.cc:359] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:21.441473 10592 consensus_peers.cc:597] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:21.438036 11273 raft_consensus.cc:740] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.446563 10704 raft_consensus.cc:1275] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.447881 10627 raft_consensus.cc:1275] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer 2da3f34a85954a319ed87fd378e5e661: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.449045 10550 raft_consensus.cc:1275] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.455018 11296 consensus_queue.cc:1048] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.451494 11273 consensus_queue.cc:260] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:21.450930  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:45267
I20260709 12:23:21.458238 11342 consensus_queue.cc:1048] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:21.454934 11242 consensus_queue.cc:1048] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:23:21.464206 11386 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:45267 every 8 connection(s)
I20260709 12:23:21.475406 11273 ts_tablet_manager.cc:1434] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:23:21.481021 11273 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:21.536557 11276 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.545061 11276 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:21.552282 11276 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:21.565138 10552 raft_consensus.cc:1275] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer becf98b94b704731a507d96d1a44737c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.606256 11359 consensus_queue.cc:1048] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:21.609166 11276 raft_consensus.cc:493] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.609864 11276 raft_consensus.cc:515] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:21.612402 11276 leader_election.cc:290] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:21.640098 11273 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:21.641809 11273 tablet_bootstrap.cc:492] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:21.642961 11273 ts_tablet_manager.cc:1403] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.001s
I20260709 12:23:21.646781 11273 raft_consensus.cc:359] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.647804 11273 raft_consensus.cc:740] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.648528 11273 consensus_queue.cc:260] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.650274 11273 ts_tablet_manager.cc:1434] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:23:21.651078 11273 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:21.660403 11322 raft_consensus.cc:3060] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:21.753721 10517 consensus_peers.cc:597] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.758103 10517 consensus_peers.cc:597] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.760236 10517 consensus_peers.cc:597] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.773427 10629 raft_consensus.cc:1275] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer becf98b94b704731a507d96d1a44737c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.775252 11333 consensus_queue.cc:1048] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.779807 11276 raft_consensus.cc:493] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.780331 11276 raft_consensus.cc:515] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:21.782497 11276 leader_election.cc:290] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:21.789798 11323 raft_consensus.cc:3060] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:21.798069 10517 consensus_peers.cc:597] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.798950 10517 consensus_peers.cc:597] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.799052 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
W20260709 12:23:21.802964 10517 consensus_peers.cc:597] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.803754 10517 consensus_peers.cc:597] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.811786 10517 consensus_peers.cc:597] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.816229 11323 raft_consensus.cc:1275] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Refusing update from remote peer becf98b94b704731a507d96d1a44737c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.827907 11322 raft_consensus.cc:1275] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Refusing update from remote peer 2da3f34a85954a319ed87fd378e5e661: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.850417 11276 raft_consensus.cc:493] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.850997 11276 raft_consensus.cc:515] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:21.854076 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:21.854156 11276 leader_election.cc:290] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:21.856137 11276 raft_consensus.cc:493] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.856663 11276 raft_consensus.cc:515] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:21.859737 11276 leader_election.cc:290] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:21.860170 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:21.862462 11393 heartbeater.cc:344] Connected to a master server at 127.3.7.190:35777
I20260709 12:23:21.863395 11276 raft_consensus.cc:493] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.863991 11276 raft_consensus.cc:515] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:21.866345 11276 leader_election.cc:290] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:21.867380 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:21.873597 11393 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:21.874346 11318 raft_consensus.cc:3060] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.874873 11393 heartbeater.cc:507] Master 127.3.7.190:35777 requested a full tablet report, sending...
W20260709 12:23:21.877563 10666 consensus_peers.cc:597] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.878674 10666 consensus_peers.cc:597] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.881515 11132 consensus_queue.cc:1048] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.884053 11333 consensus_queue.cc:1048] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:21.886497 10666 consensus_peers.cc:597] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.888981 10666 consensus_peers.cc:597] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.889966 10666 consensus_peers.cc:597] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.894517 11273 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:21.895550 11273 tablet_bootstrap.cc:492] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:21.896200 11273 ts_tablet_manager.cc:1403] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.245s	user 0.015s	sys 0.009s
I20260709 12:23:21.906585 11273 raft_consensus.cc:359] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:21.907375 11273 raft_consensus.cc:740] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.908331 11273 consensus_queue.cc:260] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:21.911687 11273 ts_tablet_manager.cc:1434] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:23:21.912992 11322 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.916847 11273 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
W20260709 12:23:21.921047 10517 consensus_peers.cc:597] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.922386 10517 consensus_peers.cc:597] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.924527 10517 consensus_peers.cc:597] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.925158 10517 consensus_peers.cc:597] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:21.929605 10517 consensus_peers.cc:597] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.941651 11318 raft_consensus.cc:1275] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Refusing update from remote peer becf98b94b704731a507d96d1a44737c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.944250 11333 consensus_queue.cc:1048] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.976312 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c771f43203d841dd8d4f4e999b6d360e" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:21.976765 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:21.980228 11320 raft_consensus.cc:3060] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.980264 10629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5703388aa4f747c280bf93e578f6bad7" is_pre_election: true
I20260709 12:23:21.986763 11315 raft_consensus.cc:3060] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.990137 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a83257d2814ade9d44473bff639778" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:21.989499 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c771f43203d841dd8d4f4e999b6d360e" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:21.990144 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:21.990209 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8799df3e4f34b99897048a5879fc688" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:21.989488 11270 leader_election.cc:304] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c
W20260709 12:23:21.996639 10517 consensus_peers.cc:597] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:21.996682 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a4197603f34f92bea91d9a4641abbd" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:21.997483 11276 raft_consensus.cc:2749] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:21.999087 10592 consensus_peers.cc:597] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:22.000566 11270 leader_election.cc:304] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:22.001341 11276 raft_consensus.cc:2749] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:22.001857 11270 leader_election.cc:304] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:22.003688 11276 raft_consensus.cc:2749] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:22.003120 11270 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:22.007630 11270 leader_election.cc:304] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:22.008736 11270 leader_election.cc:304] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:22.009347 11276 raft_consensus.cc:2749] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:22.009550 11411 raft_consensus.cc:2749] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:22.010149 11276 raft_consensus.cc:2749] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:22.099606 10374 ts_manager.cc:194] Re-registered known tserver with Master: bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:22.109738 11270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:42241, user_credentials={real_user=slave}} blocked reactor thread for 101077us
I20260709 12:23:22.110071 11273 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.112603 11273 tablet_bootstrap.cc:492] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.113436 11273 ts_tablet_manager.cc:1403] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.000s
I20260709 12:23:22.121713 11273 raft_consensus.cc:359] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:22.126492 11273 raft_consensus.cc:740] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.127418 11273 consensus_queue.cc:260] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:22.131074 11273 ts_tablet_manager.cc:1434] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:23:22.134122 11273 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.147718 11273 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.148694 11273 tablet_bootstrap.cc:492] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.149338 11273 ts_tablet_manager.cc:1403] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:23:22.158988 11273 raft_consensus.cc:359] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.160049 11273 raft_consensus.cc:740] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.160854 11273 consensus_queue.cc:260] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.167055 11273 ts_tablet_manager.cc:1434] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:22.168054 11273 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.189749 10374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57406
I20260709 12:23:22.196610 11393 heartbeater.cc:499] Master 127.3.7.190:35777 was elected leader, sending a full tablet report...
I20260709 12:23:22.197321 11273 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.198474 11273 tablet_bootstrap.cc:492] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.199175 11273 ts_tablet_manager.cc:1403] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:23:22.202525 11273 raft_consensus.cc:359] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.203332 11273 raft_consensus.cc:740] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.204085 11273 consensus_queue.cc:260] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.206310 11273 ts_tablet_manager.cc:1434] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:22.223402 11273 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.255537 11315 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.374302 11273 tablet_bootstrap.cc:700] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Time spent opening tablet: real 0.117s	user 0.030s	sys 0.041s
W20260709 12:23:22.450605 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 62481.8us
I20260709 12:23:22.451711 11273 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.469120 11273 tablet_bootstrap.cc:492] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.469882 11273 ts_tablet_manager.cc:1403] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.247s	user 0.045s	sys 0.077s
I20260709 12:23:22.485919 11273 raft_consensus.cc:359] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.486657 11273 raft_consensus.cc:740] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.487326 11273 consensus_queue.cc:260] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.502791 11273 ts_tablet_manager.cc:1434] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:23:22.528134 11273 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
W20260709 12:23:22.584923 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 115041us
I20260709 12:23:22.719947 11273 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.721096 11273 tablet_bootstrap.cc:492] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.721858 11273 ts_tablet_manager.cc:1403] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.194s	user 0.029s	sys 0.006s
I20260709 12:23:22.730451 11273 raft_consensus.cc:359] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.731171 11273 raft_consensus.cc:740] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.731851 11273 consensus_queue.cc:260] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.734175 11273 ts_tablet_manager.cc:1434] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:23:22.734999 11273 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.759747 11273 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.760636 11273 tablet_bootstrap.cc:492] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.761327 11273 ts_tablet_manager.cc:1403] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.002s
I20260709 12:23:22.763631 11273 raft_consensus.cc:359] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:22.764190 11273 raft_consensus.cc:740] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.764667 11273 consensus_queue.cc:260] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:22.766294 11273 ts_tablet_manager.cc:1434] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:22.767180 11273 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.779100 11273 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.780092 11273 tablet_bootstrap.cc:492] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.780675 11273 ts_tablet_manager.cc:1403] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.010s
I20260709 12:23:22.782541 11273 raft_consensus.cc:359] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.783070 11273 raft_consensus.cc:740] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.783674 11273 consensus_queue.cc:260] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.787130 11273 ts_tablet_manager.cc:1434] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:23:22.788697 11273 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.805552 11273 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.806512 11273 tablet_bootstrap.cc:492] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.807174 11273 ts_tablet_manager.cc:1403] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 12:23:22.809604 11273 raft_consensus.cc:359] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.810253 11273 raft_consensus.cc:740] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.810875 11273 consensus_queue.cc:260] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.812896 11273 ts_tablet_manager.cc:1434] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:22.814122 11273 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.833559 11273 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.834906 11273 tablet_bootstrap.cc:492] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.835645 11273 ts_tablet_manager.cc:1403] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:23:22.837870 11273 raft_consensus.cc:359] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.838593 11273 raft_consensus.cc:740] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.839465 11273 consensus_queue.cc:260] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.842036 11273 ts_tablet_manager.cc:1434] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:22.842907 11273 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.857131 11273 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.857976 11273 tablet_bootstrap.cc:492] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.858736 11273 ts_tablet_manager.cc:1403] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:23:22.860926 11273 raft_consensus.cc:359] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.861627 11273 raft_consensus.cc:740] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.862358 11273 consensus_queue.cc:260] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.864547 11273 ts_tablet_manager.cc:1434] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:22.865501 11273 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.879875 11273 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.880867 11273 tablet_bootstrap.cc:492] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.881606 11273 ts_tablet_manager.cc:1403] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:23:22.883697 11273 raft_consensus.cc:359] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.884347 11273 raft_consensus.cc:740] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.885025 11273 consensus_queue.cc:260] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.887511 11273 ts_tablet_manager.cc:1434] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:22.888947 11273 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.904341 11273 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.905055 11273 tablet_bootstrap.cc:492] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.905553 11273 ts_tablet_manager.cc:1403] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:23:22.907477 11273 raft_consensus.cc:359] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.907986 11273 raft_consensus.cc:740] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.908627 11273 consensus_queue.cc:260] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.910403 11273 ts_tablet_manager.cc:1434] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:22.911607 11273 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.926287 11273 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.927232 11273 tablet_bootstrap.cc:492] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.927866 11273 ts_tablet_manager.cc:1403] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:23:22.930019 11273 raft_consensus.cc:359] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.930517 11273 raft_consensus.cc:740] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.931095 11273 consensus_queue.cc:260] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:22.932571 11273 ts_tablet_manager.cc:1434] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:22.933652 11273 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.948483 11273 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.949493 11273 tablet_bootstrap.cc:492] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.950073 11273 ts_tablet_manager.cc:1403] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 12:23:22.952078 11273 raft_consensus.cc:359] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:22.952589 11273 raft_consensus.cc:740] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.953250 11273 consensus_queue.cc:260] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:22.954767 11273 ts_tablet_manager.cc:1434] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:22.955896 11273 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:22.975577 11273 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.976544 11273 tablet_bootstrap.cc:492] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:22.977200 11273 ts_tablet_manager.cc:1403] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 12:23:22.979703 11273 raft_consensus.cc:359] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.980432 11273 raft_consensus.cc:740] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.981027 11273 consensus_queue.cc:260] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:22.982219 11273 ts_tablet_manager.cc:1434] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:22.982857 11273 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.027911 11273 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.028959 11273 tablet_bootstrap.cc:492] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.029717 11273 ts_tablet_manager.cc:1403] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.016s
I20260709 12:23:23.032480 11273 raft_consensus.cc:359] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.033248 11273 raft_consensus.cc:740] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.034026 11273 consensus_queue.cc:260] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.037245 11273 ts_tablet_manager.cc:1434] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.008s
I20260709 12:23:23.038091 11273 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.052853 11273 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.053578 11273 tablet_bootstrap.cc:492] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.054096 11273 ts_tablet_manager.cc:1403] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:23:23.056044 11273 raft_consensus.cc:359] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.056528 11273 raft_consensus.cc:740] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.057083 11273 consensus_queue.cc:260] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.058619 11273 ts_tablet_manager.cc:1434] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:23:23.059526 11273 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.084117 11273 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.085167 11273 tablet_bootstrap.cc:492] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.085938 11273 ts_tablet_manager.cc:1403] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 12:23:23.088435 11273 raft_consensus.cc:359] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.089198 11273 raft_consensus.cc:740] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.089938 11273 consensus_queue.cc:260] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.092470 11273 ts_tablet_manager.cc:1434] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:23.095485 11273 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.109606 11273 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.110460 11273 tablet_bootstrap.cc:492] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.111132 11273 ts_tablet_manager.cc:1403] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:23:23.113560 11273 raft_consensus.cc:359] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.114073 11273 raft_consensus.cc:740] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.114663 11273 consensus_queue.cc:260] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:23.116472 11273 ts_tablet_manager.cc:1434] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:23.117624 11273 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.123513 11442 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.124094 11442 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.126543 11442 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:23.127275 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:23.127940 10701 raft_consensus.cc:2468] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:23.129565 10594 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:23.130501 11323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:23.132959 11439 raft_consensus.cc:2804] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:23.133366 11439 raft_consensus.cc:493] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.133694 11439 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:23.134078 10592 leader_election.cc:343] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.143528 11439 raft_consensus.cc:515] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.145879 11439 leader_election.cc:290] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 3 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:23.146730 11323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:23.146943 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73bbd93e93934a568405bc6dbe1d4877" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:23.147554 10701 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:23.147962 10592 leader_election.cc:343] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.148870 11273 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.149827 11273 tablet_bootstrap.cc:492] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.150475 11273 ts_tablet_manager.cc:1403] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.015s
I20260709 12:23:23.153055 11273 raft_consensus.cc:359] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:23.153811 11273 raft_consensus.cc:740] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.154433 11273 consensus_queue.cc:260] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:23.154811 10701 raft_consensus.cc:2468] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 3.
I20260709 12:23:23.156286 11273 ts_tablet_manager.cc:1434] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:23.157037 10594 leader_election.cc:304] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, becf98b94b704731a507d96d1a44737c; no voters: bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:23.157637 11273 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.157857 11439 raft_consensus.cc:2804] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:23.158386 11439 raft_consensus.cc:697] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 3 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:23.159185 11439 consensus_queue.cc:237] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.179883 10374 catalog_manager.cc:5697] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 1 to 3, leader changed from bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129) to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.183099 11273 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.184217 11273 tablet_bootstrap.cc:492] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.185127 11273 ts_tablet_manager.cc:1403] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 12:23:23.189741 11273 raft_consensus.cc:359] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.190369 11273 raft_consensus.cc:740] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.190900 11273 consensus_queue.cc:260] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.192977 11273 ts_tablet_manager.cc:1434] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:23:23.194151 11273 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.218647 11322 raft_consensus.cc:3060] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.219390 11273 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.220427 11273 tablet_bootstrap.cc:492] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.221076 11273 ts_tablet_manager.cc:1403] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 12:23:23.223879 11273 raft_consensus.cc:359] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.224561 11273 raft_consensus.cc:740] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.225351 11273 consensus_queue.cc:260] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.245273 11273 ts_tablet_manager.cc:1434] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.011s
I20260709 12:23:23.246140 11273 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.294260 11273 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.295408 11273 tablet_bootstrap.cc:492] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.296186 11273 ts_tablet_manager.cc:1403] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.015s
I20260709 12:23:23.298283 11273 raft_consensus.cc:359] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:23.299023 11273 raft_consensus.cc:740] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.299789 11273 consensus_queue.cc:260] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:23.301281 11273 ts_tablet_manager.cc:1434] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:23:23.301951 11273 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap starting.
I20260709 12:23:23.316542 11273 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.317466 11273 tablet_bootstrap.cc:492] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Bootstrap complete.
I20260709 12:23:23.318114 11273 ts_tablet_manager.cc:1403] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:23:23.320566 11273 raft_consensus.cc:359] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.321211 11273 raft_consensus.cc:740] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.321877 11273 consensus_queue.cc:260] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:23.323660 11273 ts_tablet_manager.cc:1434] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:23:23.620189 11322 raft_consensus.cc:3060] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.626626 11322 raft_consensus.cc:1275] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:23.628296 11442 consensus_queue.cc:1048] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:23.810389 10592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:45267, user_credentials={real_user=slave}} blocked reactor thread for 120256us
I20260709 12:23:23.838587 10704 raft_consensus.cc:1275] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:23.863067 11442 consensus_queue.cc:1048] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:23.873615 10520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 63811.5us
W20260709 12:23:23.979707 10594 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 137481us
W20260709 12:23:29.744410 10669 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:37591, user_credentials={real_user=slave}} blocked reactor thread for 161827us
I20260709 12:23:29.826582 11525 raft_consensus.cc:493] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2da3f34a85954a319ed87fd378e5e661)
I20260709 12:23:29.855751 11525 raft_consensus.cc:515] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:29.864217 11525 leader_election.cc:290] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:29.867909 11509 raft_consensus.cc:493] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2da3f34a85954a319ed87fd378e5e661)
I20260709 12:23:29.868402 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:29.874693 11509 raft_consensus.cc:515] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:29.880211 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:29.883215 11509 leader_election.cc:290] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:29.995172 11319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e51200a353f4204a472f75887547285" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:29.996363 11323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "becf98b94b704731a507d96d1a44737c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8b600238cd49d29a1bd59a571ab995" is_pre_election: true
I20260709 12:23:29.997694 11529 raft_consensus.cc:493] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader becf98b94b704731a507d96d1a44737c)
I20260709 12:23:30.000785 11529 raft_consensus.cc:515] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:30.001082 10666 leader_election.cc:304] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:30.002763 10666 leader_election.cc:304] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:30.004057 11511 raft_consensus.cc:2749] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.004369 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "becf98b94b704731a507d96d1a44737c" is_pre_election: true
I20260709 12:23:30.004839 11511 raft_consensus.cc:2749] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.009479 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33216b1d944418dbcc3a556377d0670" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2da3f34a85954a319ed87fd378e5e661" is_pre_election: true
I20260709 12:23:30.011464 11270 leader_election.cc:304] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995; no voters: 2da3f34a85954a319ed87fd378e5e661, becf98b94b704731a507d96d1a44737c
I20260709 12:23:30.015473 11529 leader_election.cc:290] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:30.016217 11529 raft_consensus.cc:2749] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:30.712275 11371 debug-util.cc:398] Leaking SignalData structure 0x7b0800123e80 after lost signal to thread 3105
W20260709 12:23:30.713725 11371 debug-util.cc:398] Leaking SignalData structure 0x7b080022d220 after lost signal to thread 10411
W20260709 12:23:30.715253 11371 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa620 after lost signal to thread 10579
W20260709 12:23:30.716459 11371 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa680 after lost signal to thread 10653
W20260709 12:23:30.717756 11371 debug-util.cc:398] Leaking SignalData structure 0x7b0800381320 after lost signal to thread 10728
W20260709 12:23:30.719086 11371 debug-util.cc:398] Leaking SignalData structure 0x7b080008f9a0 after lost signal to thread 11386
I20260709 12:23:32.208978  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.284138 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:32.284978 10551 raft_consensus.cc:606] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:32.287918 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:32.288543 10551 raft_consensus.cc:606] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:32.291654 10552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:32.292208 10552 raft_consensus.cc:606] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:32.301544 10552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "5703388aa4f747c280bf93e578f6bad7"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:32.302119 10552 raft_consensus.cc:606] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:32.336917 10700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2"
dest_uuid: "becf98b94b704731a507d96d1a44737c"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:50030
I20260709 12:23:32.337703 10700 raft_consensus.cc:606] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:32.343034 10552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:32.343659 10552 raft_consensus.cc:606] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:32.346611  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:32.348685  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:32.349881  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.540789 11516 raft_consensus.cc:993] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.541592 11518 raft_consensus.cc:1081] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.543357 11323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:32.543982 11323 raft_consensus.cc:493] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.544322 11323 raft_consensus.cc:3060] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.553012 11323 raft_consensus.cc:515] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.556057 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:32.556701 10702 raft_consensus.cc:3060] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.557185 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54527023f4db4ec3bdbcc711a0b053a4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:32.557821 10552 raft_consensus.cc:3055] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.558112 10552 raft_consensus.cc:740] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:32.559116 10552 consensus_queue.cc:260] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.559796 11323 leader_election.cc:290] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:32.560384 10552 raft_consensus.cc:3060] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.569404 10702 raft_consensus.cc:2468] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.569705 10552 raft_consensus.cc:2468] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.571043 11270 leader_election.cc:304] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:32.574093 11525 raft_consensus.cc:993] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.574682 11525 raft_consensus.cc:1081] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.582011 11323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:23:32.582693 11323 raft_consensus.cc:493] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.583153 11323 raft_consensus.cc:3060] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.589727 11540 raft_consensus.cc:2804] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.594105 11516 raft_consensus.cc:993] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.594914 11516 raft_consensus.cc:1081] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.597013 11319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:32.597632 11319 raft_consensus.cc:493] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.598065 11319 raft_consensus.cc:3060] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.603471 11323 raft_consensus.cc:515] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:32.608650 10702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:32.609395 10702 raft_consensus.cc:3055] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.609768 10702 raft_consensus.cc:740] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:32.610685 10702 consensus_queue.cc:260] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:32.613554 10623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5186731547d45a68e190092f5f7a7c2" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:32.614639 10623 raft_consensus.cc:3060] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.612105 10702 raft_consensus.cc:3060] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.617425 11319 raft_consensus.cc:515] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:32.621500 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:32.622591 10552 raft_consensus.cc:3055] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.624080 10552 raft_consensus.cc:740] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:32.625583 10625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b167d5dc1549a8a9cd1f8365c6a2cd" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:32.626318 10625 raft_consensus.cc:3060] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.625283 11319 leader_election.cc:290] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:32.628667 10552 consensus_queue.cc:260] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:32.632308 10552 raft_consensus.cc:3060] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.635579 11516 raft_consensus.cc:993] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower 5703388aa4f747c280bf93e578f6bad7 to start an election
I20260709 12:23:32.637879 11536 raft_consensus.cc:1081] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer 5703388aa4f747c280bf93e578f6bad7 to start an election
I20260709 12:23:32.651494 10552 raft_consensus.cc:2468] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.653156 11270 leader_election.cc:304] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:32.654760 11541 raft_consensus.cc:2804] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.655349 10627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf"
dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
 from {username='slave'} at 127.0.0.1:57410
I20260709 12:23:32.656095 10627 raft_consensus.cc:493] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.656559 10627 raft_consensus.cc:3060] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.674419 11518 raft_consensus.cc:993] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.674664 11540 raft_consensus.cc:697] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:32.675055 11518 raft_consensus.cc:1081] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.675796 11540 consensus_queue.cc:237] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.676900 11319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:32.677769 11319 raft_consensus.cc:493] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.678126 11319 raft_consensus.cc:3060] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.608763 11323 leader_election.cc:290] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:32.679708 11541 raft_consensus.cc:697] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:32.680644 10627 raft_consensus.cc:515] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:32.680893 10625 raft_consensus.cc:2468] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.680975 11541 consensus_queue.cc:237] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:32.684518 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:32.685112 10552 raft_consensus.cc:3055] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.685406 10552 raft_consensus.cc:740] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:32.686157 10552 consensus_queue.cc:260] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:32.687323 10552 raft_consensus.cc:3060] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.689493 10627 leader_election.cc:290] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:32.690841 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccd8757dfaa4ea6976b07cb5734fecf" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:32.691514 10700 raft_consensus.cc:3060] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.693802 10702 raft_consensus.cc:2468] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.695231 11269 leader_election.cc:304] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:32.696715 11544 raft_consensus.cc:2804] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.698422 10552 raft_consensus.cc:2468] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:32.701154 10595 leader_election.cc:304] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, 5703388aa4f747c280bf93e578f6bad7; no voters: 
I20260709 12:23:32.703889 10623 raft_consensus.cc:2468] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.704768 11507 raft_consensus.cc:2804] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.707481 11507 raft_consensus.cc:697] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:32.709398 11507 consensus_queue.cc:237] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } }
I20260709 12:23:32.725118 11319 raft_consensus.cc:515] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.728557 11544 raft_consensus.cc:697] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:32.729133 10700 raft_consensus.cc:2468] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:32.730664 11544 consensus_queue.cc:237] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:32.733870 11319 leader_election.cc:290] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:32.735863 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:32.736744 10552 raft_consensus.cc:3055] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.737136 10552 raft_consensus.cc:740] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:32.738361 10552 consensus_queue.cc:260] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.742501 10552 raft_consensus.cc:3060] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.739234 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc30d8c3835c47719e8e2711dd5dd271" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:32.744936 10700 raft_consensus.cc:3060] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.750869 10552 raft_consensus.cc:2468] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.752252 11270 leader_election.cc:304] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:32.753293 11541 raft_consensus.cc:2804] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.754072 11541 raft_consensus.cc:697] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:32.755007 11541 consensus_queue.cc:237] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.758848 11516 raft_consensus.cc:993] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.759557 11542 raft_consensus.cc:1081] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:32.765832 11319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:32.766649 11319 raft_consensus.cc:493] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.767127 11319 raft_consensus.cc:3060] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.769575 10374 catalog_manager.cc:5697] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.779876 10700 raft_consensus.cc:2468] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.779909 11319 raft_consensus.cc:515] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.785681 10700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:32.786521 10700 raft_consensus.cc:3060] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.788724 10552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85284a3fbf5b49628135573479cf48d6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:32.789845 10552 raft_consensus.cc:3055] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.790138 10552 raft_consensus.cc:740] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:32.790959 10552 consensus_queue.cc:260] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.792091 10552 raft_consensus.cc:3060] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.811331 11319 leader_election.cc:290] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:32.810464 10373 catalog_manager.cc:5697] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.813489 10552 raft_consensus.cc:2468] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.813109 10373 catalog_manager.cc:5697] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.814569 11270 leader_election.cc:304] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:32.815553 11541 raft_consensus.cc:2804] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.816030 11541 raft_consensus.cc:697] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:32.816993 11541 consensus_queue.cc:237] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:32.818414 10700 raft_consensus.cc:2468] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:32.814709 10373 catalog_manager.cc:5697] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from becf98b94b704731a507d96d1a44737c (127.3.7.132) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.823329 10373 catalog_manager.cc:5697] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.866508 10373 catalog_manager.cc:5697] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.070482 10627 raft_consensus.cc:1275] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.072245 11541 consensus_queue.cc:1048] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:33.110374 10551 raft_consensus.cc:1275] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.111729 11544 consensus_queue.cc:1048] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.139463 10700 raft_consensus.cc:1275] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.141603 11546 consensus_queue.cc:1048] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.162818 10551 raft_consensus.cc:1275] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.164937 11540 consensus_queue.cc:1048] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.238116 10552 raft_consensus.cc:1275] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.238765 10702 raft_consensus.cc:1275] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.238924 10550 raft_consensus.cc:1275] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.242297 11546 consensus_queue.cc:1048] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.244017 11546 consensus_queue.cc:1048] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.245543 11546 consensus_queue.cc:1048] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.252784 10550 raft_consensus.cc:1275] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.256119 10704 raft_consensus.cc:1275] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.260630 10627 raft_consensus.cc:1275] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.258941 11507 consensus_queue.cc:1048] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:33.264449 11544 consensus_queue.cc:1048] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.269500 11543 consensus_queue.cc:1048] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.286629 10701 raft_consensus.cc:1275] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.295529 11546 consensus_queue.cc:1048] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:33.311429 10703 raft_consensus.cc:1275] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:33.313607 11541 consensus_queue.cc:1048] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.418337  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.507125 10550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:33.507917 10550 raft_consensus.cc:606] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:33.510789 10550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:33.511353 10550 raft_consensus.cc:606] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:33.514658 10550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:33.515342 10550 raft_consensus.cc:606] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:33.520262 10704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529"
dest_uuid: "becf98b94b704731a507d96d1a44737c"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:50030
I20260709 12:23:33.520915 10704 raft_consensus.cc:606] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:33.528975 10555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:33.529670 10555 raft_consensus.cc:606] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:33.532966 10555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:33.533461 10555 raft_consensus.cc:606] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:33.534802  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:33.536788  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:33.537654  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.640413 11516 raft_consensus.cc:993] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.641086 11542 raft_consensus.cc:1081] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.644035 11319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:33.645205 11319 raft_consensus.cc:493] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.646270 11319 raft_consensus.cc:3060] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.667655 11516 raft_consensus.cc:993] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.668017 11319 raft_consensus.cc:515] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:33.668555 11542 raft_consensus.cc:1081] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.671177 11313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:33.671629 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:33.671856 11313 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.672125 10555 raft_consensus.cc:3055] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.672350 11313 raft_consensus.cc:3060] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.672359 10555 raft_consensus.cc:740] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:33.673427 10555 consensus_queue.cc:260] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:33.674345 10555 raft_consensus.cc:3060] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.676283 11319 leader_election.cc:290] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:33.677532 10623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "192ce4b500dc4ba197c4a4b9dcf6b485" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:33.684046 10623 raft_consensus.cc:3060] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.686040 11313 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.689240 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:33.689551 10555 raft_consensus.cc:2468] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.690013 10704 raft_consensus.cc:3060] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.691761 11270 leader_election.cc:304] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:33.693138 11540 raft_consensus.cc:2804] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.693655 11540 raft_consensus.cc:697] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:33.695556 11540 consensus_queue.cc:237] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:33.703272 10623 raft_consensus.cc:2468] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.705114 10704 raft_consensus.cc:2468] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.706250 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84deda81af094e08b2e7a4ed94f091c4" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:33.706640 11269 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:33.707793 11544 raft_consensus.cc:2804] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.708307 11544 raft_consensus.cc:697] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:33.709291 11544 consensus_queue.cc:237] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.713618 11313 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:33.706915 10555 raft_consensus.cc:3055] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.716930 10555 raft_consensus.cc:740] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:33.718709 10555 consensus_queue.cc:260] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.721180 10555 raft_consensus.cc:3060] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.746551 10555 raft_consensus.cc:2468] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.756747 10372 catalog_manager.cc:5697] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.761844 11525 raft_consensus.cc:993] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.762670 11535 raft_consensus.cc:1081] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.764503 11319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:23:33.765115 11319 raft_consensus.cc:493] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.765470 11319 raft_consensus.cc:3060] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.790638 11319 raft_consensus.cc:515] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:33.794054 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:33.795159 10627 raft_consensus.cc:3060] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.795167 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fa17fbe6be4fe9a202b19d42b57529" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:33.796250 10704 raft_consensus.cc:3055] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.796695 10704 raft_consensus.cc:740] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:33.797798 10704 consensus_queue.cc:260] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:33.799970 10704 raft_consensus.cc:3060] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.804214 11319 leader_election.cc:290] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:33.805016 10627 raft_consensus.cc:2468] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.808130 11270 leader_election.cc:304] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:33.809063 11544 raft_consensus.cc:2804] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.809552 11544 raft_consensus.cc:697] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:33.810395 11544 consensus_queue.cc:237] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:33.817723 10372 catalog_manager.cc:5697] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.843505 10374 catalog_manager.cc:5697] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from becf98b94b704731a507d96d1a44737c (127.3.7.132) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.809768 10704 raft_consensus.cc:2468] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.850374 11516 raft_consensus.cc:993] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.851004 11516 raft_consensus.cc:1081] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.853063 11313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:33.853626 11313 raft_consensus.cc:493] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.853950 11313 raft_consensus.cc:3060] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.866987 11313 raft_consensus.cc:515] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.870193 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:33.870833 10704 raft_consensus.cc:3060] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.870903 11313 leader_election.cc:290] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:33.874512 10555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccafdd46a364d3584441cf6aab82cf8" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:33.875156 10555 raft_consensus.cc:3055] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.875509 10555 raft_consensus.cc:740] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:33.876313 10555 consensus_queue.cc:260] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.877712 10555 raft_consensus.cc:3060] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.878631 10704 raft_consensus.cc:2468] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.879746 11269 leader_election.cc:304] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:33.880749 11544 raft_consensus.cc:2804] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.881439 11544 raft_consensus.cc:697] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:33.882345 11544 consensus_queue.cc:237] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.890244 10555 raft_consensus.cc:2468] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.893692 10374 catalog_manager.cc:5697] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.945472 11518 raft_consensus.cc:993] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.946012 11516 raft_consensus.cc:1081] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:33.947808 11313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:33.948343 11313 raft_consensus.cc:493] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.948702 11313 raft_consensus.cc:3060] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.953603 11313 raft_consensus.cc:515] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.955209 11313 leader_election.cc:290] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:33.956055 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:33.956377 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ad3183541b4bb29af186841577e9f6" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:33.956691 10704 raft_consensus.cc:3060] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.956980 10550 raft_consensus.cc:3055] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.957279 10550 raft_consensus.cc:740] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:33.958114 10550 consensus_queue.cc:260] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.959475 10550 raft_consensus.cc:3060] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.963837 10704 raft_consensus.cc:2468] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.964990 11269 leader_election.cc:304] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:33.965977 11544 raft_consensus.cc:2804] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.966496 11544 raft_consensus.cc:697] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:33.966540 10550 raft_consensus.cc:2468] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:33.967556 11544 consensus_queue.cc:237] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:33.979809 10374 catalog_manager.cc:5697] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.028790 11516 raft_consensus.cc:993] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:34.029464 11542 raft_consensus.cc:1081] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:34.031560 11313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:34.032099 11313 raft_consensus.cc:493] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.032415 11313 raft_consensus.cc:3060] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.039170 11313 raft_consensus.cc:515] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:34.041093 11313 leader_election.cc:290] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:34.041869 10550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:34.042168 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f80c13834594ea58841f45cbd2ced65" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:34.042574 10550 raft_consensus.cc:3055] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:34.042711 10627 raft_consensus.cc:3060] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.042944 10550 raft_consensus.cc:740] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:34.043846 10550 consensus_queue.cc:260] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:34.044950 10550 raft_consensus.cc:3060] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:34.050415 10627 raft_consensus.cc:2468] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:34.051883 11270 leader_election.cc:304] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:34.052867 11544 raft_consensus.cc:2804] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:34.053403 11544 raft_consensus.cc:697] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:34.054406 11544 consensus_queue.cc:237] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:34.067157 10550 raft_consensus.cc:2468] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:34.071122 10374 catalog_manager.cc:5697] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.216758 10550 raft_consensus.cc:1275] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.217427 10623 raft_consensus.cc:1275] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.218019 11544 consensus_queue.cc:1048] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.218667 11546 consensus_queue.cc:1048] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.231178 10704 raft_consensus.cc:1275] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.233152 11544 consensus_queue.cc:1048] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.291702 10704 raft_consensus.cc:1275] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.300540 11540 consensus_queue.cc:1048] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:34.317875 10551 raft_consensus.cc:1275] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.319486 11592 consensus_queue.cc:1048] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.342768 10623 raft_consensus.cc:1275] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.345053 11592 consensus_queue.cc:1048] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:34.351083 10550 raft_consensus.cc:1275] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:34.353032 11269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.132:42917, user_credentials={real_user=slave}} blocked reactor thread for 55350.9us
I20260709 12:23:34.389293 11546 consensus_queue.cc:1048] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:23:34.427868 10703 raft_consensus.cc:1275] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.435263 11546 consensus_queue.cc:1048] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.458528 10623 raft_consensus.cc:1275] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.463224 11546 consensus_queue.cc:1048] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.465596 10551 raft_consensus.cc:1275] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.467645 11546 consensus_queue.cc:1048] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.497887 10701 raft_consensus.cc:1275] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.500381 11591 consensus_queue.cc:1048] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.594259  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:34.603895 10551 raft_consensus.cc:1275] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.605664 11591 consensus_queue.cc:1048] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.704114 10703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923"
dest_uuid: "becf98b94b704731a507d96d1a44737c"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:50030
I20260709 12:23:34.704859 10703 raft_consensus.cc:606] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:34.708760 10551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18"
dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:53040
I20260709 12:23:34.709367 10551 raft_consensus.cc:606] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:34.713656 10703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3"
dest_uuid: "becf98b94b704731a507d96d1a44737c"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:50030
I20260709 12:23:34.714264 10703 raft_consensus.cc:606] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:34.717942 10703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2"
dest_uuid: "becf98b94b704731a507d96d1a44737c"
mode: GRACEFUL
new_leader_uuid: "5703388aa4f747c280bf93e578f6bad7"
 from {username='slave'} at 127.0.0.1:50030
I20260709 12:23:34.718566 10703 raft_consensus.cc:606] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Received request to transfer leadership to TS 5703388aa4f747c280bf93e578f6bad7
I20260709 12:23:34.721306 10703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d"
dest_uuid: "becf98b94b704731a507d96d1a44737c"
mode: GRACEFUL
new_leader_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:50030
I20260709 12:23:34.721736 10703 raft_consensus.cc:606] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Received request to transfer leadership to TS bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:34.722844  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:34.724303  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:34.725024  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:34.987813 11518 raft_consensus.cc:993] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:34.988348 11542 raft_consensus.cc:1081] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:34.989987 11323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43452
I20260709 12:23:34.990660 11323 raft_consensus.cc:493] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.991025 11323 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:34.999198 11323 raft_consensus.cc:515] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:35.001461 11323 leader_election.cc:290] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 3 election: Requested vote from peers 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241), 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591)
I20260709 12:23:35.003232 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:35.003847 10627 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.004467 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ee7750d0674f87be848140c6a02f18" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:35.005025 10551 raft_consensus.cc:3055] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:35.005440 10551 raft_consensus.cc:740] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2da3f34a85954a319ed87fd378e5e661, State: Running, Role: LEADER
I20260709 12:23:35.006141 10551 consensus_queue.cc:260] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:35.007459 10551 raft_consensus.cc:3060] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.011413 10627 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 3.
I20260709 12:23:35.012887 11270 leader_election.cc:304] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:35.013746 11592 raft_consensus.cc:2804] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:35.012888 10551 raft_consensus.cc:2468] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 3.
I20260709 12:23:35.014439 11592 raft_consensus.cc:697] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 3 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:35.015547 11592 consensus_queue.cc:237] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } }
I20260709 12:23:35.034586 10376 catalog_manager.cc:5697] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 2 to 3, leader changed from 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 3 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.089761 11603 raft_consensus.cc:993] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: : Instructing follower 5703388aa4f747c280bf93e578f6bad7 to start an election
I20260709 12:23:35.090464 11535 raft_consensus.cc:1081] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Signalling peer 5703388aa4f747c280bf93e578f6bad7 to start an election
I20260709 12:23:35.092221 10627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2"
dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
 from {username='slave'} at 127.0.0.1:57396
I20260709 12:23:35.093421 10627 raft_consensus.cc:493] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.094352 10627 raft_consensus.cc:3060] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.103135 10627 raft_consensus.cc:515] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.105856 10627 leader_election.cc:290] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:35.106452 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:35.106910 11319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b4dbad2b434c9fbf4dd26ec67449f2" candidate_uuid: "5703388aa4f747c280bf93e578f6bad7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
I20260709 12:23:35.107177 10703 raft_consensus.cc:3055] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.107620 11319 raft_consensus.cc:3060] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.107654 10703 raft_consensus.cc:740] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:35.108716 10703 consensus_queue.cc:260] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.110172 10703 raft_consensus.cc:3060] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.116969 11319 raft_consensus.cc:2468] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:35.118079 10703 raft_consensus.cc:2468] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5703388aa4f747c280bf93e578f6bad7 in term 2.
I20260709 12:23:35.118677 10592 leader_election.cc:304] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:35.119680 11533 raft_consensus.cc:2804] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.120187 11533 raft_consensus.cc:697] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Becoming Leader. State: Replica: 5703388aa4f747c280bf93e578f6bad7, State: Running, Role: LEADER
I20260709 12:23:35.121233 11533 consensus_queue.cc:237] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.137223 10376 catalog_manager.cc:5697] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 reported cstate change: term changed from 1 to 2, leader changed from becf98b94b704731a507d96d1a44737c (127.3.7.132) to 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "5703388aa4f747c280bf93e578f6bad7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.213769 11603 raft_consensus.cc:993] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:35.214331 11603 raft_consensus.cc:1081] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:35.217494 11319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:23:35.218017 11319 raft_consensus.cc:493] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.218364 11319 raft_consensus.cc:3060] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.226140 11319 raft_consensus.cc:515] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.228683 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:35.229369 10627 raft_consensus.cc:3060] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.229809 10703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d44f30f58f4416a927ce5433bfe923" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:35.230532 10703 raft_consensus.cc:3055] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.231235 10703 raft_consensus.cc:740] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:35.232141 11603 raft_consensus.cc:993] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:35.232481 10703 consensus_queue.cc:260] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.233599 11535 raft_consensus.cc:1081] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:35.235666 11319 leader_election.cc:290] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:35.236176 11323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:23:35.236819 11323 raft_consensus.cc:493] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.237237 11323 raft_consensus.cc:3060] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.233994 10703 raft_consensus.cc:3060] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.241711 10627 raft_consensus.cc:2468] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:35.243167 11270 leader_election.cc:304] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:35.244751 11592 raft_consensus.cc:2804] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.245311 11592 raft_consensus.cc:697] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:35.246390 11592 consensus_queue.cc:237] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.248875 10703 raft_consensus.cc:2468] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:35.260985 11323 raft_consensus.cc:515] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.264245 11323 leader_election.cc:290] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Requested vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), becf98b94b704731a507d96d1a44737c (127.3.7.132:42917)
I20260709 12:23:35.265249 10627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5703388aa4f747c280bf93e578f6bad7"
I20260709 12:23:35.265532 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3398d20ad4a14a89bcff5962ec30d" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:35.266426 10701 raft_consensus.cc:3055] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:35.266688 10701 raft_consensus.cc:740] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:35.267176 10701 consensus_queue.cc:260] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.268302 10701 raft_consensus.cc:3060] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.268626 10627 raft_consensus.cc:3060] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:35.269208 10376 catalog_manager.cc:5697] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from becf98b94b704731a507d96d1a44737c (127.3.7.132) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.275269 10701 raft_consensus.cc:2468] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:35.276245 10627 raft_consensus.cc:2468] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 2.
I20260709 12:23:35.276556 11269 leader_election.cc:304] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb8b600238cd49d29a1bd59a571ab995, becf98b94b704731a507d96d1a44737c; no voters: 
I20260709 12:23:35.278023 11592 raft_consensus.cc:2804] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:35.278510 11592 raft_consensus.cc:697] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:35.279500 11592 consensus_queue.cc:237] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:35.300726 10376 catalog_manager.cc:5697] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 1 to 2, leader changed from becf98b94b704731a507d96d1a44737c (127.3.7.132) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.313186 11613 raft_consensus.cc:993] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: : Instructing follower bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:35.313675 11603 raft_consensus.cc:1081] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Signalling peer bb8b600238cd49d29a1bd59a571ab995 to start an election
I20260709 12:23:35.315165 11323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3"
dest_uuid: "bb8b600238cd49d29a1bd59a571ab995"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:23:35.315780 11323 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:35.316123 11323 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.322376 11323 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:35.324478 11323 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 3 election: Requested vote from peers becf98b94b704731a507d96d1a44737c (127.3.7.132:42917), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:35.325052 10701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "becf98b94b704731a507d96d1a44737c"
I20260709 12:23:35.325513 10551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75cfb94c077d4b08b3644c08191e8af3" candidate_uuid: "bb8b600238cd49d29a1bd59a571ab995" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2da3f34a85954a319ed87fd378e5e661"
I20260709 12:23:35.325831 10701 raft_consensus.cc:3055] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:35.326119 10551 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.326205 10701 raft_consensus.cc:740] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: becf98b94b704731a507d96d1a44737c, State: Running, Role: LEADER
I20260709 12:23:35.327095 10701 consensus_queue.cc:260] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:35.328389 10701 raft_consensus.cc:3060] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.334398 10551 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 3.
I20260709 12:23:35.335808 11270 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995; no voters: 
I20260709 12:23:35.337512 11592 raft_consensus.cc:2804] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:35.338411 10701 raft_consensus.cc:2468] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8b600238cd49d29a1bd59a571ab995 in term 3.
I20260709 12:23:35.338788 11592 raft_consensus.cc:697] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 3 LEADER]: Becoming Leader. State: Replica: bb8b600238cd49d29a1bd59a571ab995, State: Running, Role: LEADER
I20260709 12:23:35.339910 11592 consensus_queue.cc:237] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:35.360037 10376 catalog_manager.cc:5697] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 reported cstate change: term changed from 2 to 3, leader changed from becf98b94b704731a507d96d1a44737c (127.3.7.132) to bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129). New cstate: current_term: 3 leader_uuid: "bb8b600238cd49d29a1bd59a571ab995" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.408931 10623 raft_consensus.cc:1275] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:35.410472 11592 consensus_queue.cc:1048] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:35.422000 10551 raft_consensus.cc:1275] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:35.424340 11591 consensus_queue.cc:1048] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:35.510455 10701 raft_consensus.cc:1275] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.511605 11611 consensus_queue.cc:1048] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.520280 11319 raft_consensus.cc:1275] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Refusing update from remote peer 5703388aa4f747c280bf93e578f6bad7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.522195 11533 consensus_queue.cc:1048] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.728538 10627 raft_consensus.cc:1275] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.729902 11592 consensus_queue.cc:1048] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.741539 10703 raft_consensus.cc:1275] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.744699 11544 consensus_queue.cc:1048] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.768849  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.770159 10627 raft_consensus.cc:1275] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.771451 11544 consensus_queue.cc:1048] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.774811 10701 raft_consensus.cc:1275] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:35.776285 11592 consensus_queue.cc:1048] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:35.787662 10703 raft_consensus.cc:1275] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:35.791405 11544 consensus_queue.cc:1048] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:35.814468 10551 raft_consensus.cc:1275] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Refusing update from remote peer bb8b600238cd49d29a1bd59a571ab995: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:35.816102 11591 consensus_queue.cc:1048] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:35.852485  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:35.854174  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:35.854916  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.893317  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.932888  3102 tablet_server.cc:179] TabletServer@127.3.7.129:45267 shutting down...
W20260709 12:23:35.944252 10517 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 209 similar messages]
W20260709 12:23:35.964787 10517 consensus_peers.cc:597] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.972199 10666 consensus_peers.cc:597] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.972800 10666 consensus_peers.cc:597] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.972791 10592 consensus_peers.cc:597] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.981155 10517 consensus_peers.cc:597] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.986922 10592 consensus_peers.cc:597] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.997411  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:35.998500  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:35.999706  3102 raft_consensus.cc:2243] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.000298  3102 raft_consensus.cc:2272] T ab2d2836c0834b29a9007f5c0c4469fe P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.003412  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.004125  3102 raft_consensus.cc:2243] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.004537  3102 raft_consensus.cc:2272] T 814d4d8348e448728625bdcbaf25f440 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.006704  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.007372  3102 raft_consensus.cc:2243] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.007812  3102 raft_consensus.cc:2272] T 73bbd93e93934a568405bc6dbe1d4877 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.009891  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.010618  3102 raft_consensus.cc:2243] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.011058  3102 raft_consensus.cc:2272] T c3aa16e74031433c95a793a2a839503b P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.013409  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.014020  3102 raft_consensus.cc:2243] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.014434  3102 raft_consensus.cc:2272] T a33216b1d944418dbcc3a556377d0670 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.016800  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.017504  3102 raft_consensus.cc:2243] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.017990  3102 raft_consensus.cc:2272] T 65720f7f3c724a08ba663044df41940e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.020558  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.021236  3102 raft_consensus.cc:2243] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.021763  3102 raft_consensus.cc:2272] T 8e51200a353f4204a472f75887547285 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.024055  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.024691  3102 raft_consensus.cc:2243] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.025527  3102 raft_consensus.cc:2272] T 85284a3fbf5b49628135573479cf48d6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.027678  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.028309  3102 raft_consensus.cc:2243] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.029239  3102 raft_consensus.cc:2272] T daf3398d20ad4a14a89bcff5962ec30d P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.032591  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.033326  3102 raft_consensus.cc:2243] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.033811  3102 raft_consensus.cc:2272] T f1674e84a5d245b4aa6ed2f18f24cf87 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.036302  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.036983  3102 raft_consensus.cc:2243] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.038013  3102 raft_consensus.cc:2272] T 41ad3183541b4bb29af186841577e9f6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.041594  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.042244  3102 raft_consensus.cc:2243] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:23:36.042438 10666 consensus_peers.cc:597] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.043049  3102 raft_consensus.cc:2272] T 90b167d5dc1549a8a9cd1f8365c6a2cd P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.045226  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.045835  3102 raft_consensus.cc:2243] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.046234  3102 raft_consensus.cc:2272] T 483a0bc6f3d945efaabbad914d574e84 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.048401  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.049042  3102 raft_consensus.cc:2243] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.049857  3102 raft_consensus.cc:2272] T 0f80c13834594ea58841f45cbd2ced65 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.052372  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.053054  3102 raft_consensus.cc:2243] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.054107  3102 raft_consensus.cc:2272] T fccafdd46a364d3584441cf6aab82cf8 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.057063  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.058156  3102 raft_consensus.cc:2243] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.058725  3102 raft_consensus.cc:2272] T 38a4197603f34f92bea91d9a4641abbd P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.060871 10517 consensus_peers.cc:597] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.061908  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.062935  3102 raft_consensus.cc:2243] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.063813  3102 raft_consensus.cc:2272] T fc30d8c3835c47719e8e2711dd5dd271 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.066170  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.066850  3102 raft_consensus.cc:2243] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.067459  3102 raft_consensus.cc:2272] T a8799df3e4f34b99897048a5879fc688 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.070236 10592 consensus_peers.cc:597] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.070469  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.071233  3102 raft_consensus.cc:2243] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.071674  3102 raft_consensus.cc:2272] T fab9491812e14055a4628f9b82270f73 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.074155  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.074842  3102 raft_consensus.cc:2243] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.075438  3102 raft_consensus.cc:2272] T 92c0dd6625ef4c2099f58370e62c08d8 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.077804  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.078500  3102 raft_consensus.cc:2243] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.079573  3102 raft_consensus.cc:2272] T 54527023f4db4ec3bdbcc711a0b053a4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.081799 10517 consensus_peers.cc:597] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.082608  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.083739  3102 raft_consensus.cc:2243] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.085060  3102 raft_consensus.cc:2272] T 23d44f30f58f4416a927ce5433bfe923 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.088883  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.089643  3102 raft_consensus.cc:2243] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.090512  3102 raft_consensus.cc:2272] T 43ee7750d0674f87be848140c6a02f18 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.093624  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.094496  3102 raft_consensus.cc:2243] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.095659  3102 raft_consensus.cc:2272] T c5186731547d45a68e190092f5f7a7c2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.098469  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.099344  3102 raft_consensus.cc:2243] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.099982  3102 raft_consensus.cc:2272] T c8b4dbad2b434c9fbf4dd26ec67449f2 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.108042  3102 tablet_replica.cc:333] stopping tablet replica
W20260709 12:23:36.108444 10592 consensus_peers.cc:597] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.108997  3102 raft_consensus.cc:2243] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.109669  3102 raft_consensus.cc:2272] T 935517510de547e9a555aa468eea1a10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.112612  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.113380  3102 raft_consensus.cc:2243] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.113917  3102 raft_consensus.cc:2272] T e9e217311b654a3999a76cac4fed6129 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.117341  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.118291  3102 raft_consensus.cc:2243] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.119287  3102 raft_consensus.cc:2272] T 84deda81af094e08b2e7a4ed94f091c4 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.121845  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.122624  3102 raft_consensus.cc:2243] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.123152  3102 raft_consensus.cc:2272] T 2c0f84b23d4749ca89ce418105b87c0d P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.124063 10517 consensus_peers.cc:597] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.126016  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.127064  3102 raft_consensus.cc:2243] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.127602  3102 raft_consensus.cc:2272] T 4362cb4cea024bab8e1befd005c38931 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.130688  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.131547  3102 raft_consensus.cc:2243] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:23:36.132311 10517 consensus_peers.cc:597] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.132524  3102 raft_consensus.cc:2272] T 69fa17fbe6be4fe9a202b19d42b57529 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.135286  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.136129  3102 raft_consensus.cc:2243] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.136636  3102 raft_consensus.cc:2272] T 7a978264a6a14ca296d74a58c7d58705 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.139755  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.140604  3102 raft_consensus.cc:2243] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.141095  3102 raft_consensus.cc:2272] T 2b394c6b2e7544aa890058148e0ac514 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.143903  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.144603  3102 raft_consensus.cc:2243] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.145143  3102 raft_consensus.cc:2272] T 5480174671f54c06a686c1598f36a6e6 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.147994  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.148777  3102 raft_consensus.cc:2243] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.149358  3102 raft_consensus.cc:2272] T e7a83257d2814ade9d44473bff639778 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.152350  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.153102  3102 raft_consensus.cc:2243] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.153524  3102 raft_consensus.cc:2272] T c862ff91f7484100b8a72ae26d09b8c1 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.155870  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.156469  3102 raft_consensus.cc:2243] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.156930  3102 raft_consensus.cc:2272] T 78d6d3887b1d47638ed56acc7074311b P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.159832  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.160563  3102 raft_consensus.cc:2243] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.161058  3102 raft_consensus.cc:2272] T f8af59f95c2f43cc9cd8093395b00e10 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.161922 10592 consensus_peers.cc:597] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.163760  3102 tablet_replica.cc:333] stopping tablet replica
W20260709 12:23:36.164512 10666 consensus_peers.cc:597] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.164695  3102 raft_consensus.cc:2243] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.165506  3102 raft_consensus.cc:2272] T 516058c81d8243688175010331c582ee P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.168433  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.169160  3102 raft_consensus.cc:2243] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.170085  3102 raft_consensus.cc:2272] T 192ce4b500dc4ba197c4a4b9dcf6b485 P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.172425 10592 consensus_peers.cc:597] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.173060  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.173795  3102 raft_consensus.cc:2243] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.174351  3102 raft_consensus.cc:2272] T ea516217c42649acb0675e458549a1be P bb8b600238cd49d29a1bd59a571ab995 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.177161  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.177745  3102 raft_consensus.cc:2243] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.178160  3102 raft_consensus.cc:2272] T ff41525191314521b655a8d37cb1a242 P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.180603  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.181249  3102 raft_consensus.cc:2243] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.181659  3102 raft_consensus.cc:2272] T c771f43203d841dd8d4f4e999b6d360e P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.182729 10517 consensus_peers.cc:597] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.184108  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.184818  3102 raft_consensus.cc:2243] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.185293  3102 raft_consensus.cc:2272] T 2567db905aed4ca3af769c4464b8aa2f P bb8b600238cd49d29a1bd59a571ab995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.187605  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:36.188112  3102 raft_consensus.cc:2243] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.188970  3102 raft_consensus.cc:2272] T 75cfb94c077d4b08b3644c08191e8af3 P bb8b600238cd49d29a1bd59a571ab995 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.214566 10666 consensus_peers.cc:597] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.240892 10666 consensus_peers.cc:597] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.277892 10666 consensus_peers.cc:597] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.286870  3102 tablet_server.cc:196] TabletServer@127.3.7.129:45267 shutdown complete.
W20260709 12:23:36.294342 10666 consensus_peers.cc:597] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.321255 10517 consensus_peers.cc:597] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.334872 10666 consensus_peers.cc:597] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.370719 10517 consensus_peers.cc:597] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.376257  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
W20260709 12:23:36.391289 10666 consensus_peers.cc:597] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.395056 10595 consensus_peers.cc:597] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.398236 10595 consensus_peers.cc:597] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.422756 10592 consensus_peers.cc:597] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.430336 10669 consensus_peers.cc:597] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.452096 10517 consensus_peers.cc:597] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.454732 10592 consensus_peers.cc:597] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.456305  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:36.457527  3102 tablet_replica.cc:333] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.458774  3102 raft_consensus.cc:2243] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.459474  3102 raft_consensus.cc:2272] T a3175d59583845a9aa8e63d4982cf0c0 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.462397  3102 tablet_replica.cc:333] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.463258  3102 raft_consensus.cc:2243] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.463896  3102 raft_consensus.cc:2272] T 8204fe73f2004e518c32b6310ee18b82 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.467324  3102 tablet_replica.cc:333] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.468040  3102 raft_consensus.cc:2243] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.468588  3102 raft_consensus.cc:2272] T 85284a3fbf5b49628135573479cf48d6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.470899  3102 tablet_replica.cc:333] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.471637  3102 raft_consensus.cc:2243] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.472083  3102 raft_consensus.cc:2272] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.473006 10669 consensus_peers.cc:597] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.474475  3102 tablet_replica.cc:333] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.475236  3102 raft_consensus.cc:2243] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.475747  3102 raft_consensus.cc:2272] T 0e9f415c2c9243428aacae2dc707b9d1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.477931  3102 tablet_replica.cc:333] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.478627  3102 raft_consensus.cc:2243] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.479059  3102 raft_consensus.cc:2272] T fc875de41c5440e78f3da51713684d46 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.481182  3102 tablet_replica.cc:333] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.481827  3102 raft_consensus.cc:2243] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.482260  3102 raft_consensus.cc:2272] T 41ad3183541b4bb29af186841577e9f6 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.484439  3102 tablet_replica.cc:333] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.485122  3102 raft_consensus.cc:2243] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.486009  3102 raft_consensus.cc:2272] T a8799df3e4f34b99897048a5879fc688 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.488528  3102 tablet_replica.cc:333] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.489217  3102 raft_consensus.cc:2243] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.489697  3102 raft_consensus.cc:2272] T 84deda81af094e08b2e7a4ed94f091c4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.492635  3102 tablet_replica.cc:333] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.493492  3102 raft_consensus.cc:2243] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:23:36.494437 10595 consensus_peers.cc:597] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.494601  3102 raft_consensus.cc:2272] T e9e217311b654a3999a76cac4fed6129 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.497117  3102 tablet_replica.cc:333] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.498011  3102 raft_consensus.cc:2243] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.499008  3102 raft_consensus.cc:2272] T fcc42f485018420e94dafb287e1f73b5 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.502463  3102 tablet_replica.cc:333] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.503333  3102 raft_consensus.cc:2243] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.503901  3102 raft_consensus.cc:2272] T ab2d2836c0834b29a9007f5c0c4469fe P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.506736  3102 tablet_replica.cc:333] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.507736  3102 raft_consensus.cc:2243] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.508507  3102 raft_consensus.cc:2272] T 75cfb94c077d4b08b3644c08191e8af3 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.511417  3102 tablet_replica.cc:333] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.512053  3102 raft_consensus.cc:2243] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.512892  3102 raft_consensus.cc:2272] T 2567db905aed4ca3af769c4464b8aa2f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.514814  3102 tablet_replica.cc:333] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.515632  3102 raft_consensus.cc:2243] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.516589  3102 raft_consensus.cc:2272] T 5c174a58645b464782b247e7837bb5ff P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.519567  3102 tablet_replica.cc:333] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
W20260709 12:23:36.519886 10517 consensus_peers.cc:597] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.520445  3102 raft_consensus.cc:2243] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.521447  3102 raft_consensus.cc:2272] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.524631 10669 consensus_peers.cc:597] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.524822  3102 tablet_replica.cc:333] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.525789  3102 raft_consensus.cc:2243] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.526369  3102 raft_consensus.cc:2272] T ea516217c42649acb0675e458549a1be P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.527784 10592 consensus_peers.cc:597] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 -> Peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Couldn't send request to peer bb8b600238cd49d29a1bd59a571ab995. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.529019  3102 tablet_replica.cc:333] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.529799  3102 raft_consensus.cc:2243] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.530709  3102 raft_consensus.cc:2272] T 2c0f84b23d4749ca89ce418105b87c0d P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.533110  3102 tablet_replica.cc:333] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.533711  3102 raft_consensus.cc:2243] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.534227  3102 raft_consensus.cc:2272] T 99999f0404c846758d5ec30143015bc4 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.536384  3102 tablet_replica.cc:333] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.536985  3102 raft_consensus.cc:2243] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.537405  3102 raft_consensus.cc:2272] T fccafdd46a364d3584441cf6aab82cf8 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.539356  3102 tablet_replica.cc:333] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.539932  3102 raft_consensus.cc:2243] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.540370  3102 raft_consensus.cc:2272] T abfc8bc479844f489e1971345747ec0a P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.542346  3102 tablet_replica.cc:333] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.543009  3102 raft_consensus.cc:2243] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.543502  3102 raft_consensus.cc:2272] T 38a4197603f34f92bea91d9a4641abbd P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.546168  3102 tablet_replica.cc:333] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
W20260709 12:23:36.546765 10669 consensus_peers.cc:597] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.546868  3102 raft_consensus.cc:2243] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.547595  3102 raft_consensus.cc:2272] T fc30d8c3835c47719e8e2711dd5dd271 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.550194  3102 tablet_replica.cc:333] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.550832  3102 raft_consensus.cc:2243] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.551265  3102 raft_consensus.cc:2272] T 43ee7750d0674f87be848140c6a02f18 P 2da3f34a85954a319ed87fd378e5e661 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.553333  3102 tablet_replica.cc:333] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.553987  3102 raft_consensus.cc:2243] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.554842  3102 raft_consensus.cc:2272] T 72e198a442da43a78d7375424fa47317 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.557042  3102 tablet_replica.cc:333] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.557623  3102 raft_consensus.cc:2243] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.558079  3102 raft_consensus.cc:2272] T 5986a6cceb0d4ee4ba760b56e3a47fab P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.560222  3102 tablet_replica.cc:333] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.560829  3102 raft_consensus.cc:2243] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.561301  3102 raft_consensus.cc:2272] T c771f43203d841dd8d4f4e999b6d360e P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.563383  3102 tablet_replica.cc:333] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.563968  3102 raft_consensus.cc:2243] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.564811  3102 raft_consensus.cc:2272] T 92c0dd6625ef4c2099f58370e62c08d8 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.567356  3102 tablet_replica.cc:333] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.568069  3102 raft_consensus.cc:2243] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.568655  3102 raft_consensus.cc:2272] T 54527023f4db4ec3bdbcc711a0b053a4 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.571185  3102 tablet_replica.cc:333] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.571762  3102 raft_consensus.cc:2243] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.572570  3102 raft_consensus.cc:2272] T 8e51200a353f4204a472f75887547285 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.574620  3102 tablet_replica.cc:333] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.575132  3102 raft_consensus.cc:2243] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.575963  3102 raft_consensus.cc:2272] T 65720f7f3c724a08ba663044df41940e P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.578475  3102 tablet_replica.cc:333] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.579200  3102 raft_consensus.cc:2243] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.580657  3102 raft_consensus.cc:2272] T c862ff91f7484100b8a72ae26d09b8c1 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.583216  3102 tablet_replica.cc:333] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.583949  3102 raft_consensus.cc:2243] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.585009  3102 raft_consensus.cc:2272] T 78d6d3887b1d47638ed56acc7074311b P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.587940  3102 tablet_replica.cc:333] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.589454  3102 raft_consensus.cc:2243] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.590101  3102 raft_consensus.cc:2272] T f8af59f95c2f43cc9cd8093395b00e10 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.594331  3102 tablet_replica.cc:333] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.594964  3102 raft_consensus.cc:2243] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.595810  3102 raft_consensus.cc:2272] T f1674e84a5d245b4aa6ed2f18f24cf87 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.597971  3102 tablet_replica.cc:333] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.598706  3102 raft_consensus.cc:2243] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.599220  3102 raft_consensus.cc:2272] T a33216b1d944418dbcc3a556377d0670 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.601704  3102 tablet_replica.cc:333] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.602232  3102 raft_consensus.cc:2243] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.602644  3102 raft_consensus.cc:2272] T 0f80c13834594ea58841f45cbd2ced65 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.604585  3102 tablet_replica.cc:333] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.605136  3102 raft_consensus.cc:2243] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.605626  3102 raft_consensus.cc:2272] T 8eb2769bf67740918d65b198cc6cac17 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.607971  3102 tablet_replica.cc:333] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.608580  3102 raft_consensus.cc:2243] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.609022  3102 raft_consensus.cc:2272] T e7a83257d2814ade9d44473bff639778 P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.609126 10669 consensus_peers.cc:597] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.611162  3102 tablet_replica.cc:333] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.611826  3102 raft_consensus.cc:2243] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.612342  3102 raft_consensus.cc:2272] T c3aa16e74031433c95a793a2a839503b P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.614763  3102 tablet_replica.cc:333] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.615432  3102 raft_consensus.cc:2243] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.615860  3102 raft_consensus.cc:2272] T bccd8757dfaa4ea6976b07cb5734fecf P 2da3f34a85954a319ed87fd378e5e661 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.617873  3102 tablet_replica.cc:333] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.618413  3102 raft_consensus.cc:2243] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.619199  3102 raft_consensus.cc:2272] T c8577a637ba643f8a4061e59fe155f9f P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.621901  3102 tablet_replica.cc:333] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.622661  3102 raft_consensus.cc:2243] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.623268  3102 raft_consensus.cc:2272] T 7083196608e84b20b65b0c53c528d4d3 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.626570  3102 tablet_replica.cc:333] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661: stopping tablet replica
I20260709 12:23:36.627488  3102 raft_consensus.cc:2243] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.628927  3102 raft_consensus.cc:2272] T 814d4d8348e448728625bdcbaf25f440 P 2da3f34a85954a319ed87fd378e5e661 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.635608 10595 consensus_peers.cc:597] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.726089  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
W20260709 12:23:36.754001 10669 consensus_peers.cc:597] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.769346 10595 consensus_peers.cc:597] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.807837 10595 consensus_peers.cc:597] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.817692 10595 consensus_peers.cc:597] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.830703 10595 consensus_peers.cc:597] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.848331 10595 consensus_peers.cc:597] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.851966  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
W20260709 12:23:36.859205 10669 consensus_peers.cc:597] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.862099 10669 consensus_peers.cc:597] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.889637 10669 consensus_peers.cc:597] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.925381 10669 consensus_peers.cc:597] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:36.928830 10669 consensus_peers.cc:597] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c -> Peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Couldn't send request to peer 2da3f34a85954a319ed87fd378e5e661. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.940142  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:36.941161  3102 tablet_replica.cc:333] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.942167  3102 raft_consensus.cc:2243] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.942734  3102 raft_consensus.cc:2272] T daf3398d20ad4a14a89bcff5962ec30d P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.944743  3102 tablet_replica.cc:333] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.945384  3102 raft_consensus.cc:2243] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.945802  3102 raft_consensus.cc:2272] T 8204fe73f2004e518c32b6310ee18b82 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.948320  3102 tablet_replica.cc:333] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.949141  3102 raft_consensus.cc:2243] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.950160  3102 raft_consensus.cc:2272] T a3175d59583845a9aa8e63d4982cf0c0 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.952956  3102 tablet_replica.cc:333] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.953842  3102 raft_consensus.cc:2243] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.954345  3102 raft_consensus.cc:2272] T 483a0bc6f3d945efaabbad914d574e84 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.956957  3102 tablet_replica.cc:333] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.957664  3102 raft_consensus.cc:2243] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.958250  3102 raft_consensus.cc:2272] T 23d44f30f58f4416a927ce5433bfe923 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.961011  3102 tablet_replica.cc:333] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.961922  3102 raft_consensus.cc:2243] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.962427  3102 raft_consensus.cc:2272] T 92c0dd6625ef4c2099f58370e62c08d8 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.964977  3102 tablet_replica.cc:333] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.965642  3102 raft_consensus.cc:2243] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.966045  3102 raft_consensus.cc:2272] T 0e9f415c2c9243428aacae2dc707b9d1 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.967844 10669 consensus_peers.cc:597] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:36.968716  3102 tablet_replica.cc:333] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.969375  3102 raft_consensus.cc:2243] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.970168  3102 raft_consensus.cc:2272] T fc875de41c5440e78f3da51713684d46 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.972433  3102 tablet_replica.cc:333] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.973088  3102 raft_consensus.cc:2243] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.973518  3102 raft_consensus.cc:2272] T 90b167d5dc1549a8a9cd1f8365c6a2cd P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.975395  3102 tablet_replica.cc:333] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.975950  3102 raft_consensus.cc:2243] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.976338  3102 raft_consensus.cc:2272] T 8eb2769bf67740918d65b198cc6cac17 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.978124  3102 tablet_replica.cc:333] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.978787  3102 raft_consensus.cc:2243] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.979631  3102 raft_consensus.cc:2272] T ab2d2836c0834b29a9007f5c0c4469fe P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.981590  3102 tablet_replica.cc:333] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.982146  3102 raft_consensus.cc:2243] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.982590  3102 raft_consensus.cc:2272] T fcc42f485018420e94dafb287e1f73b5 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.984555  3102 tablet_replica.cc:333] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.985101  3102 raft_consensus.cc:2243] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.985508  3102 raft_consensus.cc:2272] T a8799df3e4f34b99897048a5879fc688 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.987267  3102 tablet_replica.cc:333] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.987933  3102 raft_consensus.cc:2243] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.988365  3102 raft_consensus.cc:2272] T fab9491812e14055a4628f9b82270f73 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.990777  3102 tablet_replica.cc:333] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.991634  3102 raft_consensus.cc:2243] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.992161  3102 raft_consensus.cc:2272] T 7a978264a6a14ca296d74a58c7d58705 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.994573  3102 tablet_replica.cc:333] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.995190  3102 raft_consensus.cc:2243] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:36.996011  3102 raft_consensus.cc:2272] T 2b394c6b2e7544aa890058148e0ac514 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.998194  3102 tablet_replica.cc:333] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:36.998776  3102 raft_consensus.cc:2243] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.999203  3102 raft_consensus.cc:2272] T 192ce4b500dc4ba197c4a4b9dcf6b485 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.001091  3102 tablet_replica.cc:333] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.001682  3102 raft_consensus.cc:2243] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.002444  3102 raft_consensus.cc:2272] T ea516217c42649acb0675e458549a1be P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.004500  3102 tablet_replica.cc:333] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.005055  3102 raft_consensus.cc:2243] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.005465  3102 raft_consensus.cc:2272] T 2567db905aed4ca3af769c4464b8aa2f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.007253  3102 tablet_replica.cc:333] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.007896  3102 raft_consensus.cc:2243] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.008337  3102 raft_consensus.cc:2272] T 5c174a58645b464782b247e7837bb5ff P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.010215  3102 tablet_replica.cc:333] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.010819  3102 raft_consensus.cc:2243] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.011255  3102 raft_consensus.cc:2272] T 69fa17fbe6be4fe9a202b19d42b57529 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.013144  3102 tablet_replica.cc:333] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.013707  3102 raft_consensus.cc:2243] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.014120  3102 raft_consensus.cc:2272] T 2c0f84b23d4749ca89ce418105b87c0d P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.016141  3102 tablet_replica.cc:333] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.016692  3102 raft_consensus.cc:2243] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.017505  3102 raft_consensus.cc:2272] T 4362cb4cea024bab8e1befd005c38931 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.019512  3102 tablet_replica.cc:333] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.020118  3102 raft_consensus.cc:2243] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.020550  3102 raft_consensus.cc:2272] T 99999f0404c846758d5ec30143015bc4 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.022523  3102 tablet_replica.cc:333] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.023165  3102 raft_consensus.cc:2243] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.023671  3102 raft_consensus.cc:2272] T 516058c81d8243688175010331c582ee P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.025645  3102 tablet_replica.cc:333] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.026207  3102 raft_consensus.cc:2243] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.026628  3102 raft_consensus.cc:2272] T ff41525191314521b655a8d37cb1a242 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.028576  3102 tablet_replica.cc:333] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.028535 11613 raft_consensus.cc:493] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.029618  3102 raft_consensus.cc:2243] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.029254 11613 raft_consensus.cc:515] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:37.030615  3102 raft_consensus.cc:2272] T c8b4dbad2b434c9fbf4dd26ec67449f2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.032827 11613 leader_election.cc:290] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:37.033119  3102 tablet_replica.cc:333] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.033998  3102 raft_consensus.cc:2243] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.034500  3102 raft_consensus.cc:2272] T c5186731547d45a68e190092f5f7a7c2 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.037173  3102 tablet_replica.cc:333] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
W20260709 12:23:37.037223 10669 leader_election.cc:336] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.038223  3102 raft_consensus.cc:2243] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.038733  3102 raft_consensus.cc:2272] T 43ee7750d0674f87be848140c6a02f18 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.040751 10666 leader_election.cc:336] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:37.041288  3102 tablet_replica.cc:333] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.041234 10666 leader_election.cc:304] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.042016 11613 raft_consensus.cc:2749] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.042111  3102 raft_consensus.cc:2243] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.043174  3102 raft_consensus.cc:2272] T c771f43203d841dd8d4f4e999b6d360e P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.045521  3102 tablet_replica.cc:333] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.046375  3102 raft_consensus.cc:2243] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.046823  3102 raft_consensus.cc:2272] T 72e198a442da43a78d7375424fa47317 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.049400  3102 tablet_replica.cc:333] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.050134  3102 raft_consensus.cc:2243] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.050628  3102 raft_consensus.cc:2272] T 5986a6cceb0d4ee4ba760b56e3a47fab P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.052531 10669 consensus_peers.cc:597] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.053130  3102 tablet_replica.cc:333] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.053680  3102 raft_consensus.cc:2243] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.054054  3102 raft_consensus.cc:2272] T 65720f7f3c724a08ba663044df41940e P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.056000  3102 tablet_replica.cc:333] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.056469  3102 raft_consensus.cc:2243] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.057153  3102 raft_consensus.cc:2272] T 7083196608e84b20b65b0c53c528d4d3 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.058984  3102 tablet_replica.cc:333] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.059719  3102 raft_consensus.cc:2243] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.060858  3102 raft_consensus.cc:2272] T 73bbd93e93934a568405bc6dbe1d4877 P 5703388aa4f747c280bf93e578f6bad7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.062971  3102 tablet_replica.cc:333] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.063525  3102 raft_consensus.cc:2243] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.064335  3102 raft_consensus.cc:2272] T c3aa16e74031433c95a793a2a839503b P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.066855  3102 tablet_replica.cc:333] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.067742  3102 raft_consensus.cc:2243] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.068153  3102 raft_consensus.cc:2272] T 0f80c13834594ea58841f45cbd2ced65 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.070509  3102 tablet_replica.cc:333] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.071094  3102 raft_consensus.cc:2243] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.071724 11613 raft_consensus.cc:493] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.072116  3102 raft_consensus.cc:2272] T 5480174671f54c06a686c1598f36a6e6 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.072278 11613 raft_consensus.cc:515] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:37.074450  3102 tablet_replica.cc:333] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.074481 11613 leader_election.cc:290] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:37.075341  3102 raft_consensus.cc:2243] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.076387  3102 raft_consensus.cc:2272] T bccd8757dfaa4ea6976b07cb5734fecf P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.079265  3102 tablet_replica.cc:333] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.080051  3102 raft_consensus.cc:2243] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.080582  3102 raft_consensus.cc:2272] T c8577a637ba643f8a4061e59fe155f9f P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.080927 10669 leader_election.cc:336] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111)
W20260709 12:23:37.081497 10666 leader_election.cc:336] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:37.081943 10666 leader_election.cc:304] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.082530 11613 raft_consensus.cc:2749] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.082973  3102 tablet_replica.cc:333] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.083700  3102 raft_consensus.cc:2243] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.084472  3102 raft_consensus.cc:2272] T abfc8bc479844f489e1971345747ec0a P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.086395  3102 tablet_replica.cc:333] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.086841  3102 raft_consensus.cc:2243] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.087185  3102 raft_consensus.cc:2272] T f1674e84a5d245b4aa6ed2f18f24cf87 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.089157  3102 tablet_replica.cc:333] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.089818  3102 raft_consensus.cc:2243] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.090322  3102 raft_consensus.cc:2272] T e9e217311b654a3999a76cac4fed6129 P 5703388aa4f747c280bf93e578f6bad7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.092535  3102 tablet_replica.cc:333] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7: stopping tablet replica
I20260709 12:23:37.093128  3102 raft_consensus.cc:2243] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.093598  3102 raft_consensus.cc:2272] T 935517510de547e9a555aa468eea1a10 P 5703388aa4f747c280bf93e578f6bad7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.094266 10669 consensus_peers.cc:597] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.162591  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
W20260709 12:23:37.165213 10669 consensus_peers.cc:597] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.131:37591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.166393 11613 raft_consensus.cc:493] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.166987 11613 raft_consensus.cc:515] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:37.169060 11613 leader_election.cc:290] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:37.173332 10666 leader_election.cc:336] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:37.173892 10669 leader_election.cc:336] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111)
I20260709 12:23:37.174291 10669 leader_election.cc:304] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.175089 11613 raft_consensus.cc:2749] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.194885 11613 raft_consensus.cc:493] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.195475 11613 raft_consensus.cc:515] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:37.197540 11613 leader_election.cc:290] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:37.202960 10666 leader_election.cc:336] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:37.203754 10669 leader_election.cc:336] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111)
I20260709 12:23:37.204306 10669 leader_election.cc:304] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.205101 11613 raft_consensus.cc:2749] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.215199 11613 raft_consensus.cc:493] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.215817 11613 raft_consensus.cc:515] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
W20260709 12:23:37.217346 10669 consensus_peers.cc:597] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.131:37591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.219010 11613 leader_election.cc:290] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
W20260709 12:23:37.222170 10666 leader_election.cc:336] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:37.224392 10669 leader_election.cc:336] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111)
I20260709 12:23:37.224861 10669 leader_election.cc:304] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.225666 11613 raft_consensus.cc:2749] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.248713  3102 tablet_server.cc:179] TabletServer@127.3.7.132:0 shutting down...
I20260709 12:23:37.248888 11613 raft_consensus.cc:493] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.250974 11613 raft_consensus.cc:515] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
W20260709 12:23:37.252278 10669 consensus_peers.cc:597] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.131:37591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.253530 11613 leader_election.cc:290] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
W20260709 12:23:37.258534 10669 leader_election.cc:336] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Network error: Client connection negotiation failed: client connection to 127.3.7.131:37591: connect: Connection refused (error 111)
W20260709 12:23:37.261322 10666 leader_election.cc:336] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:37.261737 10666 leader_election.cc:304] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.262434 11637 raft_consensus.cc:2749] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.296474  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:37.296907 11613 raft_consensus.cc:493] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.297417  3102 tablet_replica.cc:333] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.297571 11613 raft_consensus.cc:515] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5703388aa4f747c280bf93e578f6bad7" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 37591 } } peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } }
I20260709 12:23:37.298612  3102 raft_consensus.cc:2243] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.299587 11613 leader_election.cc:290] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591), bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267)
I20260709 12:23:37.299780  3102 raft_consensus.cc:2272] T 483a0bc6f3d945efaabbad914d574e84 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.302531  3102 tablet_replica.cc:333] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.303472  3102 raft_consensus.cc:2243] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:37.303961 10666 leader_election.cc:336] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:37.304107  3102 raft_consensus.cc:2272] T a3175d59583845a9aa8e63d4982cf0c0 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.304792 10669 leader_election.cc:336] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Network error: Client connection negotiation failed: client connection to 127.3.7.131:37591: connect: Connection refused (error 111)
I20260709 12:23:37.305179 10669 leader_election.cc:304] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 5703388aa4f747c280bf93e578f6bad7, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.305833 11613 raft_consensus.cc:2749] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.306720  3102 tablet_replica.cc:333] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.307438  3102 raft_consensus.cc:2243] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.307873  3102 raft_consensus.cc:2272] T daf3398d20ad4a14a89bcff5962ec30d P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.309695  3102 tablet_replica.cc:333] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.310278  3102 raft_consensus.cc:2243] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.311028  3102 raft_consensus.cc:2272] T 8204fe73f2004e518c32b6310ee18b82 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.312240 11637 raft_consensus.cc:493] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.312819 11637 raft_consensus.cc:515] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:37.313299  3102 tablet_replica.cc:333] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.314113  3102 raft_consensus.cc:2243] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.314555  3102 raft_consensus.cc:2272] T 85284a3fbf5b49628135573479cf48d6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.315306 11637 leader_election.cc:290] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:37.317246  3102 tablet_replica.cc:333] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.318020  3102 raft_consensus.cc:2243] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.318732  3102 raft_consensus.cc:2272] T 8e51200a353f4204a472f75887547285 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.319954 10666 leader_election.cc:336] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
W20260709 12:23:37.320645 10669 leader_election.cc:336] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111)
I20260709 12:23:37.320957 10669 leader_election.cc:304] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.321547 11637 raft_consensus.cc:2749] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.321882  3102 tablet_replica.cc:333] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.322793  3102 raft_consensus.cc:2243] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.323832  3102 raft_consensus.cc:2272] T 0e9f415c2c9243428aacae2dc707b9d1 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.327021  3102 tablet_replica.cc:333] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.327733  3102 raft_consensus.cc:2243] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.328192  3102 raft_consensus.cc:2272] T fc875de41c5440e78f3da51713684d46 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.330123  3102 tablet_replica.cc:333] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.330705  3102 raft_consensus.cc:2243] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.331139  3102 raft_consensus.cc:2272] T fcc42f485018420e94dafb287e1f73b5 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.333187  3102 tablet_replica.cc:333] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.333782  3102 raft_consensus.cc:2243] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.334586  3102 raft_consensus.cc:2272] T fab9491812e14055a4628f9b82270f73 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.338150  3102 tablet_replica.cc:333] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.338860  3102 raft_consensus.cc:2243] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.339506  3102 raft_consensus.cc:2272] T 41ad3183541b4bb29af186841577e9f6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.341934  3102 tablet_replica.cc:333] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.342602  3102 raft_consensus.cc:2243] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.343114  3102 raft_consensus.cc:2272] T 75cfb94c077d4b08b3644c08191e8af3 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.344726 10669 consensus_peers.cc:597] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c -> Peer 5703388aa4f747c280bf93e578f6bad7 (127.3.7.131:37591): Couldn't send request to peer 5703388aa4f747c280bf93e578f6bad7. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.131:37591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.345362  3102 tablet_replica.cc:333] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.345955  3102 raft_consensus.cc:2243] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.346360  3102 raft_consensus.cc:2272] T 5c174a58645b464782b247e7837bb5ff P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.348361  3102 tablet_replica.cc:333] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.348884  3102 raft_consensus.cc:2243] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.349252  3102 raft_consensus.cc:2272] T 69fa17fbe6be4fe9a202b19d42b57529 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.351104  3102 tablet_replica.cc:333] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.351724  3102 raft_consensus.cc:2243] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.352121  3102 raft_consensus.cc:2272] T 4362cb4cea024bab8e1befd005c38931 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.353639 11637 raft_consensus.cc:493] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8b600238cd49d29a1bd59a571ab995)
I20260709 12:23:37.354099  3102 tablet_replica.cc:333] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.354101 11637 raft_consensus.cc:515] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "becf98b94b704731a507d96d1a44737c" member_type: VOTER last_known_addr { host: "127.3.7.132" port: 42917 } } peers { permanent_uuid: "bb8b600238cd49d29a1bd59a571ab995" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 45267 } } peers { permanent_uuid: "2da3f34a85954a319ed87fd378e5e661" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 42241 } }
I20260709 12:23:37.354786  3102 raft_consensus.cc:2243] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.355947  3102 raft_consensus.cc:2272] T 99999f0404c846758d5ec30143015bc4 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.356631 11637 leader_election.cc:290] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267), 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241)
I20260709 12:23:37.358786  3102 tablet_replica.cc:333] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.359520  3102 raft_consensus.cc:2243] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.360518  3102 raft_consensus.cc:2272] T 7a978264a6a14ca296d74a58c7d58705 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.361599 10669 leader_election.cc:336] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2da3f34a85954a319ed87fd378e5e661 (127.3.7.130:42241): Network error: Client connection negotiation failed: client connection to 127.3.7.130:42241: connect: Connection refused (error 111)
W20260709 12:23:37.362175 10666 leader_election.cc:336] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8b600238cd49d29a1bd59a571ab995 (127.3.7.129:45267): Network error: Client connection negotiation failed: client connection to 127.3.7.129:45267: connect: Connection refused (error 111)
I20260709 12:23:37.362553 10666 leader_election.cc:304] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becf98b94b704731a507d96d1a44737c; no voters: 2da3f34a85954a319ed87fd378e5e661, bb8b600238cd49d29a1bd59a571ab995
I20260709 12:23:37.363135  3102 tablet_replica.cc:333] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.363237 11637 raft_consensus.cc:2749] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.364029  3102 raft_consensus.cc:2243] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.364559  3102 raft_consensus.cc:2272] T 2b394c6b2e7544aa890058148e0ac514 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.366966  3102 tablet_replica.cc:333] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.367827  3102 raft_consensus.cc:2243] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.368602  3102 raft_consensus.cc:2272] T 516058c81d8243688175010331c582ee P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.370412  3102 tablet_replica.cc:333] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.370904  3102 raft_consensus.cc:2243] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.371260  3102 raft_consensus.cc:2272] T fccafdd46a364d3584441cf6aab82cf8 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.373113  3102 tablet_replica.cc:333] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.373736  3102 raft_consensus.cc:2243] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.374122  3102 raft_consensus.cc:2272] T abfc8bc479844f489e1971345747ec0a P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.376240  3102 tablet_replica.cc:333] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.376747  3102 raft_consensus.cc:2243] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.377439  3102 raft_consensus.cc:2272] T 38a4197603f34f92bea91d9a4641abbd P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.379707  3102 tablet_replica.cc:333] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.380375  3102 raft_consensus.cc:2243] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.380823  3102 raft_consensus.cc:2272] T fc30d8c3835c47719e8e2711dd5dd271 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.382776  3102 tablet_replica.cc:333] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.383481  3102 raft_consensus.cc:2243] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.383917  3102 raft_consensus.cc:2272] T c862ff91f7484100b8a72ae26d09b8c1 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.385862  3102 tablet_replica.cc:333] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.386461  3102 raft_consensus.cc:2243] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.386894  3102 raft_consensus.cc:2272] T 78d6d3887b1d47638ed56acc7074311b P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.389017  3102 tablet_replica.cc:333] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.389611  3102 raft_consensus.cc:2243] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.390439  3102 raft_consensus.cc:2272] T f8af59f95c2f43cc9cd8093395b00e10 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.392870  3102 tablet_replica.cc:333] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.393832  3102 raft_consensus.cc:2243] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.394806  3102 raft_consensus.cc:2272] T 8eb2769bf67740918d65b198cc6cac17 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.397255  3102 tablet_replica.cc:333] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.397778  3102 raft_consensus.cc:2243] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.398514  3102 raft_consensus.cc:2272] T e7a83257d2814ade9d44473bff639778 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.400527  3102 tablet_replica.cc:333] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.401039  3102 raft_consensus.cc:2243] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.401467  3102 raft_consensus.cc:2272] T 5480174671f54c06a686c1598f36a6e6 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.403499  3102 tablet_replica.cc:333] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.404019  3102 raft_consensus.cc:2243] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.404899  3102 raft_consensus.cc:2272] T a33216b1d944418dbcc3a556377d0670 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.406826  3102 tablet_replica.cc:333] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.407387  3102 raft_consensus.cc:2243] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.408150  3102 raft_consensus.cc:2272] T 5986a6cceb0d4ee4ba760b56e3a47fab P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.410092  3102 tablet_replica.cc:333] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.410638  3102 raft_consensus.cc:2243] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.411008  3102 raft_consensus.cc:2272] T 72e198a442da43a78d7375424fa47317 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.413014  3102 tablet_replica.cc:333] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.413528  3102 raft_consensus.cc:2243] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.413908  3102 raft_consensus.cc:2272] T bccd8757dfaa4ea6976b07cb5734fecf P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.415917  3102 tablet_replica.cc:333] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.416420  3102 raft_consensus.cc:2243] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.416791  3102 raft_consensus.cc:2272] T c8577a637ba643f8a4061e59fe155f9f P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.418653  3102 tablet_replica.cc:333] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.419173  3102 raft_consensus.cc:2243] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.419601  3102 raft_consensus.cc:2272] T 814d4d8348e448728625bdcbaf25f440 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.421471  3102 tablet_replica.cc:333] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.421973  3102 raft_consensus.cc:2243] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.422343  3102 raft_consensus.cc:2272] T c8b4dbad2b434c9fbf4dd26ec67449f2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.424394  3102 tablet_replica.cc:333] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.424893  3102 raft_consensus.cc:2243] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.425261  3102 raft_consensus.cc:2272] T c5186731547d45a68e190092f5f7a7c2 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.427086  3102 tablet_replica.cc:333] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.427661  3102 raft_consensus.cc:2243] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.428025  3102 raft_consensus.cc:2272] T 84deda81af094e08b2e7a4ed94f091c4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.429797  3102 tablet_replica.cc:333] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.430291  3102 raft_consensus.cc:2243] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.430986  3102 raft_consensus.cc:2272] T 935517510de547e9a555aa468eea1a10 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.432950  3102 tablet_replica.cc:333] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.433449  3102 raft_consensus.cc:2243] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.433800  3102 raft_consensus.cc:2272] T 73bbd93e93934a568405bc6dbe1d4877 P becf98b94b704731a507d96d1a44737c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.435742  3102 tablet_replica.cc:333] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.436216  3102 raft_consensus.cc:2243] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.436594  3102 raft_consensus.cc:2272] T 7083196608e84b20b65b0c53c528d4d3 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.438436  3102 tablet_replica.cc:333] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.438894  3102 raft_consensus.cc:2243] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.439692  3102 raft_consensus.cc:2272] T ff41525191314521b655a8d37cb1a242 P becf98b94b704731a507d96d1a44737c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.441514  3102 tablet_replica.cc:333] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.441968  3102 raft_consensus.cc:2243] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.442349  3102 raft_consensus.cc:2272] T 23d44f30f58f4416a927ce5433bfe923 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.444176  3102 tablet_replica.cc:333] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c: stopping tablet replica
I20260709 12:23:37.444579  3102 raft_consensus.cc:2243] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.445010  3102 raft_consensus.cc:2272] T 54527023f4db4ec3bdbcc711a0b053a4 P becf98b94b704731a507d96d1a44737c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.515221  3102 tablet_server.cc:196] TabletServer@127.3.7.132:0 shutdown complete.
I20260709 12:23:37.577934  3102 master.cc:562] Master@127.3.7.190:35777 shutting down...
I20260709 12:23:37.603078  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.603744  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.604123  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f6d3cbc67744fca86e03623203f37d0: stopping tablet replica
I20260709 12:23:37.627581  3102 master.cc:584] Master@127.3.7.190:35777 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32342 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:23:37.725522  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:45419
I20260709 12:23:37.726728  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.733592 11643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.733592 11642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.733803 11645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.734381  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:37.735718  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:37.735898  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.736073  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599817736058 us; error 0 us; skew 500 ppm
I20260709 12:23:37.736665  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.740310  3102 webserver.cc:533] Webserver started at http://127.3.7.190:46693/ using document root <none> and password file <none>
I20260709 12:23:37.741061  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.741310  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:37.741674  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:37.743090  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "668345560d6f4fa5b3c0cbbffa684210"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-6qf7"
I20260709 12:23:37.747682  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:23:37.751556 11650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.752359  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:37.752665  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "668345560d6f4fa5b3c0cbbffa684210"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-6qf7"
I20260709 12:23:37.752976  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:37.783752  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:37.785055  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:37.826524  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:45419
I20260709 12:23:37.826623 11702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:45419 every 8 connection(s)
I20260709 12:23:37.831161 11703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:37.842904 11703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210: Bootstrap starting.
I20260709 12:23:37.847956 11703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:37.852289 11703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210: No bootstrap required, opened a new log
I20260709 12:23:37.854570 11703 raft_consensus.cc:359] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668345560d6f4fa5b3c0cbbffa684210" member_type: VOTER }
I20260709 12:23:37.855010 11703 raft_consensus.cc:385] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:37.855221 11703 raft_consensus.cc:740] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668345560d6f4fa5b3c0cbbffa684210, State: Initialized, Role: FOLLOWER
I20260709 12:23:37.855882 11703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668345560d6f4fa5b3c0cbbffa684210" member_type: VOTER }
I20260709 12:23:37.856345 11703 raft_consensus.cc:399] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:37.856570 11703 raft_consensus.cc:493] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:37.856838 11703 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:37.861673 11703 raft_consensus.cc:515] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668345560d6f4fa5b3c0cbbffa684210" member_type: VOTER }
I20260709 12:23:37.862213 11703 leader_election.cc:304] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 668345560d6f4fa5b3c0cbbffa684210; no voters: 
I20260709 12:23:37.863452 11703 leader_election.cc:290] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:37.863822 11706 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:37.865301 11706 raft_consensus.cc:697] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 1 LEADER]: Becoming Leader. State: Replica: 668345560d6f4fa5b3c0cbbffa684210, State: Running, Role: LEADER
I20260709 12:23:37.866030 11706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668345560d6f4fa5b3c0cbbffa684210" member_type: VOTER }
I20260709 12:23:37.866437 11703 sys_catalog.cc:565] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:37.870684 11707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "668345560d6f4fa5b3c0cbbffa684210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668345560d6f4fa5b3c0cbbffa684210" member_type: VOTER } }
I20260709 12:23:37.870864 11708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 668345560d6f4fa5b3c0cbbffa684210. Latest consensus state: current_term: 1 leader_uuid: "668345560d6f4fa5b3c0cbbffa684210" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "668345560d6f4fa5b3c0cbbffa684210" member_type: VOTER } }
I20260709 12:23:37.871585 11707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:37.871733 11708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:37.875195 11713 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:37.882259 11713 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:37.883628  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:37.891896 11713 catalog_manager.cc:1383] Generated new cluster ID: 1b33ec9f867147b48e8590b454e0418c
I20260709 12:23:37.892305 11713 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:37.911135 11713 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:37.912518 11713 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:37.924060 11713 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210: Generated new TSK 0
I20260709 12:23:37.924710 11713 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:37.951215  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.957564 11724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.958711 11725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.965876 11727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.967623  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:37.969521  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:37.969750  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.969933  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599817969911 us; error 0 us; skew 500 ppm
I20260709 12:23:37.970489  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.972862  3102 webserver.cc:533] Webserver started at http://127.3.7.129:45791/ using document root <none> and password file <none>
I20260709 12:23:37.973348  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.973537  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:37.973814  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:37.974918  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-6qf7"
I20260709 12:23:37.979833  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:23:37.983263 11732 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.984095  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:23:37.984405  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-6qf7"
I20260709 12:23:37.984659  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:37.998140  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:37.999392  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.000906  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.003286  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.003536  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.003801  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.003991  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.044407  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:38811
I20260709 12:23:38.044497 11794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:38811 every 8 connection(s)
I20260709 12:23:38.049644  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.058240 11799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.060400 11800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.062189  3102 server_base.cc:1061] running on GCE node
W20260709 12:23:38.063374 11802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.064428  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.064652  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.064862  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599818064845 us; error 0 us; skew 500 ppm
I20260709 12:23:38.065507  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.068540  3102 webserver.cc:533] Webserver started at http://127.3.7.130:37479/ using document root <none> and password file <none>
I20260709 12:23:38.069156  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.069322 11795 heartbeater.cc:344] Connected to a master server at 127.3.7.190:45419
I20260709 12:23:38.069401  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.069898 11795 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.069928  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.070760 11795 heartbeater.cc:507] Master 127.3.7.190:45419 requested a full tablet report, sending...
I20260709 12:23:38.071533  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "c6e6a3c53bfa481c882acde3c2298504"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-6qf7"
I20260709 12:23:38.073107 11668 ts_manager.cc:194] Registered new tserver with Master: 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811)
I20260709 12:23:38.074940 11668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53274
I20260709 12:23:38.077278  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:38.081806 11807 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.082741  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:23:38.083079  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "c6e6a3c53bfa481c882acde3c2298504"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-6qf7"
I20260709 12:23:38.083457  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.106526  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.107741  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.109138  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.111368  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.111578  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.111831  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.112002  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.155210  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:35895
I20260709 12:23:38.155433 11869 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:35895 every 8 connection(s)
I20260709 12:23:38.160735  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.168566 11873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.169685 11874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.173185  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:38.173974 11870 heartbeater.cc:344] Connected to a master server at 127.3.7.190:45419
W20260709 12:23:38.173871 11876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.174580 11870 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.175397  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:38.175479 11870 heartbeater.cc:507] Master 127.3.7.190:45419 requested a full tablet report, sending...
W20260709 12:23:38.175740  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.176018  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599818175996 us; error 0 us; skew 500 ppm
I20260709 12:23:38.176842  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.178221 11668 ts_manager.cc:194] Registered new tserver with Master: c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:38.179935  3102 webserver.cc:533] Webserver started at http://127.3.7.131:33043/ using document root <none> and password file <none>
I20260709 12:23:38.180641  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.180529 11668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53286
I20260709 12:23:38.180948  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.181283  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.182701  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "d9039ce38c924681aee4310f76e56152"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-6qf7"
I20260709 12:23:38.188124  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:23:38.191988 11881 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.192893  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:38.193245  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "d9039ce38c924681aee4310f76e56152"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-6qf7"
I20260709 12:23:38.193593  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.216086  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.217306  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.218752  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.221076  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.221304  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.221541  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.221721  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.268332  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:34947
I20260709 12:23:38.268431 11945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:34947 every 8 connection(s)
I20260709 12:23:38.283987 11946 heartbeater.cc:344] Connected to a master server at 127.3.7.190:45419
I20260709 12:23:38.284423 11946 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.285277 11946 heartbeater.cc:507] Master 127.3.7.190:45419 requested a full tablet report, sending...
I20260709 12:23:38.287796 11668 ts_manager.cc:194] Registered new tserver with Master: d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:38.288635  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016564664s
I20260709 12:23:38.289480 11668 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53290
I20260709 12:23:38.316495 11668 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53304:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:38.319551 11668 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:38.417879 11909 tablet_service.cc:1511] Processing CreateTablet for tablet 601dd34af6dc4695a6881e76a0d77677 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:38.419526 11909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601dd34af6dc4695a6881e76a0d77677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.421020 11835 tablet_service.cc:1511] Processing CreateTablet for tablet 601dd34af6dc4695a6881e76a0d77677 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:38.422533 11835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601dd34af6dc4695a6881e76a0d77677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.424787 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 601dd34af6dc4695a6881e76a0d77677 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:38.426263 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601dd34af6dc4695a6881e76a0d77677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.428450 11759 tablet_service.cc:1511] Processing CreateTablet for tablet 8780dfd6f2724b8294d04ad5eb2c99e2 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:38.429874 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8780dfd6f2724b8294d04ad5eb2c99e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.432495 11758 tablet_service.cc:1511] Processing CreateTablet for tablet 37ba1c2ccfbd4e37b71936ba9dff2c18 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:38.433913 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ba1c2ccfbd4e37b71936ba9dff2c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.434434 11834 tablet_service.cc:1511] Processing CreateTablet for tablet 8780dfd6f2724b8294d04ad5eb2c99e2 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:38.435864 11834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8780dfd6f2724b8294d04ad5eb2c99e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.436256 11755 tablet_service.cc:1511] Processing CreateTablet for tablet f8e3f8c9ef1e4c0aba0549f0636e49ea (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:38.437701 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3f8c9ef1e4c0aba0549f0636e49ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.440485 11756 tablet_service.cc:1511] Processing CreateTablet for tablet ceff787e20a34d7295798261202a25a5 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:38.441949 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceff787e20a34d7295798261202a25a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.444478 11757 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2b86af086d44c88042620a6c18aebb (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:38.446040 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2b86af086d44c88042620a6c18aebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.447186 11961 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:38.452135 11833 tablet_service.cc:1511] Processing CreateTablet for tablet 37ba1c2ccfbd4e37b71936ba9dff2c18 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:38.453720 11833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ba1c2ccfbd4e37b71936ba9dff2c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.454993 11961 tablet_bootstrap.cc:654] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.458758 11962 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:38.466543 11832 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2b86af086d44c88042620a6c18aebb (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:38.468181 11962 tablet_bootstrap.cc:654] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.468825 11832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2b86af086d44c88042620a6c18aebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.466584 11908 tablet_service.cc:1511] Processing CreateTablet for tablet 8780dfd6f2724b8294d04ad5eb2c99e2 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:38.476212 11830 tablet_service.cc:1511] Processing CreateTablet for tablet f8e3f8c9ef1e4c0aba0549f0636e49ea (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:38.477005 11908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8780dfd6f2724b8294d04ad5eb2c99e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.477042 11758 tablet_service.cc:1511] Processing CreateTablet for tablet f67839d742a1420e8173615d4f72f690 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:38.478585 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67839d742a1420e8173615d4f72f690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.470183 11961 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:38.477690 11830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3f8c9ef1e4c0aba0549f0636e49ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.480537 11961 ts_tablet_manager.cc:1403] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.015s
I20260709 12:23:38.473901 11831 tablet_service.cc:1511] Processing CreateTablet for tablet ceff787e20a34d7295798261202a25a5 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:38.481942 11831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceff787e20a34d7295798261202a25a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.494925 11829 tablet_service.cc:1511] Processing CreateTablet for tablet f67839d742a1420e8173615d4f72f690 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:38.496899 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67839d742a1420e8173615d4f72f690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.542699 11961 raft_consensus.cc:359] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.550740 11909 tablet_service.cc:1511] Processing CreateTablet for tablet 37ba1c2ccfbd4e37b71936ba9dff2c18 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:38.556977 11827 tablet_service.cc:1511] Processing CreateTablet for tablet ef315b48ad574dfdb519f5ca0fd57fc0 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:38.558334 11909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37ba1c2ccfbd4e37b71936ba9dff2c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.558389 11827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef315b48ad574dfdb519f5ca0fd57fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.558748 11961 raft_consensus.cc:385] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.559186 11961 raft_consensus.cc:740] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.556313 11907 tablet_service.cc:1511] Processing CreateTablet for tablet 2e2b86af086d44c88042620a6c18aebb (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:38.564214 11907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e2b86af086d44c88042620a6c18aebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.563901 11961 consensus_queue.cc:260] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.553824 11828 tablet_service.cc:1511] Processing CreateTablet for tablet 2b54e61a43584a0d985dde3b02010a78 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:38.571534 11828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b54e61a43584a0d985dde3b02010a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.572753 11826 tablet_service.cc:1511] Processing CreateTablet for tablet d376952b48234211a6108de545b38d10 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:38.574159 11826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d376952b48234211a6108de545b38d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.572852 11754 tablet_service.cc:1511] Processing CreateTablet for tablet ef315b48ad574dfdb519f5ca0fd57fc0 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:38.579582 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef315b48ad574dfdb519f5ca0fd57fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.589035 11906 tablet_service.cc:1511] Processing CreateTablet for tablet ceff787e20a34d7295798261202a25a5 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:38.589993 11759 tablet_service.cc:1511] Processing CreateTablet for tablet d376952b48234211a6108de545b38d10 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:38.590252 11757 tablet_service.cc:1511] Processing CreateTablet for tablet 2b54e61a43584a0d985dde3b02010a78 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:38.591107 11906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceff787e20a34d7295798261202a25a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.596668 11905 tablet_service.cc:1511] Processing CreateTablet for tablet f8e3f8c9ef1e4c0aba0549f0636e49ea (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:38.598160 11905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3f8c9ef1e4c0aba0549f0636e49ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.600401 11904 tablet_service.cc:1511] Processing CreateTablet for tablet f67839d742a1420e8173615d4f72f690 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:38.601855 11904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67839d742a1420e8173615d4f72f690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.603441 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d376952b48234211a6108de545b38d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.604513 11903 tablet_service.cc:1511] Processing CreateTablet for tablet 2b54e61a43584a0d985dde3b02010a78 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:38.605949 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b54e61a43584a0d985dde3b02010a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.608515 11902 tablet_service.cc:1511] Processing CreateTablet for tablet ef315b48ad574dfdb519f5ca0fd57fc0 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:38.609937 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef315b48ad574dfdb519f5ca0fd57fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.616992 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b54e61a43584a0d985dde3b02010a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.620609 11901 tablet_service.cc:1511] Processing CreateTablet for tablet d376952b48234211a6108de545b38d10 (DEFAULT_TABLE table=test-workload [id=1a155dce6e1f4d6a9a3ff30e9c05d0ca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:38.622604 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d376952b48234211a6108de545b38d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.644990 11962 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:38.645732 11962 ts_tablet_manager.cc:1403] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.187s	user 0.025s	sys 0.028s
I20260709 12:23:38.650480 11961 ts_tablet_manager.cc:1434] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.169s	user 0.012s	sys 0.036s
I20260709 12:23:38.651610 11946 heartbeater.cc:499] Master 127.3.7.190:45419 was elected leader, sending a full tablet report...
I20260709 12:23:38.655089 11962 raft_consensus.cc:359] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.659804 11962 raft_consensus.cc:385] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.660205 11962 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.661278 11962 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.662711 11961 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:38.699966 11795 heartbeater.cc:499] Master 127.3.7.190:45419 was elected leader, sending a full tablet report...
I20260709 12:23:38.703765 11965 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:38.722254 11961 tablet_bootstrap.cc:654] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.728662 11962 ts_tablet_manager.cc:1434] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.083s	user 0.018s	sys 0.015s
I20260709 12:23:38.729812 11962 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:38.730996 11961 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:38.731575 11961 ts_tablet_manager.cc:1403] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.003s
I20260709 12:23:38.734910 11961 raft_consensus.cc:359] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.735673 11961 raft_consensus.cc:385] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.735987 11961 raft_consensus.cc:740] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.736750 11962 tablet_bootstrap.cc:654] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.736814 11961 consensus_queue.cc:260] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.739856 11961 ts_tablet_manager.cc:1434] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:38.741492 11961 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:38.748812 11962 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:38.749408 11962 ts_tablet_manager.cc:1403] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:23:38.749603 11961 tablet_bootstrap.cc:654] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.752518 11962 raft_consensus.cc:359] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.753585 11962 raft_consensus.cc:385] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.753908 11962 raft_consensus.cc:740] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.754846 11962 consensus_queue.cc:260] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.755363 11965 tablet_bootstrap.cc:654] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.756155 11961 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:38.756680 11961 ts_tablet_manager.cc:1403] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:23:38.757032 11962 ts_tablet_manager.cc:1434] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:38.758069 11962 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:38.759650 11961 raft_consensus.cc:359] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.760406 11961 raft_consensus.cc:385] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.760687 11961 raft_consensus.cc:740] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.761636 11961 consensus_queue.cc:260] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.765236 11962 tablet_bootstrap.cc:654] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.772131 11961 ts_tablet_manager.cc:1434] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:23:38.772434 11965 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
W20260709 12:23:38.773178 11947 tablet.cc:2406] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:38.774080 11965 ts_tablet_manager.cc:1403] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.006s
I20260709 12:23:38.775852 11961 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:38.777184 11962 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:38.777714 11962 ts_tablet_manager.cc:1403] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:23:38.777619 11965 raft_consensus.cc:359] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.778573 11965 raft_consensus.cc:385] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.778970 11965 raft_consensus.cc:740] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.779978 11965 consensus_queue.cc:260] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.781126 11962 raft_consensus.cc:359] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.781998 11962 raft_consensus.cc:385] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.782326 11962 raft_consensus.cc:740] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.782470 11870 heartbeater.cc:499] Master 127.3.7.190:45419 was elected leader, sending a full tablet report...
I20260709 12:23:38.782809 11961 tablet_bootstrap.cc:654] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.783231 11962 consensus_queue.cc:260] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.786338 11962 ts_tablet_manager.cc:1434] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:23:38.787365 11962 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:38.795185 11962 tablet_bootstrap.cc:654] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.797202 11973 raft_consensus.cc:493] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.797976 11973 raft_consensus.cc:515] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.810672 11965 ts_tablet_manager.cc:1434] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:23:38.813639 11965 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:38.814018 11966 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.816186 11966 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.819825 11966 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:38.830273 11965 tablet_bootstrap.cc:654] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.844421 11965 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:38.845304 11965 ts_tablet_manager.cc:1403] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 12:23:38.850096 11966 raft_consensus.cc:493] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.850863 11966 raft_consensus.cc:515] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.851791 11973 leader_election.cc:290] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:38.853893 11966 leader_election.cc:290] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:38.849850 11965 raft_consensus.cc:359] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.855840 11965 raft_consensus.cc:385] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.856303 11965 raft_consensus.cc:740] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.861690 11965 consensus_queue.cc:260] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.865108 11965 ts_tablet_manager.cc:1434] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:23:38.866979 11965 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:38.870745 11967 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.871536 11967 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.877218 11965 tablet_bootstrap.cc:654] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.878423 11967 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
W20260709 12:23:38.879289 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:38.891265 11965 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:38.892234 11965 ts_tablet_manager.cc:1403] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.010s
I20260709 12:23:38.896621 11965 raft_consensus.cc:359] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.897763 11965 raft_consensus.cc:385] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.898229 11965 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.899416 11965 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.902853 11965 ts_tablet_manager.cc:1434] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:38.904325 11965 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:38.912936 11965 tablet_bootstrap.cc:654] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.919552 11973 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.920359 11973 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.923436 11973 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:38.931856 11965 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:38.932796 11965 ts_tablet_manager.cc:1403] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.004s
I20260709 12:23:38.937536 11965 raft_consensus.cc:359] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.938879 11965 raft_consensus.cc:385] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.939440 11965 raft_consensus.cc:740] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.940770 11965 consensus_queue.cc:260] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.944578 11965 ts_tablet_manager.cc:1434] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:23:38.946301 11965 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:38.951736 11967 raft_consensus.cc:493] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.952646 11967 raft_consensus.cc:515] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.956099 11967 leader_election.cc:290] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:38.957918 11965 tablet_bootstrap.cc:654] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.976850 11962 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:38.977463 11962 ts_tablet_manager.cc:1403] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.190s	user 0.091s	sys 0.088s
I20260709 12:23:38.980435 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:38.980989 11962 raft_consensus.cc:359] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.981729 11962 raft_consensus.cc:385] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.982182 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:38.982303 11962 raft_consensus.cc:740] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.982858 11769 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 0.
W20260709 12:23:38.984480 11811 leader_election.cc:343] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.985272 11811 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:38.986267 11973 raft_consensus.cc:2804] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:38.986644 11973 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.986996 11973 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.987377 11965 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:38.987989 11965 ts_tablet_manager.cc:1403] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.007s
I20260709 12:23:38.988468 11966 raft_consensus.cc:493] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.989018 11966 raft_consensus.cc:515] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:38.991459 11966 leader_election.cc:290] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:38.980530 11961 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:38.993204 11961 ts_tablet_manager.cc:1403] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.218s	user 0.090s	sys 0.103s
I20260709 12:23:38.997640 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:38.998683 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:38.999013 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:38.999516 11768 raft_consensus.cc:2468] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 0.
I20260709 12:23:38.996599 11973 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
W20260709 12:23:39.001067 11885 leader_election.cc:343] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:39.001955 11885 leader_election.cc:343] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.002462 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:39.002707 11885 leader_election.cc:304] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:39.003129 11768 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.003465 11961 raft_consensus.cc:359] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.004397 11961 raft_consensus.cc:385] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.004491 11966 raft_consensus.cc:2804] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.004803 11961 raft_consensus.cc:740] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.005041 11966 raft_consensus.cc:493] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.005517 11966 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.005992 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.006150 11961 consensus_queue.cc:260] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.007695 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.008853 11919 raft_consensus.cc:2468] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 0.
W20260709 12:23:39.010875 11733 leader_election.cc:343] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:38.983193 11962 consensus_queue.cc:260] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.011834 11733 leader_election.cc:304] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:39.014987 11962 ts_tablet_manager.cc:1434] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 12:23:39.016245 11962 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:39.017472 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.018213 11965 raft_consensus.cc:359] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.019095 11965 raft_consensus.cc:385] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.019490 11965 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.019212 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.020274 11919 raft_consensus.cc:2468] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 0.
I20260709 12:23:39.022619 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.023682 11967 raft_consensus.cc:2804] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.023866 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.024327 11967 raft_consensus.cc:493] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.024896 11967 raft_consensus.cc:3060] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.025619 11974 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.026197 11974 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.029876 11845 raft_consensus.cc:2393] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in current term 1: Already voted for candidate c6e6a3c53bfa481c882acde3c2298504 in this term.
I20260709 12:23:39.030145 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
W20260709 12:23:39.031350 11736 leader_election.cc:343] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:39.032255 11811 leader_election.cc:343] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.033814 11962 tablet_bootstrap.cc:654] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.032608 11974 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.032377 11736 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a; no voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.040297 11966 raft_consensus.cc:515] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.044862 11965 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.047170 11962 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:39.047890 11962 ts_tablet_manager.cc:1403] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 12:23:39.043180 11966 leader_election.cc:290] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:39.052901 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:39.050645 11965 ts_tablet_manager.cc:1434] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:23:39.053670 11770 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.054661 11965 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
W20260709 12:23:39.051354 11808 leader_election.cc:343] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.056864 11808 leader_election.cc:304] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:39.058493 11974 raft_consensus.cc:2804] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.062000 11962 raft_consensus.cc:359] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.062856 11962 raft_consensus.cc:385] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.063167 11962 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.064248 11962 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.058974 11974 raft_consensus.cc:493] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.065881 11974 raft_consensus.cc:3060] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.077306 11965 tablet_bootstrap.cc:654] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.081336 11962 ts_tablet_manager.cc:1434] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 12:23:39.082469 11962 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:39.085445 11993 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.086014 11993 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.089672 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.091059 11962 tablet_bootstrap.cc:654] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:39.091154 11733 leader_election.cc:343] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.092039 11993 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.093662 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.094380 11845 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 0.
I20260709 12:23:39.096158 11736 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.050657 11973 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.105299 11962 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:39.106055 11962 ts_tablet_manager.cc:1403] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:23:39.107533 11993 raft_consensus.cc:2804] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.108340 11993 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.108799 11993 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.110253 11962 raft_consensus.cc:359] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.111343 11962 raft_consensus.cc:385] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.111725 11962 raft_consensus.cc:740] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.112900 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.112994 11962 consensus_queue.cc:260] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.115206 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
W20260709 12:23:39.116851 11808 leader_election.cc:343] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.117460 11808 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152
W20260709 12:23:39.119503 11808 leader_election.cc:343] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.121619 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.123526 11973 raft_consensus.cc:2749] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.124117 11962 ts_tablet_manager.cc:1434] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.018s	user 0.015s	sys 0.003s
I20260709 12:23:39.128232 11962 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:39.128068 11967 raft_consensus.cc:515] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.131093 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
W20260709 12:23:39.132616 11736 leader_election.cc:343] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.135802 11768 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.136781 11991 raft_consensus.cc:2749] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.140524 11811 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.142189 11973 raft_consensus.cc:2804] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.143210 11962 tablet_bootstrap.cc:654] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.145360 11770 raft_consensus.cc:2468] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 1.
I20260709 12:23:39.148000 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.150050 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.152801 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:39.154771 11885 leader_election.cc:304] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:39.155846 11966 raft_consensus.cc:2804] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.156474 11966 raft_consensus.cc:697] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 1 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
W20260709 12:23:39.156883 11885 leader_election.cc:343] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.157788 11966 consensus_queue.cc:237] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.107009 11974 raft_consensus.cc:515] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.160801 11845 raft_consensus.cc:2393] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9039ce38c924681aee4310f76e56152 in current term 1: Already voted for candidate c6e6a3c53bfa481c882acde3c2298504 in this term.
I20260709 12:23:39.156375 11962 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:39.163887 11962 ts_tablet_manager.cc:1403] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.006s
I20260709 12:23:39.168931 11973 raft_consensus.cc:697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:39.170002 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.170940 11919 raft_consensus.cc:3060] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.167905 11962 raft_consensus.cc:359] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.171649 11962 raft_consensus.cc:385] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.172096 11962 raft_consensus.cc:740] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.172869 11962 consensus_queue.cc:260] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.175364 11962 ts_tablet_manager.cc:1434] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:23:39.176437 11962 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:39.179908 11919 raft_consensus.cc:2468] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 1.
I20260709 12:23:39.181937 11733 leader_election.cc:304] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:39.183355 11991 raft_consensus.cc:2804] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.184065 11991 raft_consensus.cc:697] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Becoming Leader. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Running, Role: LEADER
I20260709 12:23:39.185258 11991 consensus_queue.cc:237] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.171427 11967 leader_election.cc:290] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Requested vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.191793 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:39.170320 11973 consensus_queue.cc:237] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.192839 11768 raft_consensus.cc:3060] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.200313 11974 leader_election.cc:290] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.157577 11885 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:39.204172 11990 raft_consensus.cc:2749] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.205264 11961 ts_tablet_manager.cc:1434] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.212s	user 0.082s	sys 0.086s
I20260709 12:23:39.206580 11961 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:39.209770 11768 raft_consensus.cc:2468] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.212133 11965 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:39.214471 11965 ts_tablet_manager.cc:1403] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.160s	user 0.055s	sys 0.062s
I20260709 12:23:39.211930 11811 leader_election.cc:304] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.216352 11974 raft_consensus.cc:2804] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.216882 11974 raft_consensus.cc:697] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:39.217787 11974 consensus_queue.cc:237] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.217886 11965 raft_consensus.cc:359] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.218660 11965 raft_consensus.cc:385] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.218986 11965 raft_consensus.cc:740] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.219911 11965 consensus_queue.cc:260] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.232309 11961 tablet_bootstrap.cc:654] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.222529 11965 ts_tablet_manager.cc:1434] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:39.233974 11668 catalog_manager.cc:5697] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.236280 11962 tablet_bootstrap.cc:654] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.237378 11965 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:39.221891 11993 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.246866 11667 catalog_manager.cc:5697] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:39.244267 11885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.7.130:35895, user_credentials={real_user=slave}} blocked reactor thread for 87432.8us
W20260709 12:23:39.253010 11885 leader_election.cc:343] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:39.254024 11885 leader_election.cc:343] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.253444 11666 catalog_manager.cc:5697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.256639 11965 tablet_bootstrap.cc:654] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.256770 11993 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Requested vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.255096 11885 leader_election.cc:304] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:39.260262 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.260630 12001 raft_consensus.cc:3060] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.258215 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
W20260709 12:23:39.261502 11733 leader_election.cc:343] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.261694 11845 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.262411 11962 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:39.263057 11962 ts_tablet_manager.cc:1403] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.005s
I20260709 12:23:39.266104 11962 raft_consensus.cc:359] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.267038 11962 raft_consensus.cc:385] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.267354 11962 raft_consensus.cc:740] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.268360 11962 consensus_queue.cc:260] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.273312 11962 ts_tablet_manager.cc:1434] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:39.274464 11962 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:39.273432 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.275967 11845 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 1.
I20260709 12:23:39.280150 11965 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:39.280186 11736 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.280958 11965 ts_tablet_manager.cc:1403] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 12:23:39.281275 11993 raft_consensus.cc:2804] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.281951 11993 raft_consensus.cc:697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Becoming Leader. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Running, Role: LEADER
I20260709 12:23:39.282981 11993 consensus_queue.cc:237] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.283645 11961 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:39.283792 11965 raft_consensus.cc:359] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.284590 11965 raft_consensus.cc:385] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.284946 11965 raft_consensus.cc:740] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.285771 11965 consensus_queue.cc:260] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.286612 12001 raft_consensus.cc:2749] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.287878 11965 ts_tablet_manager.cc:1434] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:39.288776 11965 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:39.291814 11962 tablet_bootstrap.cc:654] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.294436 11965 tablet_bootstrap.cc:654] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.298599 11919 raft_consensus.cc:2468] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.304649 11991 raft_consensus.cc:493] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.305238 11991 raft_consensus.cc:515] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.284233 11961 ts_tablet_manager.cc:1403] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.001s
I20260709 12:23:39.309682 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.312606 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
W20260709 12:23:39.314798 11736 leader_election.cc:343] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.315927 11974 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.316193 11733 leader_election.cc:343] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.316676 11733 leader_election.cc:304] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a; no voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.316488 11974 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.317512 11967 raft_consensus.cc:2749] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.318322 11991 leader_election.cc:290] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.318774 11974 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.320897 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
W20260709 12:23:39.322906 11811 leader_election.cc:343] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.325223 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
W20260709 12:23:39.327288 11808 leader_election.cc:343] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.327898 11808 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.329465 11974 raft_consensus.cc:2749] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.310819 11961 raft_consensus.cc:359] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.331107 11961 raft_consensus.cc:385] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.331580 11961 raft_consensus.cc:740] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.332638 11961 consensus_queue.cc:260] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.338269 11962 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:39.338877 11962 ts_tablet_manager.cc:1403] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.065s	user 0.040s	sys 0.012s
I20260709 12:23:39.339346 11965 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:39.339959 11965 ts_tablet_manager.cc:1403] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.018s
I20260709 12:23:39.341321 11961 ts_tablet_manager.cc:1434] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:23:39.341856 11962 raft_consensus.cc:359] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.342445 11961 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:39.342612 11962 raft_consensus.cc:385] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.342993 11962 raft_consensus.cc:740] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.343034 11965 raft_consensus.cc:359] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.343950 11965 raft_consensus.cc:385] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.344502 11965 raft_consensus.cc:740] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.345626 11965 consensus_queue.cc:260] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.343879 11962 consensus_queue.cc:260] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.349036 11965 ts_tablet_manager.cc:1434] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:39.349987 11993 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.350253 11965 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:39.350576 11993 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.353034 11961 tablet_bootstrap.cc:654] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.354720 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.355468 11845 raft_consensus.cc:2468] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 0.
I20260709 12:23:39.356338 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.356910 11736 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.357877 11991 raft_consensus.cc:2804] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:39.358034 11733 leader_election.cc:343] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.358331 11991 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.358708 11991 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.358906 11965 tablet_bootstrap.cc:654] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.365723 11993 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.367740 11962 ts_tablet_manager.cc:1434] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:23:39.367278 11991 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.369189 11962 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:39.370721 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:39.371433 11845 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.374053 11667 catalog_manager.cc:5697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.378427 11962 tablet_bootstrap.cc:654] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.388104 11845 raft_consensus.cc:2468] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 1.
I20260709 12:23:39.389580 11736 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.390488 11993 raft_consensus.cc:2804] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.391130 11993 raft_consensus.cc:697] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Becoming Leader. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Running, Role: LEADER
I20260709 12:23:39.391940 11668 catalog_manager.cc:5697] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.392549 11993 consensus_queue.cc:237] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.396800 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
W20260709 12:23:39.398504 11733 leader_election.cc:343] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.399235 11991 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Requested vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.400009 11965 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:39.400681 11965 ts_tablet_manager.cc:1403] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.025s
I20260709 12:23:39.403028 11961 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:39.403676 11961 ts_tablet_manager.cc:1403] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.003s
I20260709 12:23:39.403666 11965 raft_consensus.cc:359] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.404520 11965 raft_consensus.cc:385] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.404840 11965 raft_consensus.cc:740] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.405730 11965 consensus_queue.cc:260] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.407533 11961 raft_consensus.cc:359] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.408309 11965 ts_tablet_manager.cc:1434] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:39.408437 11961 raft_consensus.cc:385] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.407660 11667 catalog_manager.cc:5697] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.408908 11961 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.409947 11961 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.411147 11962 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: No bootstrap required, opened a new log
I20260709 12:23:39.411713 11962 ts_tablet_manager.cc:1403] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.007s
I20260709 12:23:39.412758 11961 ts_tablet_manager.cc:1434] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:23:39.413026 11965 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504: Bootstrap starting.
I20260709 12:23:39.413851 11961 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:39.414499 11962 raft_consensus.cc:359] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.419884 11965 tablet_bootstrap.cc:654] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.421041 11961 tablet_bootstrap.cc:654] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.421795 11974 raft_consensus.cc:493] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.422377 11974 raft_consensus.cc:515] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.427811 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:39.428776 11768 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 0.
I20260709 12:23:39.429942 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.430938 11919 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 0.
I20260709 12:23:39.433041 11811 leader_election.cc:304] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.434682 11973 raft_consensus.cc:2804] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.435206 11973 raft_consensus.cc:493] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.436823 11973 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.439452 11974 leader_election.cc:290] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.455279 11965 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504: No bootstrap required, opened a new log
I20260709 12:23:39.415231 11962 raft_consensus.cc:385] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.455945 11965 ts_tablet_manager.cc:1403] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.024s
I20260709 12:23:39.458371 11973 raft_consensus.cc:515] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.455966 11962 raft_consensus.cc:740] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.460278 11962 consensus_queue.cc:260] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.460680 11973 leader_election.cc:290] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.459137 11965 raft_consensus.cc:359] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.462446 11962 ts_tablet_manager.cc:1434] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 12:23:39.462462 11965 raft_consensus.cc:385] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.463112 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.463203 11965 raft_consensus.cc:740] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.463830 11919 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.464352 11965 consensus_queue.cc:260] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.465214 11961 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:39.465799 11961 ts_tablet_manager.cc:1403] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.022s
I20260709 12:23:39.466950 11965 ts_tablet_manager.cc:1434] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:39.462541 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:39.468016 11768 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.469117 11961 raft_consensus.cc:359] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.469835 11961 raft_consensus.cc:385] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.470112 11961 raft_consensus.cc:740] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.470999 11961 consensus_queue.cc:260] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.474179 11961 ts_tablet_manager.cc:1434] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:39.475466 11993 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.475827 11961 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:39.476097 11993 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.478474 11993 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.480228 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.480968 11845 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 0.
I20260709 12:23:39.482813 11736 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.483156 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.483644 11961 tablet_bootstrap.cc:654] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.483863 11993 raft_consensus.cc:2804] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.483948 11920 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 0.
I20260709 12:23:39.484772 11993 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.485335 11993 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.476095 11768 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.490578 11919 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.492158 11811 leader_election.cc:304] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.493750 11991 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.494092 11973 raft_consensus.cc:2804] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.494702 11961 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:39.494349 11991 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.494745 11973 raft_consensus.cc:697] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:39.495271 11961 ts_tablet_manager.cc:1403] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:23:39.496088 11973 consensus_queue.cc:237] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.496671 11991 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.498941 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.500005 11845 raft_consensus.cc:2468] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 0.
I20260709 12:23:39.501339 11993 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.502390 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.504117 11736 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.505160 11991 raft_consensus.cc:2804] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:39.505589 11733 leader_election.cc:343] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.505405 11961 raft_consensus.cc:359] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.505587 11991 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.506405 11993 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Requested vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.506783 11991 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.507644 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:39.507764 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.506294 11961 raft_consensus.cc:385] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.508437 11845 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.508594 11961 raft_consensus.cc:740] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.508613 11919 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.509964 11961 consensus_queue.cc:260] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.512501 11961 ts_tablet_manager.cc:1434] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:23:39.513767 11961 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:39.515003 11991 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.517349 11991 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Requested vote from peers c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.518177 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:39.518903 11844 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.519960 11845 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 1.
I20260709 12:23:39.520912 11961 tablet_bootstrap.cc:654] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.521335 11736 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.523195 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.524787 11919 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 1.
I20260709 12:23:39.525317 11991 raft_consensus.cc:2804] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.526330 11991 raft_consensus.cc:697] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Becoming Leader. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Running, Role: LEADER
I20260709 12:23:39.527323 11991 consensus_queue.cc:237] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
W20260709 12:23:39.573601 11733 leader_election.cc:343] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.594028 11845 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.595398 11668 catalog_manager.cc:5697] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.601619 11961 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:39.602659 11961 ts_tablet_manager.cc:1403] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.011s
I20260709 12:23:39.603659 11973 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.608358 11961 raft_consensus.cc:359] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.609573 11961 raft_consensus.cc:385] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.610024 11961 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.611248 11961 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.615723 12001 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.616744 12001 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.617316 11961 ts_tablet_manager.cc:1434] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.005s
I20260709 12:23:39.617478 11973 raft_consensus.cc:493] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.618417 11973 raft_consensus.cc:515] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.619481 11961 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: Bootstrap starting.
I20260709 12:23:39.620199 11667 catalog_manager.cc:5697] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.621835 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:39.622776 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:39.627429 11973 leader_election.cc:290] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.628897 11961 tablet_bootstrap.cc:654] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.631175 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.639879 11919 raft_consensus.cc:2393] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6e6a3c53bfa481c882acde3c2298504 in current term 1: Already voted for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in this term.
I20260709 12:23:39.631278 11991 consensus_queue.cc:1048] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:23:39.641752 11808 leader_election.cc:304] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.643569 11973 raft_consensus.cc:3060] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.632498 12001 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:39.634742 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.649379 11843 raft_consensus.cc:2393] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9039ce38c924681aee4310f76e56152 in current term 1: Already voted for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in this term.
I20260709 12:23:39.649541 11844 raft_consensus.cc:2468] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68f29a4d33924a90bcb8c8a78ddd3a8a in term 1.
I20260709 12:23:39.651648 11736 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.653700 11991 raft_consensus.cc:2804] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.654208 11991 raft_consensus.cc:697] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Becoming Leader. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Running, Role: LEADER
I20260709 12:23:39.656320 11885 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:39.657956 11966 consensus_queue.cc:1048] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.659725 11966 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.668409 11990 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.668793 11997 raft_consensus.cc:493] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.669173 11990 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.669668 11997 raft_consensus.cc:515] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.671595 11920 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.680012 11974 consensus_queue.cc:1048] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.660368 11991 consensus_queue.cc:237] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.685918 11997 leader_election.cc:290] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.696946 11918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.704676 11961 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: No bootstrap required, opened a new log
I20260709 12:23:39.705349 11961 ts_tablet_manager.cc:1403] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.021s
I20260709 12:23:39.709290 11769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:39.711956 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:39.713016 11768 raft_consensus.cc:2468] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.713555 11973 raft_consensus.cc:2749] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.714721 11990 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:39.716014 11843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:39.705065 11966 raft_consensus.cc:2749] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.723243 11885 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:39.724484 11993 consensus_queue.cc:1048] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.727068 11966 raft_consensus.cc:2749] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.729489 11811 leader_election.cc:304] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: d9039ce38c924681aee4310f76e56152
I20260709 12:23:39.730086 11974 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.745934 12001 consensus_queue.cc:1048] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:39.743058 11974 raft_consensus.cc:2804] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.748733 11973 raft_consensus.cc:493] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.755363 11973 raft_consensus.cc:515] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.752755 11974 raft_consensus.cc:493] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d9039ce38c924681aee4310f76e56152)
I20260709 12:23:39.759778 11961 raft_consensus.cc:359] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.762701 11961 raft_consensus.cc:385] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.763123 11961 raft_consensus.cc:740] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.765143 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" is_pre_election: true
I20260709 12:23:39.766100 11770 raft_consensus.cc:2468] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 0.
I20260709 12:23:39.761705 11974 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.773679 11811 leader_election.cc:304] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:39.776448 11973 leader_election.cc:290] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.777055 11973 raft_consensus.cc:2804] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:39.776259 11667 catalog_manager.cc:5697] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.777383 11973 raft_consensus.cc:493] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.777781 11973 raft_consensus.cc:3060] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.785285 11991 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.785542 11918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:39.786762 11918 raft_consensus.cc:2468] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 0.
I20260709 12:23:39.789228 11961 consensus_queue.cc:260] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.792837 11961 ts_tablet_manager.cc:1434] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.000s
I20260709 12:23:39.815071 11991 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.825390 11973 raft_consensus.cc:515] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.828651 11768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:39.829440 11768 raft_consensus.cc:3060] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.829906 12029 consensus_queue.cc:1048] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.830037 11974 raft_consensus.cc:515] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.831127 11844 raft_consensus.cc:1240] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Rejecting Update request from peer d9039ce38c924681aee4310f76e56152 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:39.837337 11990 consensus_queue.cc:1059] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:39.844216 11990 raft_consensus.cc:3055] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:39.844748 11990 raft_consensus.cc:740] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:39.845701 11919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.846784 11919 raft_consensus.cc:3060] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.846236 11990 consensus_queue.cc:260] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.855861 11990 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.860467 11973 leader_election.cc:290] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.879098 11917 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:39.888271 11770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:39.890558 11919 raft_consensus.cc:2468] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.888229 11768 raft_consensus.cc:2468] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:39.892521 11808 leader_election.cc:304] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:39.894801 12029 raft_consensus.cc:2804] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:39.895382 12029 raft_consensus.cc:697] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:39.896518 11974 leader_election.cc:290] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:39.896677 12029 consensus_queue.cc:237] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.903266 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:39.913563 11967 consensus_queue.cc:1048] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:39.915491 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:39.926556 11920 raft_consensus.cc:2468] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 2.
I20260709 12:23:39.928032 11808 leader_election.cc:304] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:39.929301 11973 raft_consensus.cc:2804] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:39.929812 11973 raft_consensus.cc:697] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:39.930755 11973 consensus_queue.cc:237] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:39.933418 11991 consensus_queue.cc:1048] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:39.946764 11664 catalog_manager.cc:5697] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.974402 11667 catalog_manager.cc:5697] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 1 to 2, leader changed from d9039ce38c924681aee4310f76e56152 (127.3.7.131) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.003952 11967 consensus_queue.cc:1048] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:40.003969 12029 consensus_queue.cc:1048] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:40.020431 12029 consensus_queue.cc:1048] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:40.020489 11991 consensus_queue.cc:1048] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:40.109386 11917 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.117244 12050 consensus_queue.cc:1048] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:40.129436 11967 consensus_queue.cc:1048] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:40.199885  3102 ts_manager.cc:295] Set tserver state for 68f29a4d33924a90bcb8c8a78ddd3a8a to MAINTENANCE_MODE
I20260709 12:23:40.200860  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
I20260709 12:23:40.236335  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:40.237286  3102 tablet_replica.cc:333] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.238158  3102 raft_consensus.cc:2243] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:40.239104  3102 raft_consensus.cc:2272] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.241899  3102 tablet_replica.cc:333] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.242587  3102 raft_consensus.cc:2243] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:40.243579  3102 raft_consensus.cc:2272] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.246245  3102 tablet_replica.cc:333] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.246959  3102 raft_consensus.cc:2243] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.247478  3102 raft_consensus.cc:2272] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.250641  3102 tablet_replica.cc:333] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.251380  3102 raft_consensus.cc:2243] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.251842  3102 raft_consensus.cc:2272] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:40.255769 11811 consensus_peers.cc:597] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:40.256016  3102 tablet_replica.cc:333] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.256757  3102 raft_consensus.cc:2243] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.257210  3102 raft_consensus.cc:2272] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.259956  3102 tablet_replica.cc:333] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.260569  3102 raft_consensus.cc:2243] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.261015  3102 raft_consensus.cc:2272] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.263988  3102 tablet_replica.cc:333] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.264652  3102 raft_consensus.cc:2243] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:40.265551  3102 raft_consensus.cc:2272] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.268607  3102 tablet_replica.cc:333] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.269176  3102 raft_consensus.cc:2243] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:40.269980  3102 raft_consensus.cc:2272] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.272619  3102 tablet_replica.cc:333] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.273139  3102 raft_consensus.cc:2243] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:40.273980  3102 raft_consensus.cc:2272] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.276854  3102 tablet_replica.cc:333] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: stopping tablet replica
I20260709 12:23:40.277426  3102 raft_consensus.cc:2243] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.277927  3102 raft_consensus.cc:2272] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.305603  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
W20260709 12:23:40.334854 11811 consensus_peers.cc:597] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:40.354887 11811 consensus_peers.cc:597] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:40.371111 12029 consensus_queue.cc:1048] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:40.457358 11811 consensus_peers.cc:597] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:40.470394 11917 raft_consensus.cc:1275] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:40.472292 11997 consensus_queue.cc:1048] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:40.477403 11811 consensus_peers.cc:597] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:40.916814 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:40.957983 11811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111) [suppressed 129 similar messages]
I20260709 12:23:41.250293 12058 raft_consensus.cc:493] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.250825 12058 raft_consensus.cc:515] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.252744 12058 leader_election.cc:290] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.256330 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
W20260709 12:23:41.260134 11885 leader_election.cc:336] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.260620 11885 leader_election.cc:304] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:41.261408 12058 raft_consensus.cc:2749] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.309731 11997 raft_consensus.cc:493] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.310350 11997 raft_consensus.cc:515] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.312225 11997 leader_election.cc:290] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.313910 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:41.314815 11917 raft_consensus.cc:2468] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:41.316344 11808 leader_election.cc:304] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
W20260709 12:23:41.316967 11811 leader_election.cc:336] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.317341 11997 raft_consensus.cc:2804] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.317867 11997 raft_consensus.cc:493] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.318220 11997 raft_consensus.cc:3060] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.324990 11997 raft_consensus.cc:515] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.326702 11997 leader_election.cc:290] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.328212 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3f8c9ef1e4c0aba0549f0636e49ea" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:41.329074 11917 raft_consensus.cc:3060] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:41.331616 11811 leader_election.cc:336] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.337595 11917 raft_consensus.cc:2468] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 2.
I20260709 12:23:41.338977 11808 leader_election.cc:304] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:41.339927 11997 raft_consensus.cc:2804] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.340651 11997 raft_consensus.cc:697] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:41.341619 11997 consensus_queue.cc:237] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.349843 11664 catalog_manager.cc:5697] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 1 to 2, leader changed from 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.370126 12058 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.370802 12058 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.372658 12058 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.374799 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
W20260709 12:23:41.377158 11885 leader_election.cc:336] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.377632 11885 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:41.378477 12058 raft_consensus.cc:2749] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.433161 11997 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.433751 11997 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.436674 11997 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.437964 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:41.438700 11917 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:41.439751 11808 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:41.440476 12029 raft_consensus.cc:2804] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.440809 12029 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.441111 12029 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:41.441843 11811 leader_election.cc:336] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.446959 12029 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.448916 12029 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.450083 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:41.450634 11917 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.453953 12058 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
W20260709 12:23:41.454586 11811 leader_election.cc:336] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.454523 12058 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.457144 12058 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.458564 11917 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 2.
I20260709 12:23:41.458951 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:41.459874 11808 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:41.460827 12029 raft_consensus.cc:2804] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.461376 12029 raft_consensus.cc:697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
W20260709 12:23:41.461649 11885 leader_election.cc:336] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.462273 11885 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:41.462455 12029 consensus_queue.cc:237] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.463091 12058 raft_consensus.cc:2749] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.470665 12029 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.471282 12029 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.473373 12029 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.472682 11664 catalog_manager.cc:5697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 1 to 2, leader changed from 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.474412 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:41.474953 11917 raft_consensus.cc:2468] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:41.476318 11808 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
W20260709 12:23:41.478343 11811 leader_election.cc:336] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.478502 12029 raft_consensus.cc:2804] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.479127 12029 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.479542 12029 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.486402 12029 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.488216 12029 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.489313 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:41.489939 11917 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:41.493036 11811 leader_election.cc:336] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.496531 11917 raft_consensus.cc:2468] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 2.
I20260709 12:23:41.497838 11808 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:41.498731 12029 raft_consensus.cc:2804] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.499402 12029 raft_consensus.cc:697] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:41.500406 12029 consensus_queue.cc:237] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.508505 11664 catalog_manager.cc:5697] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 1 to 2, leader changed from 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.523658 12058 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.524336 12029 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.524459 12058 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.525133 12029 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.527467 12058 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.528087 12029 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.529167 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:41.529831 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:41.530051 11917 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 1.
I20260709 12:23:41.530661 11845 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 1.
W20260709 12:23:41.532217 11811 leader_election.cc:336] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.532768 11885 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:41.533000 11808 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
W20260709 12:23:41.533835 11885 leader_election.cc:336] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.534037 12029 raft_consensus.cc:2804] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.534363 12058 raft_consensus.cc:2804] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:41.534497 12029 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.534919 12058 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.535158 12029 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.535436 12058 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.541960 12058 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.543031 12029 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.543968 12058 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.545876 12029 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:41.546068 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:41.546965 11845 raft_consensus.cc:2393] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d9039ce38c924681aee4310f76e56152 in current term 2: Already voted for candidate c6e6a3c53bfa481c882acde3c2298504 in this term.
I20260709 12:23:41.547701 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:41.548735 11917 raft_consensus.cc:2393] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6e6a3c53bfa481c882acde3c2298504 in current term 2: Already voted for candidate d9039ce38c924681aee4310f76e56152 in this term.
W20260709 12:23:41.549901 11885 leader_election.cc:336] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
W20260709 12:23:41.550272 11811 leader_election.cc:336] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.550414 11885 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:41.550925 11811 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152
I20260709 12:23:41.551506 12058 raft_consensus.cc:2749] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.551790 12029 raft_consensus.cc:2749] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.629818 12058 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.630681 12058 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.633200 12029 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.633272 12058 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.634088 12029 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.635607 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504" is_pre_election: true
I20260709 12:23:41.636484 11845 raft_consensus.cc:2468] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 1.
I20260709 12:23:41.637239 12029 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
W20260709 12:23:41.638485 11885 leader_election.cc:336] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.639572 11885 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:41.640713 12058 raft_consensus.cc:2804] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:23:41.641024 11811 leader_election.cc:336] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.641193 12058 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 68f29a4d33924a90bcb8c8a78ddd3a8a)
I20260709 12:23:41.641749 12058 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:41.642433 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:41.648303 12058 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.649600 11917 raft_consensus.cc:2393] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6e6a3c53bfa481c882acde3c2298504 in current term 2: Already voted for candidate d9039ce38c924681aee4310f76e56152 in this term.
I20260709 12:23:41.650609 12058 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:41.652438 11808 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152
I20260709 12:23:41.652768 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:41.653410 11845 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:41.655155 11885 leader_election.cc:336] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:41.659528 11845 raft_consensus.cc:2468] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:41.660137 12029 raft_consensus.cc:2749] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:41.661082 11885 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:41.662027 12058 raft_consensus.cc:2804] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:41.663136 12058 raft_consensus.cc:697] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:41.664036 12058 consensus_queue.cc:237] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:41.672721 11664 catalog_manager.cc:5697] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 1 to 2, leader changed from 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:41.765875 11811 consensus_peers.cc:597] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.824391 11917 raft_consensus.cc:1275] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:41.826826 12029 consensus_queue.cc:1048] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.885274 11917 raft_consensus.cc:1275] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:41.886931 12072 consensus_queue.cc:1048] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:41.901407 11811 consensus_peers.cc:597] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.917788 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:41.939447 11811 consensus_peers.cc:597] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.002580 11917 raft_consensus.cc:1275] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:42.004372 12029 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:42.232143 11885 consensus_peers.cc:597] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.236117 11845 raft_consensus.cc:1275] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:42.237798 12058 consensus_queue.cc:1048] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:42.718911 11811 consensus_peers.cc:597] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:42.874219 11811 consensus_peers.cc:597] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:42.919152 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:42.967612 11811 consensus_peers.cc:597] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:42.983704 11811 consensus_peers.cc:597] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:43.057046 11811 consensus_peers.cc:597] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:43.475399 12029 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.475993 12029 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:43.478351 12029 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:43.479753 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152" is_pre_election: true
I20260709 12:23:43.480633 11917 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 2.
I20260709 12:23:43.481959 11808 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
W20260709 12:23:43.482579 11811 leader_election.cc:336] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:43.482844 12029 raft_consensus.cc:2804] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:43.483367 12029 raft_consensus.cc:493] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.483664 12029 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:43.489625 12029 raft_consensus.cc:515] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:43.491370 12029 leader_election.cc:290] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:43.492759 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67839d742a1420e8173615d4f72f690" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:43.493680 11917 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:43.495610 11811 leader_election.cc:336] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111)
I20260709 12:23:43.501385 11917 raft_consensus.cc:2468] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:43.503384 11808 leader_election.cc:304] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:43.504279 12029 raft_consensus.cc:2804] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:43.504819 12029 raft_consensus.cc:697] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:43.505671 12029 consensus_queue.cc:237] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:43.514509 11664 catalog_manager.cc:5697] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 1 to 3, leader changed from 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:43.920324 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:43.997740 11917 raft_consensus.cc:1275] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:44.159910 12029 consensus_queue.cc:1048] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:44.276698 11811 consensus_peers.cc:597] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.322295 11811 consensus_peers.cc:597] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.511221 11811 consensus_peers.cc:597] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.716509 11811 consensus_peers.cc:597] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:44.921357 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:23:45.001132 11885 consensus_peers.cc:597] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.234884 11942 debug-util.cc:398] Leaking SignalData structure 0x7b080018dd20 after lost signal to thread 3105
W20260709 12:23:45.236189 11942 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee400 after lost signal to thread 11702
W20260709 12:23:45.237353 11942 debug-util.cc:398] Leaking SignalData structure 0x7b0800193360 after lost signal to thread 11869
W20260709 12:23:45.238368 11942 debug-util.cc:398] Leaking SignalData structure 0x7b08004144e0 after lost signal to thread 11945
W20260709 12:23:45.340909 11811 consensus_peers.cc:597] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:45.466566 11811 consensus_peers.cc:597] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:45.518083 11811 consensus_peers.cc:597] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:45.536075 11811 consensus_peers.cc:597] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:45.546458  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:45.556138 12110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:45.558552 12112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:45.556142 12109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:45.562846  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:45.564174  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:45.564419  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:45.564628  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599825564607 us; error 0 us; skew 500 ppm
I20260709 12:23:45.565233  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:45.569041  3102 webserver.cc:533] Webserver started at http://127.3.7.129:45791/ using document root <none> and password file <none>
I20260709 12:23:45.569599  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:45.569800  3102 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:23:45.575887  3102 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:23:45.580473 12117 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:45.581449  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:23:45.581876  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-6qf7"
I20260709 12:23:45.582408  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:45.631163  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:45.633131  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:45.635360  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:45.641149 12126 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:23:45.700618  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:23:45.700949  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.061s	user 0.003s	sys 0.000s
I20260709 12:23:45.701311  3102 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:23:45.707129 12126 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.728227 12126 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.729359 12126 tablet_bootstrap.cc:492] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.730137 12126 ts_tablet_manager.cc:1403] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 12:23:45.733525 12126 raft_consensus.cc:359] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.734381 12126 raft_consensus.cc:740] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.735272 12126 consensus_queue.cc:260] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.738574 12126 ts_tablet_manager.cc:1434] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 12:23:45.739615 12126 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.744613  3102 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:23:45.745051  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.044s	sys 0.000s
I20260709 12:23:45.759562 12126 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.760882 12126 tablet_bootstrap.cc:492] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.761734 12126 ts_tablet_manager.cc:1403] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:23:45.766019 12126 raft_consensus.cc:359] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.766990 12126 raft_consensus.cc:740] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.768337 12126 consensus_queue.cc:260] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.770938 12126 ts_tablet_manager.cc:1434] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:45.772099 12126 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.793502 12126 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.794852 12126 tablet_bootstrap.cc:492] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.797758 12126 ts_tablet_manager.cc:1403] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:23:45.802920 12126 raft_consensus.cc:359] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.804019 12126 raft_consensus.cc:740] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.805248 12126 consensus_queue.cc:260] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.807830 12126 ts_tablet_manager.cc:1434] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:23:45.808866 12126 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.837102 12126 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.838220 12126 tablet_bootstrap.cc:492] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.838985 12126 ts_tablet_manager.cc:1403] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.004s
I20260709 12:23:45.841991 12126 raft_consensus.cc:359] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.842862 12126 raft_consensus.cc:740] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.844022 12126 consensus_queue.cc:260] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.846426  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:38811
I20260709 12:23:45.846541 12187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:38811 every 8 connection(s)
I20260709 12:23:45.847194 12126 ts_tablet_manager.cc:1434] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:45.848281 12126 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.864913  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:45.877276 12126 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.878432 12126 tablet_bootstrap.cc:492] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.879259 12126 ts_tablet_manager.cc:1403] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.000s
I20260709 12:23:45.882540 12126 raft_consensus.cc:359] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.887374 12126 raft_consensus.cc:740] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.888535 12126 consensus_queue.cc:260] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.895840 12126 ts_tablet_manager.cc:1434] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:23:45.901909 12126 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.907286 12188 heartbeater.cc:344] Connected to a master server at 127.3.7.190:45419
I20260709 12:23:45.908183 12188 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:45.919745 12188 heartbeater.cc:507] Master 127.3.7.190:45419 requested a full tablet report, sending...
W20260709 12:23:45.922565 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:45.929498 11667 ts_manager.cc:194] Re-registered known tserver with Master: 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811)
I20260709 12:23:45.936924 12126 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.937283 11845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:45.938172 12126 tablet_bootstrap.cc:492] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.940546 12126 ts_tablet_manager.cc:1403] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.017s
I20260709 12:23:45.938150 11845 raft_consensus.cc:606] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:45.945178 12126 raft_consensus.cc:359] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.946225 12126 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.947068 12126 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.948086 11667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48512
I20260709 12:23:45.949869 12126 ts_tablet_manager.cc:1434] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:45.949954 11845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:45.950724 11845 raft_consensus.cc:606] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:45.951128 12126 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:45.952327 12188 heartbeater.cc:499] Master 127.3.7.190:45419 was elected leader, sending a full tablet report...
I20260709 12:23:45.953794 11844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:45.954520 11844 raft_consensus.cc:606] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:45.962528 11844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceff787e20a34d7295798261202a25a5"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:45.963258 11844 raft_consensus.cc:606] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:45.968391 12199 raft_consensus.cc:993] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:45.969125 12029 raft_consensus.cc:1081] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:45.971163 11920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:45.971939 11920 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:45.972316 11920 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.975317 11844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d376952b48234211a6108de545b38d10"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:45.976004 11844 raft_consensus.cc:606] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:45.977497  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:45.978204  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:45.978982  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:45.978935 12126 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.981220 12126 tablet_bootstrap.cc:492] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:45.981961 12126 ts_tablet_manager.cc:1403] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 12:23:45.982621 11920 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.984874 12126 raft_consensus.cc:359] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.985848 12126 raft_consensus.cc:740] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.986801 12126 consensus_queue.cc:260] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.988941 12126 ts_tablet_manager.cc:1434] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:45.991340 11920 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:45.994516 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:45.995230 11844 raft_consensus.cc:3055] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:45.995594 11844 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:45.996450 11844 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:45.997804 11844 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:45.999653 12162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
W20260709 12:23:46.001329 11885 leader_election.cc:343] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.993533 12126 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:46.008802 11844 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:46.011696 11885 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 68f29a4d33924a90bcb8c8a78ddd3a8a
I20260709 12:23:46.013612 12099 raft_consensus.cc:2804] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.015101 12099 raft_consensus.cc:697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:46.016126 12099 consensus_queue.cc:237] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.020942 12126 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.022282 12126 tablet_bootstrap.cc:492] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:46.023048 12126 ts_tablet_manager.cc:1403] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 12:23:46.025528 12126 raft_consensus.cc:359] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.026083 12126 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.026842 12126 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.028483 12126 ts_tablet_manager.cc:1434] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:46.026911 11664 catalog_manager.cc:5697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 1 to 2, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.030535 12126 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:46.050699 12126 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.051720 12126 tablet_bootstrap.cc:492] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:46.052471 12126 ts_tablet_manager.cc:1403] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:23:46.054661 12126 raft_consensus.cc:359] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.055204 12126 raft_consensus.cc:740] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.055948 12126 consensus_queue.cc:260] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.057905 12126 ts_tablet_manager.cc:1434] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:46.058656 12126 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap starting.
I20260709 12:23:46.063526 12162 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.078776 12126 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.079833 12126 tablet_bootstrap.cc:492] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Bootstrap complete.
I20260709 12:23:46.080550 12126 ts_tablet_manager.cc:1403] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:23:46.083087 12126 raft_consensus.cc:359] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.083802 12126 raft_consensus.cc:740] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f29a4d33924a90bcb8c8a78ddd3a8a, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.084566 12126 consensus_queue.cc:260] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.086700 12126 ts_tablet_manager.cc:1434] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:23:46.108282 12162 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.124552 12161 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.157944 12199 raft_consensus.cc:993] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.158601 12108 raft_consensus.cc:1081] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.161214 11920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceff787e20a34d7295798261202a25a5"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:46.162202 11920 raft_consensus.cc:493] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.162654 11920 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.172530 11920 raft_consensus.cc:515] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.174989 11920 leader_election.cc:290] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:46.176282 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:46.176996 12161 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.176247 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:46.177949 11844 raft_consensus.cc:3055] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.178277 11844 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:46.179170 11844 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.180660 11844 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.185773 12161 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:46.188159 11885 leader_election.cc:304] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:46.189684 12099 raft_consensus.cc:2804] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.190268 12099 raft_consensus.cc:697] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:46.191370 12099 consensus_queue.cc:237] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.196403 12199 raft_consensus.cc:993] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.196971 12199 raft_consensus.cc:1081] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.198863 11917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d376952b48234211a6108de545b38d10"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:46.199476 11917 raft_consensus.cc:493] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.199877 11917 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.200464 11844 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:46.201759 11667 catalog_manager.cc:5697] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 1 to 2, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.208176 11917 raft_consensus.cc:515] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.210558 11917 leader_election.cc:290] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:46.212754 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:46.213431 12161 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.217651 12108 raft_consensus.cc:993] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.218227 12029 raft_consensus.cc:1081] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.220742 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d376952b48234211a6108de545b38d10" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:46.221522 11844 raft_consensus.cc:3055] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.221946 11844 raft_consensus.cc:740] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:46.223615 11917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:46.223289 11844 consensus_queue.cc:260] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.224285 11917 raft_consensus.cc:493] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.224745 11917 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.225118 11844 raft_consensus.cc:3060] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.232472 11917 raft_consensus.cc:515] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.234786 11917 leader_election.cc:290] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:46.236171 12162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:46.236661 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e2b86af086d44c88042620a6c18aebb" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:46.236919 12162 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.237360 11845 raft_consensus.cc:3055] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:46.237779 11845 raft_consensus.cc:740] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:46.238591 11845 consensus_queue.cc:260] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.231055 12161 raft_consensus.cc:2468] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 3.
I20260709 12:23:46.239907 11845 raft_consensus.cc:3060] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.240765 11885 leader_election.cc:304] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:46.241902 12099 raft_consensus.cc:2804] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:46.242532 12099 raft_consensus.cc:697] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:46.243693 12099 consensus_queue.cc:237] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.245775 12162 raft_consensus.cc:2468] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 3.
I20260709 12:23:46.247328 11885 leader_election.cc:304] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:46.248211 12201 raft_consensus.cc:2804] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:46.252053 12201 raft_consensus.cc:697] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:46.253069 12201 consensus_queue.cc:237] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.254613 11667 catalog_manager.cc:5697] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 2 to 3, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.257877 11845 raft_consensus.cc:2468] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 3.
I20260709 12:23:46.263131 11844 raft_consensus.cc:2468] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 3.
I20260709 12:23:46.271732 11667 catalog_manager.cc:5697] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 2 to 3, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.293394 12199 raft_consensus.cc:993] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.293944 12108 raft_consensus.cc:1081] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:46.296079 11917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:46.296684 11917 raft_consensus.cc:493] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.297035 11917 raft_consensus.cc:3060] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.303094 11917 raft_consensus.cc:515] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.304934 11917 leader_election.cc:290] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:46.306094 12162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:46.306486 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601dd34af6dc4695a6881e76a0d77677" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:46.306805 12162 raft_consensus.cc:3060] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.307168 11844 raft_consensus.cc:3055] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:46.307554 11844 raft_consensus.cc:740] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:46.308351 11844 consensus_queue.cc:260] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.309355 11844 raft_consensus.cc:3060] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.314988 11844 raft_consensus.cc:2468] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:46.315608 12162 raft_consensus.cc:2468] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:46.316256 11885 leader_election.cc:304] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:46.316993 12201 raft_consensus.cc:2804] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:46.317466 12201 raft_consensus.cc:697] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:46.318449 12201 consensus_queue.cc:237] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:46.326570 11667 catalog_manager.cc:5697] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 1 to 2, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.406304 12162 raft_consensus.cc:3060] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.429389 12162 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.435566 12162 raft_consensus.cc:1275] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.438648 12201 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.440124 12162 raft_consensus.cc:3060] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:46.461840 11844 raft_consensus.cc:1275] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.463944 12099 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.589591 11844 raft_consensus.cc:1275] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.590866 12099 consensus_queue.cc:1048] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.601154 12160 raft_consensus.cc:1275] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.602723 12215 consensus_queue.cc:1048] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.724704 11844 raft_consensus.cc:1275] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:46.726370 12201 consensus_queue.cc:1048] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.739104 12161 raft_consensus.cc:1275] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:46.741485 12099 consensus_queue.cc:1048] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.761438 11844 raft_consensus.cc:1275] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.762930 12201 consensus_queue.cc:1048] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.777050 12161 raft_consensus.cc:1275] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:46.778916 12215 consensus_queue.cc:1048] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.796573 12161 raft_consensus.cc:1275] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:46.797907 12099 consensus_queue.cc:1048] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.808188 11844 raft_consensus.cc:1275] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:46.809986 12215 consensus_queue.cc:1048] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:46.924124 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:46.990437  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.011384 11917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
mode: GRACEFUL
new_leader_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:49632
I20260709 12:23:47.012079 11917 raft_consensus.cc:606] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Received request to transfer leadership to TS c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:47.014994 11917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceff787e20a34d7295798261202a25a5"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
mode: GRACEFUL
new_leader_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:49632
I20260709 12:23:47.015530 11917 raft_consensus.cc:606] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Received request to transfer leadership to TS c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:47.016547  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:47.017284  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:47.018049  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.182742 12201 raft_consensus.cc:993] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: : Instructing follower c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:47.183405 12201 raft_consensus.cc:1081] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Signalling peer c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:47.187393 11845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceff787e20a34d7295798261202a25a5"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:46886
I20260709 12:23:47.188133 11845 raft_consensus.cc:493] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:47.188563 11845 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.198822 11845 raft_consensus.cc:515] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:47.201608 11845 leader_election.cc:290] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:47.202098 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:47.202905 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:47.203505 12161 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.203614 11917 raft_consensus.cc:3055] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.204061 11917 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:47.204908 11917 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:47.206280 11917 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.210036 12161 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:47.212885 11811 leader_election.cc:304] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:47.213837 12108 raft_consensus.cc:2804] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.215104 11917 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:47.215167 12108 raft_consensus.cc:697] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:47.216778 12108 consensus_queue.cc:237] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:47.225943 11664 catalog_manager.cc:5697] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 2 to 3, leader changed from d9039ce38c924681aee4310f76e56152 (127.3.7.131) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.400126 12099 raft_consensus.cc:993] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: : Instructing follower c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:47.400646 12201 raft_consensus.cc:1081] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Signalling peer c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:47.402148 11845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:46886
I20260709 12:23:47.402657 11845 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:47.402961 11845 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.408550 11845 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:47.410677 11845 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:47.411631 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:47.412254 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:47.412437 12161 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.412781 11917 raft_consensus.cc:3055] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:47.413160 11917 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:47.413841 11917 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:47.414748 11917 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.421903 12161 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:47.423156 11917 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:47.423573 11811 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:47.424889 12199 raft_consensus.cc:2804] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:47.425465 12199 raft_consensus.cc:697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:47.426546 12199 consensus_queue.cc:237] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:47.435009 11664 catalog_manager.cc:5697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 2 to 3, leader changed from d9039ce38c924681aee4310f76e56152 (127.3.7.131) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.684705 12161 raft_consensus.cc:1275] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:47.686245 12199 consensus_queue.cc:1048] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.709398 11917 raft_consensus.cc:1275] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:47.710826 12199 consensus_queue.cc:1048] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.897802 12161 raft_consensus.cc:1275] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:47.899320 12199 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.912664 11917 raft_consensus.cc:1275] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:47.914142 12108 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:47.925112 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:48.025769  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:48.034842 11845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:48.035697 11845 raft_consensus.cc:606] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:48.039126 11845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:48.039745 11845 raft_consensus.cc:606] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:48.041262  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:48.041983  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:48.042595  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:48.226130 12108 raft_consensus.cc:993] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:48.226687 12199 raft_consensus.cc:1081] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:48.228503 11917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:48.229000 11917 raft_consensus.cc:493] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:48.229307 11917 raft_consensus.cc:3060] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.235144 11917 raft_consensus.cc:515] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:48.236773 11917 leader_election.cc:290] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:48.237840 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:48.238170 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef315b48ad574dfdb519f5ca0fd57fc0" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:48.238799 12161 raft_consensus.cc:3060] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.239075 11845 raft_consensus.cc:3055] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:48.239737 11845 raft_consensus.cc:740] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:48.241029 11845 consensus_queue.cc:260] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:48.242437 11845 raft_consensus.cc:3060] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.246497 12161 raft_consensus.cc:2468] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:48.247918 11885 leader_election.cc:304] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:48.248646 12201 raft_consensus.cc:2804] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:48.250816 11845 raft_consensus.cc:2468] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 2.
I20260709 12:23:48.253258 12201 raft_consensus.cc:697] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:48.254755 12201 consensus_queue.cc:237] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:48.267643 11667 catalog_manager.cc:5697] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 1 to 2, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:48.355167 12108 raft_consensus.cc:993] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:48.355811 12199 raft_consensus.cc:1081] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:48.357535 11917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:48.358090 11917 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:48.358474 11917 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.364028 11917 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:48.365520 11917 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:48.366575 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:48.366734 11845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:48.367393 11845 raft_consensus.cc:3055] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:48.367339 12161 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.367807 11845 raft_consensus.cc:740] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:48.368633 11845 consensus_queue.cc:260] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:48.369797 11845 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.375010 12161 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 3.
I20260709 12:23:48.376493 11885 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:48.376847 11845 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 3.
I20260709 12:23:48.377370 12248 raft_consensus.cc:2804] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:48.377904 12248 raft_consensus.cc:697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:48.379503 12248 consensus_queue.cc:237] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:48.391165 11667 catalog_manager.cc:5697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 2 to 3, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:48.768903 12161 raft_consensus.cc:1275] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:48.770210 12248 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:48.780776 11845 raft_consensus.cc:1275] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:48.782328 12259 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:48.826893 12161 raft_consensus.cc:1275] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.828339 12248 consensus_queue.cc:1048] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.838786 11845 raft_consensus.cc:1275] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:48.842460 12259 consensus_queue.cc:1048] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:48.926205 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:49.049453  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:49.058171 11917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
mode: GRACEFUL
new_leader_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:49632
I20260709 12:23:49.058737 11917 raft_consensus.cc:606] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Received request to transfer leadership to TS c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:49.062129 11917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
mode: GRACEFUL
new_leader_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:49632
I20260709 12:23:49.062852 11917 raft_consensus.cc:606] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Received request to transfer leadership to TS c6e6a3c53bfa481c882acde3c2298504
I20260709 12:23:49.064343  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:49.064957  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:49.065743  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:49.231926 12266 raft_consensus.cc:993] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: : Instructing follower c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:49.232651 12266 raft_consensus.cc:1081] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Signalling peer c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:49.234304 11845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:46886
I20260709 12:23:49.234812 11845 raft_consensus.cc:493] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.235132 11845 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.236889 12267 raft_consensus.cc:993] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: : Instructing follower c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:49.237489 12266 raft_consensus.cc:1081] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Signalling peer c6e6a3c53bfa481c882acde3c2298504 to start an election
I20260709 12:23:49.239157 11844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
 from {username='slave'} at 127.0.0.1:46886
I20260709 12:23:49.239779 11844 raft_consensus.cc:493] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:49.240130 11844 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.241827 11845 raft_consensus.cc:515] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:49.243711 11845 leader_election.cc:290] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 4 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:49.244902 11917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:49.245426 11917 raft_consensus.cc:3055] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.245740 11917 raft_consensus.cc:740] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:49.245647 12162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8780dfd6f2724b8294d04ad5eb2c99e2" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:49.246436 12162 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.246641 11917 consensus_queue.cc:260] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:49.247848 11917 raft_consensus.cc:3060] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.247587 11844 raft_consensus.cc:515] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:49.250506 11844 leader_election.cc:290] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), d9039ce38c924681aee4310f76e56152 (127.3.7.131:34947)
I20260709 12:23:49.250783 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:49.251116 11920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b54e61a43584a0d985dde3b02010a78" candidate_uuid: "c6e6a3c53bfa481c882acde3c2298504" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9039ce38c924681aee4310f76e56152"
I20260709 12:23:49.251467 12161 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.251784 11920 raft_consensus.cc:3055] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.252125 11920 raft_consensus.cc:740] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:49.252869 11920 consensus_queue.cc:260] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:49.253919 11920 raft_consensus.cc:3060] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.254866 11917 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 4.
I20260709 12:23:49.256814 11808 leader_election.cc:304] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6e6a3c53bfa481c882acde3c2298504, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:49.257622 12161 raft_consensus.cc:2468] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:49.258663 12265 raft_consensus.cc:2804] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:49.258922 11811 leader_election.cc:304] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, c6e6a3c53bfa481c882acde3c2298504; no voters: 
I20260709 12:23:49.260068 12162 raft_consensus.cc:2468] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 4.
I20260709 12:23:49.263315 12108 raft_consensus.cc:2804] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.264021 12108 raft_consensus.cc:697] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:49.264331 11920 raft_consensus.cc:2468] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e6a3c53bfa481c882acde3c2298504 in term 3.
I20260709 12:23:49.265631 12108 consensus_queue.cc:237] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:49.269666 12265 raft_consensus.cc:697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 4 LEADER]: Becoming Leader. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:49.270804 12265 consensus_queue.cc:237] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:49.277401 11664 catalog_manager.cc:5697] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 3 to 4, leader changed from d9039ce38c924681aee4310f76e56152 (127.3.7.131) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 4 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.292826 11664 catalog_manager.cc:5697] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 reported cstate change: term changed from 2 to 3, leader changed from d9039ce38c924681aee4310f76e56152 (127.3.7.131) to c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130). New cstate: current_term: 3 leader_uuid: "c6e6a3c53bfa481c882acde3c2298504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.698407 11920 raft_consensus.cc:1275] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:49.699951 12265 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:49.715646 12161 raft_consensus.cc:1275] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:49.717762 12108 consensus_queue.cc:1048] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:49.780035 12161 raft_consensus.cc:1275] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:49.781381 12108 consensus_queue.cc:1048] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.794553 11920 raft_consensus.cc:1275] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Refusing update from remote peer c6e6a3c53bfa481c882acde3c2298504: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:49.796195 12108 consensus_queue.cc:1048] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:49.927469 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:50.073053  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.082659 11844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:50.083395 11844 raft_consensus.cc:606] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:50.086673 11844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ceff787e20a34d7295798261202a25a5"
dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
mode: GRACEFUL
new_leader_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:35276
I20260709 12:23:50.087210 11844 raft_consensus.cc:606] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Received request to transfer leadership to TS d9039ce38c924681aee4310f76e56152
I20260709 12:23:50.088402  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:50.089048  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:50.090059  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.341252 12108 raft_consensus.cc:993] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:50.342047 12108 raft_consensus.cc:1081] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:50.344806 11920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:50.345674 11920 raft_consensus.cc:493] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:50.346129 11920 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.361176 11920 raft_consensus.cc:515] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:50.364235 11920 leader_election.cc:290] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 4 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:50.365101 12161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:50.365979 12161 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.367800 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37ba1c2ccfbd4e37b71936ba9dff2c18" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:50.368515 11844 raft_consensus.cc:3055] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:50.368808 11844 raft_consensus.cc:740] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:50.369967 11844 consensus_queue.cc:260] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:50.371542 11844 raft_consensus.cc:3060] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.401497 12161 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 4.
I20260709 12:23:50.512992 11885 leader_election.cc:304] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:50.514262 12266 raft_consensus.cc:2804] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:50.514849 12266 raft_consensus.cc:697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 4 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:50.516911 12266 consensus_queue.cc:237] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
W20260709 12:23:50.812983 11885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:35895, user_credentials={real_user=slave}} blocked reactor thread for 67035.7us
I20260709 12:23:50.925019 11667 catalog_manager.cc:5697] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 3 to 4, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 4 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:50.927891 11844 consensus_meta.cc:287] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: Time spent flushing consensus metadata: real 0.554s	user 0.019s	sys 0.009s
I20260709 12:23:50.928515 11844 raft_consensus.cc:2468] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 4.
W20260709 12:23:50.929697 11716 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:23:50.947525 12161 raft_consensus.cc:1275] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:50.949223 12266 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.963376 12282 raft_consensus.cc:993] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: : Instructing follower d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:50.964068 12293 raft_consensus.cc:1081] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Signalling peer d9039ce38c924681aee4310f76e56152 to start an election
I20260709 12:23:50.966616 11916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ceff787e20a34d7295798261202a25a5"
dest_uuid: "d9039ce38c924681aee4310f76e56152"
 from {username='slave'} at 127.0.0.1:39902
I20260709 12:23:50.967254 11916 raft_consensus.cc:493] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:50.967728 11916 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.978410 11916 raft_consensus.cc:515] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:50.982036 12160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a"
I20260709 12:23:50.982712 12160 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.984445 11916 leader_election.cc:290] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 4 election: Requested vote from peers 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811), c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895)
I20260709 12:23:50.985247 11844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceff787e20a34d7295798261202a25a5" candidate_uuid: "d9039ce38c924681aee4310f76e56152" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6e6a3c53bfa481c882acde3c2298504"
I20260709 12:23:50.985984 11844 raft_consensus.cc:3055] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:50.986400 11844 raft_consensus.cc:740] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6e6a3c53bfa481c882acde3c2298504, State: Running, Role: LEADER
I20260709 12:23:50.987653 11844 consensus_queue.cc:260] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:50.989563 11844 raft_consensus.cc:3060] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.997480 12160 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 4.
I20260709 12:23:50.998867 11885 leader_election.cc:304] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68f29a4d33924a90bcb8c8a78ddd3a8a, d9039ce38c924681aee4310f76e56152; no voters: 
I20260709 12:23:50.999599 11845 raft_consensus.cc:1275] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Refusing update from remote peer d9039ce38c924681aee4310f76e56152: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:51.000700 12285 raft_consensus.cc:2804] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.001323 12285 raft_consensus.cc:697] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 4 LEADER]: Becoming Leader. State: Replica: d9039ce38c924681aee4310f76e56152, State: Running, Role: LEADER
I20260709 12:23:51.001510 12266 consensus_queue.cc:1048] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:51.002486 12285 consensus_queue.cc:237] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } }
I20260709 12:23:51.008106 11844 raft_consensus.cc:2468] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9039ce38c924681aee4310f76e56152 in term 4.
I20260709 12:23:51.016388 11667 catalog_manager.cc:5697] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 reported cstate change: term changed from 3 to 4, leader changed from c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130) to d9039ce38c924681aee4310f76e56152 (127.3.7.131). New cstate: current_term: 4 leader_uuid: "d9039ce38c924681aee4310f76e56152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f29a4d33924a90bcb8c8a78ddd3a8a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6e6a3c53bfa481c882acde3c2298504" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9039ce38c924681aee4310f76e56152" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34947 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:51.185525  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:51.219247  3102 tablet_server.cc:179] TabletServer@127.3.7.129:38811 shutting down...
W20260709 12:23:51.230439 11885 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 99 similar messages]
W20260709 12:23:51.236042 11885 consensus_peers.cc:597] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.248618  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:51.249449  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.250308  3102 raft_consensus.cc:2243] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.250926  3102 raft_consensus.cc:2272] T f67839d742a1420e8173615d4f72f690 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.254014  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.254812  3102 raft_consensus.cc:2243] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.255414  3102 raft_consensus.cc:2272] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.258759  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.259541  3102 raft_consensus.cc:2243] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.260079  3102 raft_consensus.cc:2272] T 2b54e61a43584a0d985dde3b02010a78 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.263427  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.264077  3102 raft_consensus.cc:2243] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.264652  3102 raft_consensus.cc:2272] T 2e2b86af086d44c88042620a6c18aebb P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.267285  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.268038  3102 raft_consensus.cc:2243] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.268586  3102 raft_consensus.cc:2272] T ceff787e20a34d7295798261202a25a5 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.271667  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.272320  3102 raft_consensus.cc:2243] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.272910  3102 raft_consensus.cc:2272] T d376952b48234211a6108de545b38d10 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.275599  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.276288  3102 raft_consensus.cc:2243] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.276825  3102 raft_consensus.cc:2272] T f8e3f8c9ef1e4c0aba0549f0636e49ea P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.279490  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.280090  3102 raft_consensus.cc:2243] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.280596  3102 raft_consensus.cc:2272] T 601dd34af6dc4695a6881e76a0d77677 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.283164  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.283803  3102 raft_consensus.cc:2243] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.284382  3102 raft_consensus.cc:2272] T ef315b48ad574dfdb519f5ca0fd57fc0 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.286814  3102 tablet_replica.cc:333] stopping tablet replica
I20260709 12:23:51.287386  3102 raft_consensus.cc:2243] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.287871  3102 raft_consensus.cc:2272] T 8780dfd6f2724b8294d04ad5eb2c99e2 P 68f29a4d33924a90bcb8c8a78ddd3a8a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:51.320809 11885 consensus_peers.cc:597] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.322882  3102 tablet_server.cc:196] TabletServer@127.3.7.129:38811 shutdown complete.
I20260709 12:23:51.356673  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
I20260709 12:23:51.379509  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:51.380271  3102 tablet_replica.cc:333] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.381237  3102 raft_consensus.cc:2243] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.382241  3102 raft_consensus.cc:2272] T f67839d742a1420e8173615d4f72f690 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.385592  3102 tablet_replica.cc:333] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.386231  3102 raft_consensus.cc:2243] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.387360  3102 raft_consensus.cc:2272] T 2b54e61a43584a0d985dde3b02010a78 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:51.389708 11811 consensus_peers.cc:597] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.390468  3102 tablet_replica.cc:333] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.391131  3102 raft_consensus.cc:2243] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.391738  3102 raft_consensus.cc:2272] T 2e2b86af086d44c88042620a6c18aebb P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.394969  3102 tablet_replica.cc:333] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.395776  3102 raft_consensus.cc:2243] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.396267  3102 raft_consensus.cc:2272] T ceff787e20a34d7295798261202a25a5 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:51.396799 11885 consensus_peers.cc:597] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 -> Peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Couldn't send request to peer c6e6a3c53bfa481c882acde3c2298504. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.398818  3102 tablet_replica.cc:333] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.399705  3102 raft_consensus.cc:2243] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.400967  3102 raft_consensus.cc:2272] T f8e3f8c9ef1e4c0aba0549f0636e49ea P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.403594  3102 tablet_replica.cc:333] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.404197  3102 raft_consensus.cc:2243] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.404738  3102 raft_consensus.cc:2272] T d376952b48234211a6108de545b38d10 P c6e6a3c53bfa481c882acde3c2298504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.407112  3102 tablet_replica.cc:333] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.407925  3102 raft_consensus.cc:2243] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.408365  3102 raft_consensus.cc:2272] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:51.411612 11885 consensus_peers.cc:597] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.411938  3102 tablet_replica.cc:333] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.412586  3102 raft_consensus.cc:2243] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.413364  3102 raft_consensus.cc:2272] T 8780dfd6f2724b8294d04ad5eb2c99e2 P c6e6a3c53bfa481c882acde3c2298504 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.415608  3102 tablet_replica.cc:333] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.416177  3102 raft_consensus.cc:2243] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.416653  3102 raft_consensus.cc:2272] T ef315b48ad574dfdb519f5ca0fd57fc0 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:51.416827 11699 debug-util.cc:398] Leaking SignalData structure 0x7b0800032cc0 after lost signal to thread 3105
W20260709 12:23:51.418021 11699 debug-util.cc:398] Leaking SignalData structure 0x7b080005b740 after lost signal to thread 11702
W20260709 12:23:51.419211 11699 debug-util.cc:398] Leaking SignalData structure 0x7b0800081de0 after lost signal to thread 11869
I20260709 12:23:51.419258  3102 tablet_replica.cc:333] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504: stopping tablet replica
I20260709 12:23:51.420130  3102 raft_consensus.cc:2243] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:51.420491 11699 debug-util.cc:398] Leaking SignalData structure 0x7b08002a31e0 after lost signal to thread 11945
I20260709 12:23:51.420799  3102 raft_consensus.cc:2272] T 601dd34af6dc4695a6881e76a0d77677 P c6e6a3c53bfa481c882acde3c2298504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.461542  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
W20260709 12:23:51.473453 11885 consensus_peers.cc:597] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 -> Peer c6e6a3c53bfa481c882acde3c2298504 (127.3.7.130:35895): Couldn't send request to peer c6e6a3c53bfa481c882acde3c2298504. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:35895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.505467  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
W20260709 12:23:51.512894 11885 consensus_peers.cc:597] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:51.538878 11885 consensus_peers.cc:597] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 -> Peer 68f29a4d33924a90bcb8c8a78ddd3a8a (127.3.7.129:38811): Couldn't send request to peer 68f29a4d33924a90bcb8c8a78ddd3a8a. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.545356  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:51.546448  3102 tablet_replica.cc:333] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.547676  3102 raft_consensus.cc:2243] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.548422  3102 raft_consensus.cc:2272] T 2b54e61a43584a0d985dde3b02010a78 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.551687  3102 tablet_replica.cc:333] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.552606  3102 raft_consensus.cc:2243] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.553777  3102 raft_consensus.cc:2272] T 37ba1c2ccfbd4e37b71936ba9dff2c18 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.557331  3102 tablet_replica.cc:333] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.558322  3102 raft_consensus.cc:2243] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.558949  3102 raft_consensus.cc:2272] T 8780dfd6f2724b8294d04ad5eb2c99e2 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.562264  3102 tablet_replica.cc:333] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.563194  3102 raft_consensus.cc:2243] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.563947  3102 raft_consensus.cc:2272] T f67839d742a1420e8173615d4f72f690 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.567373  3102 tablet_replica.cc:333] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.568224  3102 raft_consensus.cc:2243] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.569233  3102 pending_rounds.cc:70] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: Trying to abort 1 pending ops.
I20260709 12:23:51.569489  3102 pending_rounds.cc:77] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305624907796541440 op_type: NO_OP noop_request { }
I20260709 12:23:51.569887  3102 raft_consensus.cc:2889] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:51.570281  3102 raft_consensus.cc:2272] T ceff787e20a34d7295798261202a25a5 P d9039ce38c924681aee4310f76e56152 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.574031  3102 tablet_replica.cc:333] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.574888  3102 raft_consensus.cc:2243] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.576282  3102 raft_consensus.cc:2272] T 2e2b86af086d44c88042620a6c18aebb P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.579849  3102 tablet_replica.cc:333] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.580657  3102 raft_consensus.cc:2243] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.581923  3102 raft_consensus.cc:2272] T d376952b48234211a6108de545b38d10 P d9039ce38c924681aee4310f76e56152 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.585230  3102 tablet_replica.cc:333] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.585988  3102 raft_consensus.cc:2243] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.586681  3102 raft_consensus.cc:2272] T f8e3f8c9ef1e4c0aba0549f0636e49ea P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.589903  3102 tablet_replica.cc:333] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.590692  3102 raft_consensus.cc:2243] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.591950  3102 raft_consensus.cc:2272] T ef315b48ad574dfdb519f5ca0fd57fc0 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.595224  3102 tablet_replica.cc:333] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152: stopping tablet replica
I20260709 12:23:51.595963  3102 raft_consensus.cc:2243] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.597301  3102 raft_consensus.cc:2272] T 601dd34af6dc4695a6881e76a0d77677 P d9039ce38c924681aee4310f76e56152 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.656512  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
I20260709 12:23:51.688446  3102 master.cc:562] Master@127.3.7.190:45419 shutting down...
I20260709 12:23:51.723943  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:51.724530  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.724874  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P 668345560d6f4fa5b3c0cbbffa684210: stopping tablet replica
W20260709 12:23:52.744259  3102 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11699)
W20260709 12:23:53.744716  3102 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11699)
I20260709 12:23:54.637588  3102 master.cc:584] Master@127.3.7.190:45419 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (16962 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:23:54.687726  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:44911
I20260709 12:23:54.688951  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:54.695174 12308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:54.695582 12311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:54.695437 12309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:54.697388  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:54.698407  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:54.698637  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:54.698753  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599834698742 us; error 0 us; skew 500 ppm
I20260709 12:23:54.699227  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:54.701562  3102 webserver.cc:533] Webserver started at http://127.3.7.190:36853/ using document root <none> and password file <none>
I20260709 12:23:54.702025  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:54.702178  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:54.702433  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:54.703966  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8"
format_stamp: "Formatted at 2026-07-09 12:23:54 on dist-test-slave-6qf7"
I20260709 12:23:54.708743  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:54.712622 12316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:54.713538  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:54.713981  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8"
format_stamp: "Formatted at 2026-07-09 12:23:54 on dist-test-slave-6qf7"
I20260709 12:23:54.714355  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:54.743409  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:54.744611  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:54.785116  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:44911
I20260709 12:23:54.785229 12367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:44911 every 8 connection(s)
I20260709 12:23:54.789124 12368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.802898 12368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8: Bootstrap starting.
I20260709 12:23:54.807942 12368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:54.812288 12368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8: No bootstrap required, opened a new log
I20260709 12:23:54.814499 12368 raft_consensus.cc:359] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" member_type: VOTER }
I20260709 12:23:54.814910 12368 raft_consensus.cc:385] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:54.815132 12368 raft_consensus.cc:740] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b0f81fa3d04c50bf4dc9c191182cd8, State: Initialized, Role: FOLLOWER
I20260709 12:23:54.815793 12368 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" member_type: VOTER }
I20260709 12:23:54.816272 12368 raft_consensus.cc:399] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:54.816497 12368 raft_consensus.cc:493] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:54.816788 12368 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:54.821959 12368 raft_consensus.cc:515] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" member_type: VOTER }
I20260709 12:23:54.822491 12368 leader_election.cc:304] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3b0f81fa3d04c50bf4dc9c191182cd8; no voters: 
I20260709 12:23:54.823653 12368 leader_election.cc:290] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:54.824004 12372 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:54.825372 12372 raft_consensus.cc:697] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 1 LEADER]: Becoming Leader. State: Replica: d3b0f81fa3d04c50bf4dc9c191182cd8, State: Running, Role: LEADER
I20260709 12:23:54.826097 12372 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" member_type: VOTER }
I20260709 12:23:54.826659 12368 sys_catalog.cc:565] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:54.830930 12374 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3b0f81fa3d04c50bf4dc9c191182cd8. Latest consensus state: current_term: 1 leader_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" member_type: VOTER } }
I20260709 12:23:54.831771 12374 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:54.833158 12373 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b0f81fa3d04c50bf4dc9c191182cd8" member_type: VOTER } }
I20260709 12:23:54.833876 12373 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:54.834036 12380 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:54.839252 12380 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:54.841897  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:54.849084 12380 catalog_manager.cc:1383] Generated new cluster ID: 8ef0a63064b546e99de4bfc7d7e0fd5d
I20260709 12:23:54.849475 12380 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:54.873010 12380 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:54.874341 12380 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:54.887786 12380 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8: Generated new TSK 0
I20260709 12:23:54.888319 12380 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:54.908589  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:54.914935 12390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:54.916381 12391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:54.920842 12393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:54.920889  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:54.922210  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:54.922448  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:54.922631  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599834922606 us; error 0 us; skew 500 ppm
I20260709 12:23:54.923192  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:54.925726  3102 webserver.cc:533] Webserver started at http://127.3.7.129:35909/ using document root <none> and password file <none>
I20260709 12:23:54.926254  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:54.926489  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:54.926770  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:54.928455  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "2678f07543b94e73b941aee9e3c0994a"
format_stamp: "Formatted at 2026-07-09 12:23:54 on dist-test-slave-6qf7"
I20260709 12:23:54.933880  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:54.937510 12398 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:54.938303  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:54.938609  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "2678f07543b94e73b941aee9e3c0994a"
format_stamp: "Formatted at 2026-07-09 12:23:54 on dist-test-slave-6qf7"
I20260709 12:23:54.938927  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:54.974457  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:54.975821  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:54.977437  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:54.979979  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:54.980221  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:54.980479  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:54.980679  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.026007  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:37649
I20260709 12:23:55.026198 12460 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:37649 every 8 connection(s)
I20260709 12:23:55.031416  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:55.039511 12465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:55.040704 12466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:55.045163 12468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:55.045377  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:55.046779  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:55.047016  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:55.047155 12461 heartbeater.cc:344] Connected to a master server at 127.3.7.190:44911
I20260709 12:23:55.047230  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599835047207 us; error 0 us; skew 500 ppm
I20260709 12:23:55.047767 12461 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:55.048151  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:55.048594 12461 heartbeater.cc:507] Master 127.3.7.190:44911 requested a full tablet report, sending...
I20260709 12:23:55.050948  3102 webserver.cc:533] Webserver started at http://127.3.7.130:44131/ using document root <none> and password file <none>
I20260709 12:23:55.051280 12333 ts_manager.cc:194] Registered new tserver with Master: 2678f07543b94e73b941aee9e3c0994a (127.3.7.129:37649)
I20260709 12:23:55.051683  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:55.052011  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:55.052358  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:55.053929  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "90d7daeb266f4bbeb745b97a899ecf35"
format_stamp: "Formatted at 2026-07-09 12:23:55 on dist-test-slave-6qf7"
I20260709 12:23:55.054090 12333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33572
I20260709 12:23:55.059515  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:23:55.065327 12473 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.066432  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:23:55.066823  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "90d7daeb266f4bbeb745b97a899ecf35"
format_stamp: "Formatted at 2026-07-09 12:23:55 on dist-test-slave-6qf7"
I20260709 12:23:55.067225  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:55.086109  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:55.087481  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:55.089068  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:55.091814  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:55.092084  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.092340  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:55.092514  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.138288  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:39821
I20260709 12:23:55.138425 12536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:39821 every 8 connection(s)
I20260709 12:23:55.143807  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:55.151544 12540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:55.153350 12541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:55.156828 12543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:55.157856 12537 heartbeater.cc:344] Connected to a master server at 127.3.7.190:44911
I20260709 12:23:55.157938  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:55.158573 12537 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:55.159379  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:55.159724  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:55.159725 12537 heartbeater.cc:507] Master 127.3.7.190:44911 requested a full tablet report, sending...
I20260709 12:23:55.160068  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599835160046 us; error 0 us; skew 500 ppm
I20260709 12:23:55.160923  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:55.162521 12333 ts_manager.cc:194] Registered new tserver with Master: 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821)
I20260709 12:23:55.163700  3102 webserver.cc:533] Webserver started at http://127.3.7.131:36793/ using document root <none> and password file <none>
I20260709 12:23:55.164268  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:55.164230 12333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33574
I20260709 12:23:55.164652  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:55.164981  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:55.166381  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "e47f11b009cf459ba86e038ce640bfd6"
format_stamp: "Formatted at 2026-07-09 12:23:55 on dist-test-slave-6qf7"
I20260709 12:23:55.171094  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:23:55.174921 12548 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.175953  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:55.176226  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "e47f11b009cf459ba86e038ce640bfd6"
format_stamp: "Formatted at 2026-07-09 12:23:55 on dist-test-slave-6qf7"
I20260709 12:23:55.176471  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:55.190968  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:55.192269  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:55.193684  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:55.195957  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:55.196172  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.196434  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:55.196594  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:55.240048  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:34463
I20260709 12:23:55.240162 12610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:34463 every 8 connection(s)
I20260709 12:23:55.255440 12611 heartbeater.cc:344] Connected to a master server at 127.3.7.190:44911
I20260709 12:23:55.255880 12611 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:55.256640 12611 heartbeater.cc:507] Master 127.3.7.190:44911 requested a full tablet report, sending...
I20260709 12:23:55.258698 12333 ts_manager.cc:194] Registered new tserver with Master: e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:55.259253  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0158044s
I20260709 12:23:55.260444 12333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33582
I20260709 12:23:55.286342 12333 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33584:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:55.288537 12333 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:55.361526 12426 tablet_service.cc:1511] Processing CreateTablet for tablet 19eccf80915f4e70aaafff98fb7e56c6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f49bbaa4ac434d20a6aa48e39bbbb966]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:55.362749 12501 tablet_service.cc:1511] Processing CreateTablet for tablet 19eccf80915f4e70aaafff98fb7e56c6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f49bbaa4ac434d20a6aa48e39bbbb966]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:55.363158 12426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19eccf80915f4e70aaafff98fb7e56c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.363142 12500 tablet_service.cc:1511] Processing CreateTablet for tablet 55a9edf098294725b6c05bb4b18f0343 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f49bbaa4ac434d20a6aa48e39bbbb966]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:55.364313 12501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19eccf80915f4e70aaafff98fb7e56c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.365401 12576 tablet_service.cc:1511] Processing CreateTablet for tablet 19eccf80915f4e70aaafff98fb7e56c6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f49bbaa4ac434d20a6aa48e39bbbb966]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:55.365595 12425 tablet_service.cc:1511] Processing CreateTablet for tablet 55a9edf098294725b6c05bb4b18f0343 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f49bbaa4ac434d20a6aa48e39bbbb966]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:55.366905 12576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19eccf80915f4e70aaafff98fb7e56c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.367241 12425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a9edf098294725b6c05bb4b18f0343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.368628 12500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a9edf098294725b6c05bb4b18f0343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.368686 12575 tablet_service.cc:1511] Processing CreateTablet for tablet 55a9edf098294725b6c05bb4b18f0343 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f49bbaa4ac434d20a6aa48e39bbbb966]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:55.370185 12575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a9edf098294725b6c05bb4b18f0343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.399260 12628 tablet_bootstrap.cc:492] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a: Bootstrap starting.
I20260709 12:23:55.400847 12627 tablet_bootstrap.cc:492] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6: Bootstrap starting.
I20260709 12:23:55.407459 12628 tablet_bootstrap.cc:654] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.411099 12626 tablet_bootstrap.cc:492] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35: Bootstrap starting.
I20260709 12:23:55.412060 12627 tablet_bootstrap.cc:654] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.415495 12628 tablet_bootstrap.cc:492] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a: No bootstrap required, opened a new log
I20260709 12:23:55.416206 12628 ts_tablet_manager.cc:1403] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:23:55.419220 12626 tablet_bootstrap.cc:654] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.419525 12628 raft_consensus.cc:359] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.420362 12628 raft_consensus.cc:385] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.420696 12628 raft_consensus.cc:740] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.420928 12627 tablet_bootstrap.cc:492] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6: No bootstrap required, opened a new log
I20260709 12:23:55.421573 12627 ts_tablet_manager.cc:1403] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 12:23:55.421674 12628 consensus_queue.cc:260] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.424494 12627 raft_consensus.cc:359] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.425132 12627 raft_consensus.cc:385] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.425510 12627 raft_consensus.cc:740] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47f11b009cf459ba86e038ce640bfd6, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.425699 12626 tablet_bootstrap.cc:492] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35: No bootstrap required, opened a new log
I20260709 12:23:55.426092 12461 heartbeater.cc:499] Master 127.3.7.190:44911 was elected leader, sending a full tablet report...
I20260709 12:23:55.426278 12626 ts_tablet_manager.cc:1403] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:23:55.426499 12627 consensus_queue.cc:260] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.427429 12628 ts_tablet_manager.cc:1434] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:23:55.428925 12628 tablet_bootstrap.cc:492] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: Bootstrap starting.
I20260709 12:23:55.429630 12626 raft_consensus.cc:359] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.430418 12626 raft_consensus.cc:385] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.430737 12626 raft_consensus.cc:740] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.431635 12626 consensus_queue.cc:260] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.440399 12537 heartbeater.cc:499] Master 127.3.7.190:44911 was elected leader, sending a full tablet report...
I20260709 12:23:55.441331 12626 ts_tablet_manager.cc:1434] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.005s
I20260709 12:23:55.442493 12626 tablet_bootstrap.cc:492] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35: Bootstrap starting.
I20260709 12:23:55.442562 12628 tablet_bootstrap.cc:654] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.450140 12626 tablet_bootstrap.cc:654] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.456310 12628 tablet_bootstrap.cc:492] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: No bootstrap required, opened a new log
I20260709 12:23:55.456396 12611 heartbeater.cc:499] Master 127.3.7.190:44911 was elected leader, sending a full tablet report...
I20260709 12:23:55.456923 12628 ts_tablet_manager.cc:1403] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
I20260709 12:23:55.459213 12626 tablet_bootstrap.cc:492] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35: No bootstrap required, opened a new log
I20260709 12:23:55.459800 12627 ts_tablet_manager.cc:1434] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.023s
I20260709 12:23:55.459852 12626 ts_tablet_manager.cc:1403] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.009s
I20260709 12:23:55.460094 12628 raft_consensus.cc:359] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.461021 12628 raft_consensus.cc:385] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.461052 12627 tablet_bootstrap.cc:492] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6: Bootstrap starting.
I20260709 12:23:55.461421 12628 raft_consensus.cc:740] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.462285 12628 consensus_queue.cc:260] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.463603 12626 raft_consensus.cc:359] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.464435 12626 raft_consensus.cc:385] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.464740 12626 raft_consensus.cc:740] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.465718 12626 consensus_queue.cc:260] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.467137 12628 ts_tablet_manager.cc:1434] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:23:55.468075 12626 ts_tablet_manager.cc:1434] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:55.469295 12627 tablet_bootstrap.cc:654] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:55.469738 12632 raft_consensus.cc:493] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.470258 12632 raft_consensus.cc:515] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.475617 12632 leader_election.cc:290] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:55.487705 12627 tablet_bootstrap.cc:492] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6: No bootstrap required, opened a new log
I20260709 12:23:55.488386 12627 ts_tablet_manager.cc:1403] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.012s
I20260709 12:23:55.488294 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19eccf80915f4e70aaafff98fb7e56c6" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35" is_pre_election: true
I20260709 12:23:55.489154 12511 raft_consensus.cc:2468] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 0.
I20260709 12:23:55.490646 12402 leader_election.cc:304] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, 90d7daeb266f4bbeb745b97a899ecf35; no voters: 
I20260709 12:23:55.491569 12632 raft_consensus.cc:2804] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.492015 12632 raft_consensus.cc:493] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.491776 12627 raft_consensus.cc:359] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.492373 12632 raft_consensus.cc:3060] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.492640 12627 raft_consensus.cc:385] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:55.493013 12627 raft_consensus.cc:740] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47f11b009cf459ba86e038ce640bfd6, State: Initialized, Role: FOLLOWER
I20260709 12:23:55.493834 12627 consensus_queue.cc:260] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.496193 12627 ts_tablet_manager.cc:1434] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:23:55.499187 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19eccf80915f4e70aaafff98fb7e56c6" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6" is_pre_election: true
I20260709 12:23:55.499948 12586 raft_consensus.cc:2468] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 0.
I20260709 12:23:55.500243 12632 raft_consensus.cc:515] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.503033 12632 leader_election.cc:290] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 election: Requested vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:55.503614 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19eccf80915f4e70aaafff98fb7e56c6" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
I20260709 12:23:55.503360 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19eccf80915f4e70aaafff98fb7e56c6" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
I20260709 12:23:55.504225 12586 raft_consensus.cc:3060] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.504597 12511 raft_consensus.cc:3060] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.511252 12586 raft_consensus.cc:2468] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 1.
I20260709 12:23:55.512635 12399 leader_election.cc:304] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, e47f11b009cf459ba86e038ce640bfd6; no voters: 
I20260709 12:23:55.512694 12511 raft_consensus.cc:2468] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 1.
I20260709 12:23:55.513418 12632 raft_consensus.cc:2804] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.514658 12632 raft_consensus.cc:697] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Becoming Leader. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Running, Role: LEADER
I20260709 12:23:55.515412 12632 consensus_queue.cc:237] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.523193 12332 catalog_manager.cc:5697] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2678f07543b94e73b941aee9e3c0994a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "2678f07543b94e73b941aee9e3c0994a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:55.837899 12382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:55.849843 12632 raft_consensus.cc:493] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.850477 12632 raft_consensus.cc:515] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.852362 12632 leader_election.cc:290] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:55.853366 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35" is_pre_election: true
I20260709 12:23:55.853498 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6" is_pre_election: true
I20260709 12:23:55.854017 12511 raft_consensus.cc:2468] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 0.
I20260709 12:23:55.854205 12586 raft_consensus.cc:2468] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 0.
I20260709 12:23:55.855057 12402 leader_election.cc:304] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, 90d7daeb266f4bbeb745b97a899ecf35; no voters: 
I20260709 12:23:55.855875 12632 raft_consensus.cc:2804] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:55.856276 12632 raft_consensus.cc:493] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.856596 12632 raft_consensus.cc:3060] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.862771 12632 raft_consensus.cc:515] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.864820 12632 leader_election.cc:290] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 election: Requested vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:55.865576 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
I20260709 12:23:55.865859 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
I20260709 12:23:55.866151 12511 raft_consensus.cc:3060] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.866482 12586 raft_consensus.cc:3060] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:55.871536 12511 raft_consensus.cc:2468] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 1.
I20260709 12:23:55.871726 12586 raft_consensus.cc:2468] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 1.
I20260709 12:23:55.872800 12402 leader_election.cc:304] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, 90d7daeb266f4bbeb745b97a899ecf35; no voters: 
I20260709 12:23:55.873503 12632 raft_consensus.cc:2804] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:55.873932 12632 raft_consensus.cc:697] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Becoming Leader. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Running, Role: LEADER
I20260709 12:23:55.874585 12632 consensus_queue.cc:237] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:55.881699 12332 catalog_manager.cc:5697] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2678f07543b94e73b941aee9e3c0994a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "2678f07543b94e73b941aee9e3c0994a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.933640 12632 consensus_queue.cc:1048] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:55.957952 12332 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33598:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:55.961205 12332 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:55.963842 12639 consensus_queue.cc:1048] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:55.990415 12425 tablet_service.cc:1511] Processing CreateTablet for tablet abfad3ec4e0d4d279f19ffe863c95a3f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d7d82377d6cd49658924d92b6efc0650]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:55.991390 12500 tablet_service.cc:1511] Processing CreateTablet for tablet abfad3ec4e0d4d279f19ffe863c95a3f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d7d82377d6cd49658924d92b6efc0650]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:55.991811 12425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfad3ec4e0d4d279f19ffe863c95a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.992805 12500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfad3ec4e0d4d279f19ffe863c95a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.993106 12576 tablet_service.cc:1511] Processing CreateTablet for tablet abfad3ec4e0d4d279f19ffe863c95a3f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d7d82377d6cd49658924d92b6efc0650]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:23:55.994385 12576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfad3ec4e0d4d279f19ffe863c95a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.996575 12501 tablet_service.cc:1511] Processing CreateTablet for tablet db6d16752e7547c3b0926b4c9f8c9893 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d7d82377d6cd49658924d92b6efc0650]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:55.998698 12501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db6d16752e7547c3b0926b4c9f8c9893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.998649 12575 tablet_service.cc:1511] Processing CreateTablet for tablet db6d16752e7547c3b0926b4c9f8c9893 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d7d82377d6cd49658924d92b6efc0650]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:56.000686 12426 tablet_service.cc:1511] Processing CreateTablet for tablet db6d16752e7547c3b0926b4c9f8c9893 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d7d82377d6cd49658924d92b6efc0650]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:23:56.001304 12575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db6d16752e7547c3b0926b4c9f8c9893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.001953 12426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db6d16752e7547c3b0926b4c9f8c9893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.034619 12655 tablet_bootstrap.cc:492] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35: Bootstrap starting.
I20260709 12:23:56.040529 12654 tablet_bootstrap.cc:492] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6: Bootstrap starting.
I20260709 12:23:56.044613 12655 tablet_bootstrap.cc:654] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.046126 12656 tablet_bootstrap.cc:492] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a: Bootstrap starting.
I20260709 12:23:56.048167 12654 tablet_bootstrap.cc:654] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.049804 12655 tablet_bootstrap.cc:492] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35: No bootstrap required, opened a new log
I20260709 12:23:56.050285 12655 ts_tablet_manager.cc:1403] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:23:56.053344 12656 tablet_bootstrap.cc:654] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.053042 12655 raft_consensus.cc:359] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.053840 12655 raft_consensus.cc:385] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.053938 12654 tablet_bootstrap.cc:492] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6: No bootstrap required, opened a new log
I20260709 12:23:56.054250 12655 raft_consensus.cc:740] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.054663 12654 ts_tablet_manager.cc:1403] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:23:56.055248 12655 consensus_queue.cc:260] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.057703 12655 ts_tablet_manager.cc:1434] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:23:56.058272 12654 raft_consensus.cc:359] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.059242 12655 tablet_bootstrap.cc:492] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: Bootstrap starting.
I20260709 12:23:56.059562 12654 raft_consensus.cc:385] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.060084 12654 raft_consensus.cc:740] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47f11b009cf459ba86e038ce640bfd6, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.061352 12654 consensus_queue.cc:260] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.070407 12655 tablet_bootstrap.cc:654] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.072826 12654 ts_tablet_manager.cc:1434] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:23:56.074388 12654 tablet_bootstrap.cc:492] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: Bootstrap starting.
I20260709 12:23:56.081014 12656 tablet_bootstrap.cc:492] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a: No bootstrap required, opened a new log
I20260709 12:23:56.081668 12656 ts_tablet_manager.cc:1403] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.012s
I20260709 12:23:56.084472 12654 tablet_bootstrap.cc:654] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.084844 12656 raft_consensus.cc:359] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.085551 12656 raft_consensus.cc:385] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.085816 12656 raft_consensus.cc:740] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.086302 12655 tablet_bootstrap.cc:492] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: No bootstrap required, opened a new log
I20260709 12:23:56.086520 12656 consensus_queue.cc:260] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.086838 12655 ts_tablet_manager.cc:1403] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 12:23:56.088768 12656 ts_tablet_manager.cc:1434] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:56.089866 12656 tablet_bootstrap.cc:492] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: Bootstrap starting.
I20260709 12:23:56.090178 12655 raft_consensus.cc:359] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.090936 12655 raft_consensus.cc:385] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.091271 12655 raft_consensus.cc:740] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.092147 12655 consensus_queue.cc:260] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.094513 12655 ts_tablet_manager.cc:1434] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:23:56.096951 12656 tablet_bootstrap.cc:654] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:56.098364 12639 raft_consensus.cc:493] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.099080 12639 raft_consensus.cc:515] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.102769 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfad3ec4e0d4d279f19ffe863c95a3f" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35" is_pre_election: true
I20260709 12:23:56.103531 12511 raft_consensus.cc:2468] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 0.
I20260709 12:23:56.103865 12639 leader_election.cc:290] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:56.104542 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfad3ec4e0d4d279f19ffe863c95a3f" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6" is_pre_election: true
I20260709 12:23:56.105166 12586 raft_consensus.cc:2468] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 0.
I20260709 12:23:56.105916 12654 tablet_bootstrap.cc:492] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: No bootstrap required, opened a new log
I20260709 12:23:56.106468 12654 ts_tablet_manager.cc:1403] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.017s
I20260709 12:23:56.109127 12402 leader_election.cc:304] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, 90d7daeb266f4bbeb745b97a899ecf35; no voters: 
I20260709 12:23:56.109594 12654 raft_consensus.cc:359] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.110071 12639 raft_consensus.cc:2804] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.110412 12654 raft_consensus.cc:385] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.110695 12639 raft_consensus.cc:493] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.111286 12639 raft_consensus.cc:3060] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.110828 12654 raft_consensus.cc:740] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47f11b009cf459ba86e038ce640bfd6, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.112388 12654 consensus_queue.cc:260] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.113989 12656 tablet_bootstrap.cc:492] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: No bootstrap required, opened a new log
I20260709 12:23:56.114624 12656 ts_tablet_manager.cc:1403] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 12:23:56.114782 12654 ts_tablet_manager.cc:1434] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:56.117820 12656 raft_consensus.cc:359] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.118549 12656 raft_consensus.cc:385] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:56.118857 12656 raft_consensus.cc:740] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Initialized, Role: FOLLOWER
I20260709 12:23:56.119681 12656 consensus_queue.cc:260] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.120932 12639 raft_consensus.cc:515] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.122087 12656 ts_tablet_manager.cc:1434] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:56.123153 12639 leader_election.cc:290] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 election: Requested vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:56.124179 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfad3ec4e0d4d279f19ffe863c95a3f" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
I20260709 12:23:56.124357 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfad3ec4e0d4d279f19ffe863c95a3f" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
I20260709 12:23:56.124794 12511 raft_consensus.cc:3060] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.124984 12586 raft_consensus.cc:3060] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.133347 12586 raft_consensus.cc:2468] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 1.
I20260709 12:23:56.134806 12399 leader_election.cc:304] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, e47f11b009cf459ba86e038ce640bfd6; no voters: 
I20260709 12:23:56.134845 12511 raft_consensus.cc:2468] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 1.
I20260709 12:23:56.135990 12639 raft_consensus.cc:2804] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.136644 12639 raft_consensus.cc:697] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Becoming Leader. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Running, Role: LEADER
I20260709 12:23:56.137547 12639 consensus_queue.cc:237] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.145887 12332 catalog_manager.cc:5697] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2678f07543b94e73b941aee9e3c0994a (127.3.7.129). New cstate: current_term: 1 leader_uuid: "2678f07543b94e73b941aee9e3c0994a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.170785 12634 raft_consensus.cc:493] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.171510 12634 raft_consensus.cc:515] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.173656 12634 leader_election.cc:290] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2678f07543b94e73b941aee9e3c0994a (127.3.7.129:37649), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:56.197002 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "90d7daeb266f4bbeb745b97a899ecf35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6" is_pre_election: true
I20260709 12:23:56.197382 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "90d7daeb266f4bbeb745b97a899ecf35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2678f07543b94e73b941aee9e3c0994a" is_pre_election: true
I20260709 12:23:56.197731 12586 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d7daeb266f4bbeb745b97a899ecf35 in term 0.
I20260709 12:23:56.198072 12436 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d7daeb266f4bbeb745b97a899ecf35 in term 0.
I20260709 12:23:56.198830 12474 leader_election.cc:304] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90d7daeb266f4bbeb745b97a899ecf35, e47f11b009cf459ba86e038ce640bfd6; no voters: 
I20260709 12:23:56.199667 12634 raft_consensus.cc:2804] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:56.200031 12634 raft_consensus.cc:493] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.200297 12634 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.206025 12634 raft_consensus.cc:515] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.207782 12634 leader_election.cc:290] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [CANDIDATE]: Term 1 election: Requested vote from peers 2678f07543b94e73b941aee9e3c0994a (127.3.7.129:37649), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:56.208738 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "90d7daeb266f4bbeb745b97a899ecf35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2678f07543b94e73b941aee9e3c0994a"
I20260709 12:23:56.208911 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "90d7daeb266f4bbeb745b97a899ecf35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
I20260709 12:23:56.209311 12436 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.209556 12586 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:56.215183 12436 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d7daeb266f4bbeb745b97a899ecf35 in term 1.
I20260709 12:23:56.215425 12586 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d7daeb266f4bbeb745b97a899ecf35 in term 1.
I20260709 12:23:56.216666 12476 leader_election.cc:304] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, 90d7daeb266f4bbeb745b97a899ecf35; no voters: 
I20260709 12:23:56.217492 12634 raft_consensus.cc:2804] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:56.218593 12634 raft_consensus.cc:697] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 LEADER]: Becoming Leader. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Running, Role: LEADER
I20260709 12:23:56.219480 12634 consensus_queue.cc:237] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.227504 12332 catalog_manager.cc:5697] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "90d7daeb266f4bbeb745b97a899ecf35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.297345 12436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343"
dest_uuid: "2678f07543b94e73b941aee9e3c0994a"
mode: GRACEFUL
new_leader_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
 from {username='slave'} at 127.0.0.1:55630
I20260709 12:23:56.297922 12436 raft_consensus.cc:606] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Received request to transfer leadership to TS 90d7daeb266f4bbeb745b97a899ecf35
I20260709 12:23:56.311638 12639 consensus_queue.cc:1048] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.318233 12510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893"
dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
mode: GRACEFUL
new_leader_uuid: "2678f07543b94e73b941aee9e3c0994a"
 from {username='slave'} at 127.0.0.1:60886
I20260709 12:23:56.318924 12510 raft_consensus.cc:606] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 LEADER]: Received request to transfer leadership to TS 2678f07543b94e73b941aee9e3c0994a
I20260709 12:23:56.319423 12651 raft_consensus.cc:993] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: : Instructing follower 90d7daeb266f4bbeb745b97a899ecf35 to start an election
I20260709 12:23:56.319926 12651 raft_consensus.cc:1081] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Signalling peer 90d7daeb266f4bbeb745b97a899ecf35 to start an election
I20260709 12:23:56.324555 12651 consensus_queue.cc:1048] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.331058 12511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343"
dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
 from {username='slave'} at 127.0.0.1:60882
I20260709 12:23:56.332050 12511 raft_consensus.cc:493] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.332576 12511 raft_consensus.cc:3060] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.341504 12511 raft_consensus.cc:515] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.344154 12436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343" candidate_uuid: "90d7daeb266f4bbeb745b97a899ecf35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2678f07543b94e73b941aee9e3c0994a"
I20260709 12:23:56.344797 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a9edf098294725b6c05bb4b18f0343" candidate_uuid: "90d7daeb266f4bbeb745b97a899ecf35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
I20260709 12:23:56.344841 12436 raft_consensus.cc:3055] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.345558 12586 raft_consensus.cc:3060] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.345590 12436 raft_consensus.cc:740] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Running, Role: LEADER
I20260709 12:23:56.344254 12511 leader_election.cc:290] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [CANDIDATE]: Term 2 election: Requested vote from peers 2678f07543b94e73b941aee9e3c0994a (127.3.7.129:37649), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:56.346832 12436 consensus_queue.cc:260] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.348601 12436 raft_consensus.cc:3060] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.352505 12586 raft_consensus.cc:2468] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d7daeb266f4bbeb745b97a899ecf35 in term 2.
I20260709 12:23:56.354034 12474 leader_election.cc:304] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90d7daeb266f4bbeb745b97a899ecf35, e47f11b009cf459ba86e038ce640bfd6; no voters: 
I20260709 12:23:56.354925 12634 raft_consensus.cc:2804] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.355423 12634 raft_consensus.cc:697] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 LEADER]: Becoming Leader. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Running, Role: LEADER
I20260709 12:23:56.355835 12436 raft_consensus.cc:2468] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d7daeb266f4bbeb745b97a899ecf35 in term 2.
I20260709 12:23:56.356267 12634 consensus_queue.cc:237] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.364398 12332 catalog_manager.cc:5697] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 reported cstate change: term changed from 1 to 2, leader changed from 2678f07543b94e73b941aee9e3c0994a (127.3.7.129) to 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "90d7daeb266f4bbeb745b97a899ecf35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.545526 12651 consensus_queue.cc:1048] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.558509 12632 consensus_queue.cc:1048] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.747992 12634 consensus_queue.cc:1048] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.753506 12634 consensus_queue.cc:1048] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:56.763646 12634 raft_consensus.cc:993] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: : Instructing follower 2678f07543b94e73b941aee9e3c0994a to start an election
I20260709 12:23:56.764204 12668 raft_consensus.cc:1081] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 LEADER]: Signalling peer 2678f07543b94e73b941aee9e3c0994a to start an election
I20260709 12:23:56.766542 12435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893"
dest_uuid: "2678f07543b94e73b941aee9e3c0994a"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:23:56.768410 12435 raft_consensus.cc:493] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.768880 12435 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.776564 12435 raft_consensus.cc:515] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.781101 12435 leader_election.cc:290] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 2 election: Requested vote from peers 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821), e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131:34463)
I20260709 12:23:56.781330 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
I20260709 12:23:56.782073 12511 raft_consensus.cc:3055] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.782435 12511 raft_consensus.cc:740] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90d7daeb266f4bbeb745b97a899ecf35, State: Running, Role: LEADER
I20260709 12:23:56.783267 12511 consensus_queue.cc:260] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.784235 12586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "2678f07543b94e73b941aee9e3c0994a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
I20260709 12:23:56.784824 12511 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.784935 12586 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.792301 12511 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 2.
I20260709 12:23:56.792438 12586 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2678f07543b94e73b941aee9e3c0994a in term 2.
I20260709 12:23:56.793609 12402 leader_election.cc:304] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2678f07543b94e73b941aee9e3c0994a, 90d7daeb266f4bbeb745b97a899ecf35; no voters: 
I20260709 12:23:56.794672 12632 raft_consensus.cc:2804] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.795097 12632 raft_consensus.cc:697] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 LEADER]: Becoming Leader. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Running, Role: LEADER
I20260709 12:23:56.795775 12632 consensus_queue.cc:237] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:56.801885 12332 catalog_manager.cc:5697] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a reported cstate change: term changed from 1 to 2, leader changed from 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130) to 2678f07543b94e73b941aee9e3c0994a (127.3.7.129). New cstate: current_term: 2 leader_uuid: "2678f07543b94e73b941aee9e3c0994a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.943710 12586 raft_consensus.cc:1275] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Refusing update from remote peer 90d7daeb266f4bbeb745b97a899ecf35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:56.945333 12668 consensus_queue.cc:1048] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.954118 12435 raft_consensus.cc:1275] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Refusing update from remote peer 90d7daeb266f4bbeb745b97a899ecf35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:56.956305 12678 consensus_queue.cc:1048] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.075176  3102 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:23:57.076965  3102 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:23:57.077386  3102 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:23:57.089632 12435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893"
dest_uuid: "2678f07543b94e73b941aee9e3c0994a"
mode: GRACEFUL
new_leader_uuid: "e47f11b009cf459ba86e038ce640bfd6"
 from {username='slave'} at 127.0.0.1:55646
I20260709 12:23:57.090179 12435 raft_consensus.cc:606] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 LEADER]: Received request to transfer leadership to TS e47f11b009cf459ba86e038ce640bfd6
I20260709 12:23:57.091251  3102 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:23:57.341264 12511 raft_consensus.cc:1275] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 FOLLOWER]: Refusing update from remote peer 2678f07543b94e73b941aee9e3c0994a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.342758 12682 consensus_queue.cc:1048] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.351008 12586 raft_consensus.cc:1275] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Refusing update from remote peer 2678f07543b94e73b941aee9e3c0994a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.352794 12651 consensus_queue.cc:1048] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.360785 12682 raft_consensus.cc:993] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: : Instructing follower e47f11b009cf459ba86e038ce640bfd6 to start an election
I20260709 12:23:57.361299 12651 raft_consensus.cc:1081] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 LEADER]: Signalling peer e47f11b009cf459ba86e038ce640bfd6 to start an election
I20260709 12:23:57.362952 12585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893"
dest_uuid: "e47f11b009cf459ba86e038ce640bfd6"
 from {username='slave'} at 127.0.0.1:44662
I20260709 12:23:57.363541 12585 raft_consensus.cc:493] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:57.363857 12585 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.369330 12585 raft_consensus.cc:515] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:57.377765 12585 leader_election.cc:290] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [CANDIDATE]: Term 3 election: Requested vote from peers 2678f07543b94e73b941aee9e3c0994a (127.3.7.129:37649), 90d7daeb266f4bbeb745b97a899ecf35 (127.3.7.130:39821)
I20260709 12:23:57.389043 12435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "e47f11b009cf459ba86e038ce640bfd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2678f07543b94e73b941aee9e3c0994a"
I20260709 12:23:57.389387 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d16752e7547c3b0926b4c9f8c9893" candidate_uuid: "e47f11b009cf459ba86e038ce640bfd6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90d7daeb266f4bbeb745b97a899ecf35"
I20260709 12:23:57.389652 12435 raft_consensus.cc:3055] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.390128 12511 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.390193 12435 raft_consensus.cc:740] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2678f07543b94e73b941aee9e3c0994a, State: Running, Role: LEADER
I20260709 12:23:57.391111 12435 consensus_queue.cc:260] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:57.392230 12435 raft_consensus.cc:3060] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.395576 12511 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47f11b009cf459ba86e038ce640bfd6 in term 3.
I20260709 12:23:57.396919 12552 leader_election.cc:304] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90d7daeb266f4bbeb745b97a899ecf35, e47f11b009cf459ba86e038ce640bfd6; no voters: 
I20260709 12:23:57.397425 12435 raft_consensus.cc:2468] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47f11b009cf459ba86e038ce640bfd6 in term 3.
I20260709 12:23:57.397799 12633 raft_consensus.cc:2804] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.399137 12633 raft_consensus.cc:697] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 3 LEADER]: Becoming Leader. State: Replica: e47f11b009cf459ba86e038ce640bfd6, State: Running, Role: LEADER
I20260709 12:23:57.399961 12633 consensus_queue.cc:237] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } }
I20260709 12:23:57.407151 12330 catalog_manager.cc:5697] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 reported cstate change: term changed from 2 to 3, leader changed from 2678f07543b94e73b941aee9e3c0994a (127.3.7.129) to e47f11b009cf459ba86e038ce640bfd6 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "e47f11b009cf459ba86e038ce640bfd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2678f07543b94e73b941aee9e3c0994a" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 37649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90d7daeb266f4bbeb745b97a899ecf35" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47f11b009cf459ba86e038ce640bfd6" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 34463 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.447957  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
I20260709 12:23:57.468796  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:57.469517  3102 tablet_replica.cc:333] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a: stopping tablet replica
I20260709 12:23:57.470172  3102 raft_consensus.cc:2243] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.470975  3102 raft_consensus.cc:2272] T abfad3ec4e0d4d279f19ffe863c95a3f P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.473999  3102 tablet_replica.cc:333] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a: stopping tablet replica
I20260709 12:23:57.474584  3102 raft_consensus.cc:2243] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.475046  3102 raft_consensus.cc:2272] T 55a9edf098294725b6c05bb4b18f0343 P 2678f07543b94e73b941aee9e3c0994a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.477169  3102 tablet_replica.cc:333] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a: stopping tablet replica
I20260709 12:23:57.477743  3102 raft_consensus.cc:2243] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.478236  3102 raft_consensus.cc:2272] T db6d16752e7547c3b0926b4c9f8c9893 P 2678f07543b94e73b941aee9e3c0994a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.480424  3102 tablet_replica.cc:333] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a: stopping tablet replica
I20260709 12:23:57.480888  3102 raft_consensus.cc:2243] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.481606  3102 raft_consensus.cc:2272] T 19eccf80915f4e70aaafff98fb7e56c6 P 2678f07543b94e73b941aee9e3c0994a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.506395  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
I20260709 12:23:57.519078  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
I20260709 12:23:57.539423  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:57.540217  3102 tablet_replica.cc:333] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35: stopping tablet replica
I20260709 12:23:57.540843  3102 raft_consensus.cc:2243] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.541282  3102 raft_consensus.cc:2272] T abfad3ec4e0d4d279f19ffe863c95a3f P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.543742  3102 tablet_replica.cc:333] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35: stopping tablet replica
I20260709 12:23:57.544286  3102 raft_consensus.cc:2243] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.545080  3102 raft_consensus.cc:2272] T 55a9edf098294725b6c05bb4b18f0343 P 90d7daeb266f4bbeb745b97a899ecf35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.547502  3102 tablet_replica.cc:333] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35: stopping tablet replica
I20260709 12:23:57.548002  3102 raft_consensus.cc:2243] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.548385  3102 raft_consensus.cc:2272] T db6d16752e7547c3b0926b4c9f8c9893 P 90d7daeb266f4bbeb745b97a899ecf35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.550431  3102 tablet_replica.cc:333] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35: stopping tablet replica
I20260709 12:23:57.550868  3102 raft_consensus.cc:2243] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.551234  3102 raft_consensus.cc:2272] T 19eccf80915f4e70aaafff98fb7e56c6 P 90d7daeb266f4bbeb745b97a899ecf35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.573895  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
I20260709 12:23:57.586426  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
I20260709 12:23:57.604681  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:57.605394  3102 tablet_replica.cc:333] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6: stopping tablet replica
I20260709 12:23:57.605976  3102 raft_consensus.cc:2243] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.606467  3102 raft_consensus.cc:2272] T abfad3ec4e0d4d279f19ffe863c95a3f P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.608529  3102 tablet_replica.cc:333] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6: stopping tablet replica
I20260709 12:23:57.609089  3102 raft_consensus.cc:2243] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.609555  3102 raft_consensus.cc:2272] T 55a9edf098294725b6c05bb4b18f0343 P e47f11b009cf459ba86e038ce640bfd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.612071  3102 tablet_replica.cc:333] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: stopping tablet replica
I20260709 12:23:57.612674  3102 raft_consensus.cc:2243] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.613377  3102 pending_rounds.cc:70] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: Trying to abort 1 pending ops.
I20260709 12:23:57.613536  3102 pending_rounds.cc:77] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305624933997568000 op_type: NO_OP noop_request { }
I20260709 12:23:57.613862  3102 raft_consensus.cc:2889] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:57.614171  3102 raft_consensus.cc:2272] T db6d16752e7547c3b0926b4c9f8c9893 P e47f11b009cf459ba86e038ce640bfd6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.616971  3102 tablet_replica.cc:333] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6: stopping tablet replica
I20260709 12:23:57.617486  3102 raft_consensus.cc:2243] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:57.617926  3102 raft_consensus.cc:2272] T 19eccf80915f4e70aaafff98fb7e56c6 P e47f11b009cf459ba86e038ce640bfd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.641440  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
I20260709 12:23:57.654505  3102 master.cc:562] Master@127.3.7.190:44911 shutting down...
I20260709 12:23:57.670794  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:57.671442  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:57.671797  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P d3b0f81fa3d04c50bf4dc9c191182cd8: stopping tablet replica
I20260709 12:23:57.690132  3102 master.cc:584] Master@127.3.7.190:44911 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3030 ms)
[----------] 6 tests from LeaderRebalancerTest (316571 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:23:57.718528  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:33427
I20260709 12:23:57.719774  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:57.724853 12690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:57.725004 12691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:57.726394 12693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:57.727407  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:57.728193  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:57.728365  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:57.728555  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599837728539 us; error 0 us; skew 500 ppm
I20260709 12:23:57.729153  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:57.731808  3102 webserver.cc:533] Webserver started at http://127.3.7.190:38045/ using document root <none> and password file <none>
I20260709 12:23:57.732343  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:57.732546  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:57.732872  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:57.734074  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "afc94e5c04da4a4c96337c51793ab6da"
format_stamp: "Formatted at 2026-07-09 12:23:57 on dist-test-slave-6qf7"
I20260709 12:23:57.739168  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:23:57.742946 12698 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:57.743937  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:57.744248  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "afc94e5c04da4a4c96337c51793ab6da"
format_stamp: "Formatted at 2026-07-09 12:23:57 on dist-test-slave-6qf7"
I20260709 12:23:57.744517  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:57.755487  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:57.756691  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:57.795992  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:33427
I20260709 12:23:57.796113 12749 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:33427 every 8 connection(s)
I20260709 12:23:57.800140 12750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:57.811432 12750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da: Bootstrap starting.
I20260709 12:23:57.815861 12750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:57.819830 12750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da: No bootstrap required, opened a new log
I20260709 12:23:57.821895 12750 raft_consensus.cc:359] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc94e5c04da4a4c96337c51793ab6da" member_type: VOTER }
I20260709 12:23:57.822275 12750 raft_consensus.cc:385] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:57.822551 12750 raft_consensus.cc:740] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc94e5c04da4a4c96337c51793ab6da, State: Initialized, Role: FOLLOWER
I20260709 12:23:57.823156 12750 consensus_queue.cc:260] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc94e5c04da4a4c96337c51793ab6da" member_type: VOTER }
I20260709 12:23:57.823640 12750 raft_consensus.cc:399] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:57.823866 12750 raft_consensus.cc:493] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:57.824108 12750 raft_consensus.cc:3060] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:57.829319 12750 raft_consensus.cc:515] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc94e5c04da4a4c96337c51793ab6da" member_type: VOTER }
I20260709 12:23:57.829885 12750 leader_election.cc:304] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afc94e5c04da4a4c96337c51793ab6da; no voters: 
I20260709 12:23:57.831040 12750 leader_election.cc:290] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:57.831445 12754 raft_consensus.cc:2804] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:57.832906 12754 raft_consensus.cc:697] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 1 LEADER]: Becoming Leader. State: Replica: afc94e5c04da4a4c96337c51793ab6da, State: Running, Role: LEADER
I20260709 12:23:57.833599 12754 consensus_queue.cc:237] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc94e5c04da4a4c96337c51793ab6da" member_type: VOTER }
I20260709 12:23:57.834112 12750 sys_catalog.cc:565] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:57.836767 12756 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [sys.catalog]: SysCatalogTable state changed. Reason: New leader afc94e5c04da4a4c96337c51793ab6da. Latest consensus state: current_term: 1 leader_uuid: "afc94e5c04da4a4c96337c51793ab6da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc94e5c04da4a4c96337c51793ab6da" member_type: VOTER } }
I20260709 12:23:57.836828 12755 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afc94e5c04da4a4c96337c51793ab6da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc94e5c04da4a4c96337c51793ab6da" member_type: VOTER } }
I20260709 12:23:57.837519 12756 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:57.837577 12755 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:57.840482 12760 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:57.848666 12760 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:57.850436  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:57.858289 12760 catalog_manager.cc:1383] Generated new cluster ID: fee61472da5d4e9a9e9687be721de6bf
I20260709 12:23:57.858623 12760 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:57.874760 12760 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:57.876142 12760 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:57.893612 12760 catalog_manager.cc:6070] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da: Generated new TSK 0
I20260709 12:23:57.894256 12760 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:57.917542  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:57.924033 12772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:57.925571 12773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:57.927397 12775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:57.927784  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:57.928828  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:57.929021  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:57.929245  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599837929209 us; error 0 us; skew 500 ppm
I20260709 12:23:57.929840  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:57.932507  3102 webserver.cc:533] Webserver started at http://127.3.7.129:45217/ using document root <none> and password file <none>
I20260709 12:23:57.932991  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:57.933149  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:57.933490  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:57.934579  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
format_stamp: "Formatted at 2026-07-09 12:23:57 on dist-test-slave-6qf7"
I20260709 12:23:57.939339  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:57.942826 12781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:57.943616  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:57.943964  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
format_stamp: "Formatted at 2026-07-09 12:23:57 on dist-test-slave-6qf7"
I20260709 12:23:57.944271  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:57.958575  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:57.959860  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:57.961331  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:57.963744  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:57.963965  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:57.964227  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:57.964409  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.004364  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:46469
I20260709 12:23:58.004482 12843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:46469 every 8 connection(s)
I20260709 12:23:58.009418  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:58.017210 12848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:58.019196 12849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:58.022414 12851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:58.024112  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:58.025040 12844 heartbeater.cc:344] Connected to a master server at 127.3.7.190:33427
I20260709 12:23:58.025252  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:58.025516 12844 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:58.025606  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:58.025882  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599838025865 us; error 0 us; skew 500 ppm
I20260709 12:23:58.026511 12844 heartbeater.cc:507] Master 127.3.7.190:33427 requested a full tablet report, sending...
I20260709 12:23:58.026728  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:58.029090 12715 ts_manager.cc:194] Registered new tserver with Master: b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469)
I20260709 12:23:58.029672  3102 webserver.cc:533] Webserver started at http://127.3.7.130:37327/ using document root <none> and password file <none>
I20260709 12:23:58.030210  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:58.030426  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:58.030706  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:58.031106 12715 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50836
I20260709 12:23:58.031913  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "4a58242bae09424e8951a4a882f57c39"
format_stamp: "Formatted at 2026-07-09 12:23:58 on dist-test-slave-6qf7"
I20260709 12:23:58.037070  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:58.040669 12857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.041646  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:23:58.041905  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "4a58242bae09424e8951a4a882f57c39"
format_stamp: "Formatted at 2026-07-09 12:23:58 on dist-test-slave-6qf7"
I20260709 12:23:58.042155  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:58.059206  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:58.060686  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:58.062143  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:58.064630  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:58.064819  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.065146  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:58.065310  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.107677  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:40501
I20260709 12:23:58.107796 12919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:40501 every 8 connection(s)
I20260709 12:23:58.112681  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:58.120930 12923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:58.122189 12924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:58.125172 12920 heartbeater.cc:344] Connected to a master server at 127.3.7.190:33427
I20260709 12:23:58.125731 12920 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:58.125799 12926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:58.126113  3102 server_base.cc:1061] running on GCE node
I20260709 12:23:58.126835 12920 heartbeater.cc:507] Master 127.3.7.190:33427 requested a full tablet report, sending...
I20260709 12:23:58.127252  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:58.127615  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:58.127841  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599838127822 us; error 0 us; skew 500 ppm
I20260709 12:23:58.128677  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:58.129365 12715 ts_manager.cc:194] Registered new tserver with Master: 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:23:58.131690 12715 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50840
I20260709 12:23:58.131865  3102 webserver.cc:533] Webserver started at http://127.3.7.131:39989/ using document root <none> and password file <none>
I20260709 12:23:58.132609  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:58.132875  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:58.133241  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:58.134446  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "fc9b5699a29143a1b83240426cb8f202"
format_stamp: "Formatted at 2026-07-09 12:23:58 on dist-test-slave-6qf7"
I20260709 12:23:58.139499  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:23:58.143172 12932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.144234  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:23:58.144618  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "fc9b5699a29143a1b83240426cb8f202"
format_stamp: "Formatted at 2026-07-09 12:23:58 on dist-test-slave-6qf7"
I20260709 12:23:58.144955  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:58.162611  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:58.163902  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:58.165407  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:58.167855  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:58.168103  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.168356  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:58.168537  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:58.209962  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:45809
I20260709 12:23:58.210160 12994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:45809 every 8 connection(s)
I20260709 12:23:58.224858 12995 heartbeater.cc:344] Connected to a master server at 127.3.7.190:33427
I20260709 12:23:58.225376 12995 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:58.226269 12995 heartbeater.cc:507] Master 127.3.7.190:33427 requested a full tablet report, sending...
I20260709 12:23:58.228487 12715 ts_manager.cc:194] Registered new tserver with Master: fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.228708  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015373052s
I20260709 12:23:58.230520 12715 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50854
I20260709 12:23:58.257314 12715 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50868:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:58.260231 12715 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:58.337213 12885 tablet_service.cc:1511] Processing CreateTablet for tablet 2d486d0e245e4a42a94cbe1aa4f8df56 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:58.338816 12885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d486d0e245e4a42a94cbe1aa4f8df56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.338487 12883 tablet_service.cc:1511] Processing CreateTablet for tablet 04c57746c93c492ab4f50be15abfe86f (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:58.338726 12882 tablet_service.cc:1511] Processing CreateTablet for tablet 19b8c17a33ce463e8d0e8558aa32bd07 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:58.340062 12883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c57746c93c492ab4f50be15abfe86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.340533 12881 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcd0c3747b74436b8ba0e0b11db3a48 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:58.341939 12881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcd0c3747b74436b8ba0e0b11db3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.345299 12880 tablet_service.cc:1511] Processing CreateTablet for tablet 6d61f30a9975498da59dc45ffe62993a (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:58.348837 12879 tablet_service.cc:1511] Processing CreateTablet for tablet 77b57f9c807747bab426c65049fcf252 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:58.341956 12884 tablet_service.cc:1511] Processing CreateTablet for tablet f320dc5ffca54822a8b937396332dbc6 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:58.353230 12884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f320dc5ffca54822a8b937396332dbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.353945 12879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b57f9c807747bab426c65049fcf252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.355904 12882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b8c17a33ce463e8d0e8558aa32bd07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.358203 12880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d61f30a9975498da59dc45ffe62993a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.373757 13010 tablet_bootstrap.cc:492] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.380370 13010 tablet_bootstrap.cc:654] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.380620 12960 tablet_service.cc:1511] Processing CreateTablet for tablet 2d486d0e245e4a42a94cbe1aa4f8df56 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:58.382050 12960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d486d0e245e4a42a94cbe1aa4f8df56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.386232 13010 tablet_bootstrap.cc:492] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.387997 12959 tablet_service.cc:1511] Processing CreateTablet for tablet f320dc5ffca54822a8b937396332dbc6 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:58.389477 12959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f320dc5ffca54822a8b937396332dbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.389107 12883 tablet_service.cc:1511] Processing CreateTablet for tablet 4494b1fc744048f2b08edbe9ef5b9d27 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:58.386968 13010 ts_tablet_manager.cc:1403] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:23:58.393335 12882 tablet_service.cc:1511] Processing CreateTablet for tablet 6846b79d30024ea8837b42836e2fd819 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:58.395138 13010 raft_consensus.cc:359] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.395987 13010 raft_consensus.cc:385] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.396261 13010 raft_consensus.cc:740] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.397114 13010 consensus_queue.cc:260] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.400089 13010 ts_tablet_manager.cc:1434] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:23:58.400213 12920 heartbeater.cc:499] Master 127.3.7.190:33427 was elected leader, sending a full tablet report...
I20260709 12:23:58.401218 13010 tablet_bootstrap.cc:492] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.402571 12958 tablet_service.cc:1511] Processing CreateTablet for tablet 04c57746c93c492ab4f50be15abfe86f (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:58.403939 12809 tablet_service.cc:1511] Processing CreateTablet for tablet 2d486d0e245e4a42a94cbe1aa4f8df56 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:58.404351 12957 tablet_service.cc:1511] Processing CreateTablet for tablet 19b8c17a33ce463e8d0e8558aa32bd07 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:58.405377 12809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d486d0e245e4a42a94cbe1aa4f8df56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.405709 12957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b8c17a33ce463e8d0e8558aa32bd07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.408430 12956 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcd0c3747b74436b8ba0e0b11db3a48 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:58.408838 12808 tablet_service.cc:1511] Processing CreateTablet for tablet f320dc5ffca54822a8b937396332dbc6 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:58.409840 12956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcd0c3747b74436b8ba0e0b11db3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.410117 12808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f320dc5ffca54822a8b937396332dbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.410959 13010 tablet_bootstrap.cc:654] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.412417 12955 tablet_service.cc:1511] Processing CreateTablet for tablet 6d61f30a9975498da59dc45ffe62993a (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:58.412417 12807 tablet_service.cc:1511] Processing CreateTablet for tablet 04c57746c93c492ab4f50be15abfe86f (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:58.413902 12955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d61f30a9975498da59dc45ffe62993a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.414252 12807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c57746c93c492ab4f50be15abfe86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.416306 12954 tablet_service.cc:1511] Processing CreateTablet for tablet 77b57f9c807747bab426c65049fcf252 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:58.417649 12954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b57f9c807747bab426c65049fcf252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.420439 12804 tablet_service.cc:1511] Processing CreateTablet for tablet 6d61f30a9975498da59dc45ffe62993a (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:58.422013 12804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d61f30a9975498da59dc45ffe62993a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.415161 12805 tablet_service.cc:1511] Processing CreateTablet for tablet 7bcd0c3747b74436b8ba0e0b11db3a48 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:58.413491 12806 tablet_service.cc:1511] Processing CreateTablet for tablet 19b8c17a33ce463e8d0e8558aa32bd07 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:58.424417 12803 tablet_service.cc:1511] Processing CreateTablet for tablet 77b57f9c807747bab426c65049fcf252 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:58.424490 12805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcd0c3747b74436b8ba0e0b11db3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.425838 12803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b57f9c807747bab426c65049fcf252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.427935 12802 tablet_service.cc:1511] Processing CreateTablet for tablet 4494b1fc744048f2b08edbe9ef5b9d27 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:58.429874 12806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b8c17a33ce463e8d0e8558aa32bd07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.430258 12801 tablet_service.cc:1511] Processing CreateTablet for tablet 6846b79d30024ea8837b42836e2fd819 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:58.431552 12801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6846b79d30024ea8837b42836e2fd819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.434477 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c57746c93c492ab4f50be15abfe86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.439841 12952 tablet_service.cc:1511] Processing CreateTablet for tablet 6846b79d30024ea8837b42836e2fd819 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:58.440953 12883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4494b1fc744048f2b08edbe9ef5b9d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.441735 12802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4494b1fc744048f2b08edbe9ef5b9d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.442190 12952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6846b79d30024ea8837b42836e2fd819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.443063 12882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6846b79d30024ea8837b42836e2fd819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.439841 12953 tablet_service.cc:1511] Processing CreateTablet for tablet 4494b1fc744048f2b08edbe9ef5b9d27 (DEFAULT_TABLE table=test-workload [id=b9d3e6f30741477f9989bdd95dcedf77]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:58.449683 12953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4494b1fc744048f2b08edbe9ef5b9d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.454787 13012 raft_consensus.cc:493] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.455651 13012 raft_consensus.cc:515] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.462211 13012 leader_election.cc:290] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.497889 13016 tablet_bootstrap.cc:492] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.552744 13010 tablet_bootstrap.cc:492] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.561105 13010 ts_tablet_manager.cc:1403] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.160s	user 0.033s	sys 0.049s
I20260709 12:23:58.566037 13010 raft_consensus.cc:359] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:58.572822 13015 tablet_bootstrap.cc:492] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:58.586458 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:58.570578 13010 raft_consensus.cc:385] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.587504 13010 raft_consensus.cc:740] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.588445 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:58.588599 13010 consensus_queue.cc:260] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
W20260709 12:23:58.590762 12861 leader_election.cc:343] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.591202 13010 ts_tablet_manager.cc:1434] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.002s
I20260709 12:23:58.599869 13010 tablet_bootstrap.cc:492] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
W20260709 12:23:58.598510 12861 leader_election.cc:343] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.603132 12861 leader_election.cc:304] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202
I20260709 12:23:58.603982 13012 raft_consensus.cc:2749] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.597440 13016 tablet_bootstrap.cc:654] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.606544 13010 tablet_bootstrap.cc:654] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.607553 13015 tablet_bootstrap.cc:654] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.612920 13015 tablet_bootstrap.cc:492] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:58.613423 13015 ts_tablet_manager.cc:1403] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.041s	user 0.002s	sys 0.007s
I20260709 12:23:58.616612 13015 raft_consensus.cc:359] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:58.617336 13015 raft_consensus.cc:385] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.617535 13010 tablet_bootstrap.cc:492] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.617631 13015 raft_consensus.cc:740] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.618244 13010 ts_tablet_manager.cc:1403] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 12:23:58.618625 13015 consensus_queue.cc:260] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:58.621269 12995 heartbeater.cc:499] Master 127.3.7.190:33427 was elected leader, sending a full tablet report...
I20260709 12:23:58.621126 13010 raft_consensus.cc:359] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.621676 13015 ts_tablet_manager.cc:1434] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:23:58.622052 13010 raft_consensus.cc:385] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.622428 13010 raft_consensus.cc:740] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.622859 13015 tablet_bootstrap.cc:492] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:58.623422 13010 consensus_queue.cc:260] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.624159 13016 tablet_bootstrap.cc:492] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:58.624727 13016 ts_tablet_manager.cc:1403] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.000s
I20260709 12:23:58.627559 13016 raft_consensus.cc:359] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.628281 13016 raft_consensus.cc:385] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.628593 13016 raft_consensus.cc:740] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.629078 13015 tablet_bootstrap.cc:654] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.630844 13016 consensus_queue.cc:260] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.637046 13015 tablet_bootstrap.cc:492] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:58.637712 13015 ts_tablet_manager.cc:1403] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:23:58.638813 12844 heartbeater.cc:499] Master 127.3.7.190:33427 was elected leader, sending a full tablet report...
I20260709 12:23:58.639488 13016 ts_tablet_manager.cc:1434] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.005s
I20260709 12:23:58.640650 13016 tablet_bootstrap.cc:492] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.641201 13015 raft_consensus.cc:359] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.641978 13015 raft_consensus.cc:385] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.642290 13015 raft_consensus.cc:740] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.643608 13010 ts_tablet_manager.cc:1434] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:23:58.643321 13015 consensus_queue.cc:260] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.646016 13015 ts_tablet_manager.cc:1434] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:58.647357 13015 tablet_bootstrap.cc:492] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:58.647465 13016 tablet_bootstrap.cc:654] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.648514 13010 tablet_bootstrap.cc:492] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.654522 13015 tablet_bootstrap.cc:654] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.656905 13010 tablet_bootstrap.cc:654] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.659075 13016 tablet_bootstrap.cc:492] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:58.659816 13016 ts_tablet_manager.cc:1403] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 12:23:58.664127 13016 raft_consensus.cc:359] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.665191 13016 raft_consensus.cc:385] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.665575 13016 raft_consensus.cc:740] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.666836 13016 consensus_queue.cc:260] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.670245 13016 ts_tablet_manager.cc:1434] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:58.671664 13016 tablet_bootstrap.cc:492] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.678380 13010 tablet_bootstrap.cc:492] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.679059 13010 ts_tablet_manager.cc:1403] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.002s
I20260709 12:23:58.679791 13016 tablet_bootstrap.cc:654] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.683539 13010 raft_consensus.cc:359] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.684649 13010 raft_consensus.cc:385] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.685045 13010 raft_consensus.cc:740] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.686523 13010 consensus_queue.cc:260] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.693079 13010 ts_tablet_manager.cc:1434] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:23:58.694542 13010 tablet_bootstrap.cc:492] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.703089 13010 tablet_bootstrap.cc:654] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.728683 13015 tablet_bootstrap.cc:492] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:58.729775 13015 ts_tablet_manager.cc:1403] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.083s	user 0.047s	sys 0.033s
I20260709 12:23:58.730055 13010 tablet_bootstrap.cc:492] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.730631 13010 ts_tablet_manager.cc:1403] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.015s
I20260709 12:23:58.730784 13016 tablet_bootstrap.cc:492] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:58.731371 13016 ts_tablet_manager.cc:1403] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.036s
I20260709 12:23:58.732934 13015 raft_consensus.cc:359] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.732945 13010 raft_consensus.cc:359] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.733930 13015 raft_consensus.cc:385] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.734107 13010 raft_consensus.cc:385] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.734326 13015 raft_consensus.cc:740] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.734505 13010 raft_consensus.cc:740] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.734263 13016 raft_consensus.cc:359] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.735229 13016 raft_consensus.cc:385] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.735638 13016 raft_consensus.cc:740] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.735592 13015 consensus_queue.cc:260] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.735610 13010 consensus_queue.cc:260] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.736876 13016 consensus_queue.cc:260] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.738229 13015 ts_tablet_manager.cc:1434] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:23:58.738356 13010 ts_tablet_manager.cc:1434] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.001s
I20260709 12:23:58.739194 13016 ts_tablet_manager.cc:1434] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:58.739519 13015 tablet_bootstrap.cc:492] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:58.739516 13010 tablet_bootstrap.cc:492] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.746275 13016 tablet_bootstrap.cc:492] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.747836 13015 tablet_bootstrap.cc:654] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.749150 13010 tablet_bootstrap.cc:654] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.756068 13016 tablet_bootstrap.cc:654] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.760720 13010 tablet_bootstrap.cc:492] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.761359 13010 ts_tablet_manager.cc:1403] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.022s	user 0.001s	sys 0.016s
I20260709 12:23:58.764631 13010 raft_consensus.cc:359] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.765434 13010 raft_consensus.cc:385] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.765784 13010 raft_consensus.cc:740] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.766748 13010 consensus_queue.cc:260] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.770195 13016 tablet_bootstrap.cc:492] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:58.771039 13016 ts_tablet_manager.cc:1403] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:23:58.771489 13010 ts_tablet_manager.cc:1434] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:58.772665 13010 tablet_bootstrap.cc:492] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.777194 13016 raft_consensus.cc:359] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.778322 13016 raft_consensus.cc:385] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.778753 13016 raft_consensus.cc:740] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.779708 13010 tablet_bootstrap.cc:654] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.780092 13016 consensus_queue.cc:260] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.785022 13016 ts_tablet_manager.cc:1434] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 12:23:58.786191 13016 tablet_bootstrap.cc:492] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.786396 13015 tablet_bootstrap.cc:492] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:58.787176 13015 ts_tablet_manager.cc:1403] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.021s
I20260709 12:23:58.791567 13015 raft_consensus.cc:359] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.792603 13015 raft_consensus.cc:385] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.792997 13015 raft_consensus.cc:740] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.793780 13016 tablet_bootstrap.cc:654] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.793864 13012 raft_consensus.cc:493] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.794559 13012 raft_consensus.cc:515] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.794977 13015 consensus_queue.cc:260] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.796700 13012 leader_election.cc:290] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.799485 13015 ts_tablet_manager.cc:1434] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:23:58.799721 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:58.800660 13015 tablet_bootstrap.cc:492] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
W20260709 12:23:58.801333 12861 leader_election.cc:343] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.801390 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:58.802155 13012 raft_consensus.cc:493] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.802866 13012 raft_consensus.cc:515] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
W20260709 12:23:58.804031 12861 leader_election.cc:343] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.804623 12861 leader_election.cc:304] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202
I20260709 12:23:58.805962 13012 leader_election.cc:290] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.806692 13012 raft_consensus.cc:2749] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:58.808017 13016 tablet_bootstrap.cc:492] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:58.808645 13016 ts_tablet_manager.cc:1403] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 12:23:58.808802 13015 tablet_bootstrap.cc:654] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.810153 13010 tablet_bootstrap.cc:492] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.810797 13010 ts_tablet_manager.cc:1403] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.015s
I20260709 12:23:58.812394 13016 raft_consensus.cc:359] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.813196 13016 raft_consensus.cc:385] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.813485 13016 raft_consensus.cc:740] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.814153 13010 raft_consensus.cc:359] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.814390 13016 consensus_queue.cc:260] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.814996 13010 raft_consensus.cc:385] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.815441 13010 raft_consensus.cc:740] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.816347 13010 consensus_queue.cc:260] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.819798 13016 ts_tablet_manager.cc:1434] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:23:58.820921 13016 tablet_bootstrap.cc:492] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.823315 13010 ts_tablet_manager.cc:1434] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:23:58.824077 13022 raft_consensus.cc:493] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.824609 13022 raft_consensus.cc:515] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.828676 13016 tablet_bootstrap.cc:654] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.835922 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:58.836966 12819 raft_consensus.cc:2468] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:23:58.839578 13022 leader_election.cc:290] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.840590 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:58.841594 12970 raft_consensus.cc:2468] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
W20260709 12:23:58.845860 12764 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:58.846892 12861 leader_election.cc:304] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:58.848201 13012 raft_consensus.cc:2804] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.849010 13012 raft_consensus.cc:493] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.849864 13012 raft_consensus.cc:3060] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.824608 13010 tablet_bootstrap.cc:492] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.863647 13016 tablet_bootstrap.cc:492] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:58.864279 13016 ts_tablet_manager.cc:1403] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.007s
I20260709 12:23:58.864172 13012 raft_consensus.cc:515] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.868403 13016 raft_consensus.cc:359] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.869305 13016 raft_consensus.cc:385] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.869681 13016 raft_consensus.cc:740] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.869417 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:58.870625 12819 raft_consensus.cc:3060] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.870838 13016 consensus_queue.cc:260] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.878716 13016 ts_tablet_manager.cc:1434] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:58.879890 13016 tablet_bootstrap.cc:492] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:58.883421 13015 tablet_bootstrap.cc:492] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:58.884086 13015 ts_tablet_manager.cc:1403] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.084s	user 0.046s	sys 0.030s
I20260709 12:23:58.884210 12819 raft_consensus.cc:2468] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:23:58.885737 12861 leader_election.cc:304] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:58.886884 13033 raft_consensus.cc:2804] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.889637 13010 tablet_bootstrap.cc:654] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.889043 13015 raft_consensus.cc:359] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.890281 13015 raft_consensus.cc:385] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.890734 13015 raft_consensus.cc:740] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.892009 13015 consensus_queue.cc:260] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.893514 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:58.894168 12970 raft_consensus.cc:3060] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.901073 13010 tablet_bootstrap.cc:492] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.902276 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:58.902983 12970 raft_consensus.cc:2468] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:23:58.903025 12895 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:58.903975 13012 leader_election.cc:290] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.906384 12784 leader_election.cc:304] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:58.907375 13022 raft_consensus.cc:2804] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.907778 13022 raft_consensus.cc:493] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.908138 13022 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.908448 13015 ts_tablet_manager.cc:1434] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:23:58.909849 13033 raft_consensus.cc:697] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:58.910513 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:58.911438 12970 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:58.910930 13033 consensus_queue.cc:237] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.901714 13010 ts_tablet_manager.cc:1403] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.014s
I20260709 12:23:58.887004 13016 tablet_bootstrap.cc:654] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.916250 13010 raft_consensus.cc:359] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.916420 13022 raft_consensus.cc:515] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.917101 13010 raft_consensus.cc:385] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.917451 13010 raft_consensus.cc:740] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.918291 13010 consensus_queue.cc:260] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.919276 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:58.919898 12895 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.920095 13015 tablet_bootstrap.cc:492] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:58.920676 13039 raft_consensus.cc:493] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.921259 13039 raft_consensus.cc:515] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.923627 13039 leader_election.cc:290] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.925015 13010 ts_tablet_manager.cc:1434] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:23:58.925514 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:58.926254 13010 tablet_bootstrap.cc:492] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:23:58.926308 12819 raft_consensus.cc:2468] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:23:58.928004 12861 leader_election.cc:304] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:58.928964 13039 raft_consensus.cc:2804] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.929131 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:58.929458 13039 raft_consensus.cc:493] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.929909 12969 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.930608 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:58.931391 12970 raft_consensus.cc:2468] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:23:58.928989 13015 tablet_bootstrap.cc:654] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.929939 13039 raft_consensus.cc:3060] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.933959 13010 tablet_bootstrap.cc:654] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:58.938822 13022 leader_election.cc:290] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.940335 12969 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:58.942281 12785 leader_election.cc:304] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:58.943660 13022 raft_consensus.cc:2804] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.945395 13033 raft_consensus.cc:493] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.946102 13033 raft_consensus.cc:515] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:58.946475 12895 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:58.952419 12713 catalog_manager.cc:5697] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.948321 13015 tablet_bootstrap.cc:492] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:58.957139 13015 ts_tablet_manager.cc:1403] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.010s
I20260709 12:23:58.958613 13039 raft_consensus.cc:515] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.960651 13015 raft_consensus.cc:359] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.961493 13015 raft_consensus.cc:385] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.961845 13015 raft_consensus.cc:740] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.962114 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:58.962765 12819 raft_consensus.cc:3060] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.963864 13033 leader_election.cc:290] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809), b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469)
I20260709 12:23:58.964787 13022 raft_consensus.cc:697] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:58.967917 13022 consensus_queue.cc:237] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.966966 13039 leader_election.cc:290] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:58.969141 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:58.969815 12969 raft_consensus.cc:2468] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:23:58.972771 12861 leader_election.cc:304] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:58.973232 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:58.973474 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:58.973726 13039 raft_consensus.cc:2804] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:58.974119 12969 raft_consensus.cc:3060] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.974207 13039 raft_consensus.cc:493] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.974713 13039 raft_consensus.cc:3060] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:58.974922 12861 leader_election.cc:343] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.975103 13010 tablet_bootstrap.cc:492] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:23:58.975818 13010 ts_tablet_manager.cc:1403] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.013s
I20260709 12:23:58.978761 13010 raft_consensus.cc:359] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.979784 13010 raft_consensus.cc:385] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:58.980134 13010 raft_consensus.cc:740] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:23:58.972191 13015 consensus_queue.cc:260] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.980986 13010 consensus_queue.cc:260] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.981923 12969 raft_consensus.cc:2468] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:23:58.983405 13010 ts_tablet_manager.cc:1434] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:58.983188 12861 leader_election.cc:304] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:58.984205 13033 raft_consensus.cc:2804] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:58.984697 13033 raft_consensus.cc:697] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:58.984819 12819 raft_consensus.cc:2468] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:23:58.985617 13033 consensus_queue.cc:237] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:58.986722 13039 raft_consensus.cc:515] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:58.995915 13039 leader_election.cc:290] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809), b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469)
I20260709 12:23:58.997524 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:58.997829 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:58.998528 12969 raft_consensus.cc:3060] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:58.998764 12714 catalog_manager.cc:5697] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:58.998783 12861 leader_election.cc:343] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:58.991060 13015 ts_tablet_manager.cc:1434] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.005s
I20260709 12:23:58.992657 13016 tablet_bootstrap.cc:492] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:59.003216 13016 ts_tablet_manager.cc:1403] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.005s
I20260709 12:23:59.006421 13016 raft_consensus.cc:359] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:59.007081 12969 raft_consensus.cc:2468] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:23:59.007206 13016 raft_consensus.cc:385] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.008318 13016 raft_consensus.cc:740] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.008973 12861 leader_election.cc:304] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:23:59.009132 13016 consensus_queue.cc:260] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:59.011256 13039 raft_consensus.cc:2804] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.011823 13016 ts_tablet_manager.cc:1434] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:23:59.012964 13033 raft_consensus.cc:493] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.013614 13033 raft_consensus.cc:515] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.015854 13015 tablet_bootstrap.cc:492] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:59.017612 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b57f9c807747bab426c65049fcf252" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:59.018330 12969 raft_consensus.cc:2468] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:23:59.018522 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b57f9c807747bab426c65049fcf252" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:59.019749 12861 leader_election.cc:304] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.020641 13012 raft_consensus.cc:2804] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:59.020774 12861 leader_election.cc:343] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.021108 13012 raft_consensus.cc:493] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.012387 13039 raft_consensus.cc:697] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:59.021581 13012 raft_consensus.cc:3060] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.022300 13039 consensus_queue.cc:237] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:59.015897 13033 leader_election.cc:290] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.012974 13016 tablet_bootstrap.cc:492] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:59.025723 13015 tablet_bootstrap.cc:654] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.030217 13012 raft_consensus.cc:515] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.034499 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b57f9c807747bab426c65049fcf252" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:59.035523 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b57f9c807747bab426c65049fcf252" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.036154 12969 raft_consensus.cc:3060] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:59.038754 12861 leader_election.cc:343] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:59.039420 13012 leader_election.cc:290] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.040045 13016 tablet_bootstrap.cc:654] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.043105 13015 tablet_bootstrap.cc:492] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:59.043663 13015 ts_tablet_manager.cc:1403] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 12:23:59.044646 12969 raft_consensus.cc:2468] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:23:59.046064 12861 leader_election.cc:304] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:23:59.046959 13015 raft_consensus.cc:359] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.047763 13012 raft_consensus.cc:2804] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.048367 13012 raft_consensus.cc:697] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:59.047796 13015 raft_consensus.cc:385] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.049572 13015 raft_consensus.cc:740] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.049258 13012 consensus_queue.cc:237] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.050251 13015 consensus_queue.cc:260] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.052546 13015 ts_tablet_manager.cc:1434] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:59.053617 13015 tablet_bootstrap.cc:492] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:59.059360 13016 tablet_bootstrap.cc:492] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:59.060211 13016 ts_tablet_manager.cc:1403] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.001s
I20260709 12:23:59.060611 13015 tablet_bootstrap.cc:654] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.064168 13016 raft_consensus.cc:359] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.065270 13016 raft_consensus.cc:385] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.065681 13016 raft_consensus.cc:740] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.066922 13016 consensus_queue.cc:260] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.071617 13016 ts_tablet_manager.cc:1434] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:23:59.071988 13022 raft_consensus.cc:493] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.072547 13022 raft_consensus.cc:515] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.079082 13022 leader_election.cc:290] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.080044 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:59.080826 12895 raft_consensus.cc:2468] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:59.081279 13016 tablet_bootstrap.cc:492] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:23:59.082903 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:59.083570 12784 leader_election.cc:304] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:59.082015 12714 catalog_manager.cc:5697] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.083622 12969 raft_consensus.cc:2468] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:59.085909 12714 catalog_manager.cc:5697] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.087960 13016 tablet_bootstrap.cc:654] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.087935 13022 raft_consensus.cc:2804] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.084551 13015 tablet_bootstrap.cc:492] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:59.088518 13022 raft_consensus.cc:493] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.091970 13015 ts_tablet_manager.cc:1403] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.007s
I20260709 12:23:59.094799 13015 raft_consensus.cc:359] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.095553 13015 raft_consensus.cc:385] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.095819 13015 raft_consensus.cc:740] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.096341 13016 tablet_bootstrap.cc:492] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:23:59.093660 13022 raft_consensus.cc:3060] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.096976 13016 ts_tablet_manager.cc:1403] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:23:59.096669 13015 consensus_queue.cc:260] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.101028 13016 raft_consensus.cc:359] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.101972 13016 raft_consensus.cc:385] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.102340 13016 raft_consensus.cc:740] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.103665 13015 ts_tablet_manager.cc:1434] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:59.103394 13016 consensus_queue.cc:260] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.104791 13015 tablet_bootstrap.cc:492] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:23:59.104588 13022 raft_consensus.cc:515] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.106612 13016 ts_tablet_manager.cc:1434] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:59.107570 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.108249 12895 raft_consensus.cc:3060] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.108593 13045 raft_consensus.cc:493] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.109470 13045 raft_consensus.cc:515] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.111534 13015 tablet_bootstrap.cc:654] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:59.114586 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b57f9c807747bab426c65049fcf252" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:59.115823 12969 raft_consensus.cc:2393] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate 4a58242bae09424e8951a4a882f57c39 in this term.
I20260709 12:23:59.117985 13045 leader_election.cc:290] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.118847 13045 raft_consensus.cc:493] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.119590 13045 raft_consensus.cc:515] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.125156 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:59.126214 12969 raft_consensus.cc:2468] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:59.127960 12785 leader_election.cc:304] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.129142 13045 leader_election.cc:290] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.129763 13045 raft_consensus.cc:2804] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.130193 13045 raft_consensus.cc:493] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.130640 13045 raft_consensus.cc:3060] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.140251 13045 raft_consensus.cc:515] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.140430 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b57f9c807747bab426c65049fcf252" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:59.142582 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:59.143754 12893 raft_consensus.cc:2468] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:59.144227 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.144834 12969 raft_consensus.cc:3060] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.147428 12784 leader_election.cc:304] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:23:59.148419 13057 raft_consensus.cc:3060] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.149832 12895 raft_consensus.cc:2468] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:59.150058 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.150883 12893 raft_consensus.cc:3060] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.146656 12715 catalog_manager.cc:5697] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.152964 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.153653 12970 raft_consensus.cc:3060] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.155735 12784 leader_election.cc:304] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:59.160303 12969 raft_consensus.cc:2468] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:59.164425 12785 leader_election.cc:304] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.161583 12970 raft_consensus.cc:2468] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:59.166174 13060 raft_consensus.cc:2804] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.162041 13022 leader_election.cc:290] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.162824 13057 raft_consensus.cc:2749] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.163117 13045 leader_election.cc:290] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.167117 13022 raft_consensus.cc:2804] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.168892 13022 raft_consensus.cc:697] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:59.169678 13022 consensus_queue.cc:237] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.170267 13015 tablet_bootstrap.cc:492] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:23:59.170987 13015 ts_tablet_manager.cc:1403] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.035s
I20260709 12:23:59.174008 13015 raft_consensus.cc:359] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.174690 13015 raft_consensus.cc:385] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:59.174952 13015 raft_consensus.cc:740] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:23:59.175789 13060 raft_consensus.cc:697] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:59.176090 13015 consensus_queue.cc:260] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.177340 12893 raft_consensus.cc:2468] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:59.177485 13060 consensus_queue.cc:237] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.180655 13015 ts_tablet_manager.cc:1434] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:59.187098 12715 catalog_manager.cc:5697] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.200246 12715 catalog_manager.cc:5697] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.222906 13060 raft_consensus.cc:493] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.223498 13060 raft_consensus.cc:515] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:59.225216 13060 leader_election.cc:290] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.226197 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:59.226338 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:59.227102 12969 raft_consensus.cc:2393] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate 4a58242bae09424e8951a4a882f57c39 in this term.
I20260709 12:23:59.228212 12785 leader_election.cc:304] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:23:59.228910 13060 raft_consensus.cc:3060] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.229698 13020 raft_consensus.cc:493] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.230206 13020 raft_consensus.cc:515] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.232522 13020 leader_election.cc:290] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:23:59.238458 13060 raft_consensus.cc:2749] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:59.239233 13022 raft_consensus.cc:493] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.239784 13022 raft_consensus.cc:515] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.241742 13022 leader_election.cc:290] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.242481 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:59.243212 12893 raft_consensus.cc:2468] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:59.243276 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:23:59.243973 12969 raft_consensus.cc:2468] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:23:59.244585 12784 leader_election.cc:304] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:59.245594 13022 raft_consensus.cc:2804] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.245965 13022 raft_consensus.cc:493] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.246325 13022 raft_consensus.cc:3060] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.249636 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:23:59.249863 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:23:59.250368 12819 raft_consensus.cc:2468] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 0.
I20260709 12:23:59.250584 12893 raft_consensus.cc:2468] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 0.
I20260709 12:23:59.251648 12936 leader_election.cc:304] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.252472 13020 raft_consensus.cc:2804] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:59.252889 13020 raft_consensus.cc:493] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.253201 13020 raft_consensus.cc:3060] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.254212 13022 raft_consensus.cc:515] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.256484 13022 leader_election.cc:290] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.256896 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.257151 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.257638 12893 raft_consensus.cc:3060] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.257736 12969 raft_consensus.cc:3060] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.260272 13020 raft_consensus.cc:515] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.262562 13020 leader_election.cc:290] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:23:59.263237 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:59.263593 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.263983 12819 raft_consensus.cc:3060] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.264276 12895 raft_consensus.cc:3060] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:59.265642 12969 raft_consensus.cc:2468] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:59.266851 12785 leader_election.cc:304] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.270166 12893 raft_consensus.cc:2468] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:23:59.271670 12819 raft_consensus.cc:2468] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 1.
I20260709 12:23:59.271895 13022 raft_consensus.cc:2804] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.271667 12895 raft_consensus.cc:2468] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 1.
I20260709 12:23:59.272619 13022 raft_consensus.cc:697] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:59.273151 12936 leader_election.cc:304] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.273478 13022 consensus_queue.cc:237] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.274046 13020 raft_consensus.cc:2804] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:59.275132 13020 raft_consensus.cc:697] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:23:59.276005 13020 consensus_queue.cc:237] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.282070 12715 catalog_manager.cc:5697] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.285012 12714 catalog_manager.cc:5697] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.371325 13012 consensus_queue.cc:1048] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.383123 13033 consensus_queue.cc:1048] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.413632 13033 consensus_queue.cc:1048] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.421773 13060 consensus_queue.cc:1048] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.425794 13022 consensus_queue.cc:1048] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.429342 13012 consensus_queue.cc:1048] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:59.481225 13039 consensus_queue.cc:1048] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.493199 13033 consensus_queue.cc:1048] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.494411 12895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:23:59.495162 12895 raft_consensus.cc:606] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:23:59.502031 12895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:23:59.502707 12895 raft_consensus.cc:606] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:23:59.512697 12895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:23:59.513258 12895 raft_consensus.cc:606] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:23:59.515803 13033 consensus_queue.cc:1048] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.529758 12819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
mode: GRACEFUL
new_leader_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:39548
I20260709 12:23:59.530413 12819 raft_consensus.cc:606] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Received request to transfer leadership to TS 4a58242bae09424e8951a4a882f57c39
I20260709 12:23:59.534871 13012 consensus_queue.cc:1048] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.544209 13012 raft_consensus.cc:993] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:23:59.544759 13012 raft_consensus.cc:1081] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:23:59.547564 12819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:23:59.548223 12819 raft_consensus.cc:493] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.548604 12819 raft_consensus.cc:3060] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.552513 12969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
mode: GRACEFUL
new_leader_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:40728
I20260709 12:23:59.553151 12969 raft_consensus.cc:606] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Received request to transfer leadership to TS 4a58242bae09424e8951a4a882f57c39
I20260709 12:23:59.555095 12819 raft_consensus.cc:515] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.557669 12819 leader_election.cc:290] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.558573 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.558808 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f320dc5ffca54822a8b937396332dbc6" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.559444 12969 raft_consensus.cc:3060] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.559156 12895 raft_consensus.cc:3055] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.560173 12895 raft_consensus.cc:740] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:59.561012 12895 consensus_queue.cc:260] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.562189 12895 raft_consensus.cc:3060] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.562376 12819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
mode: GRACEFUL
new_leader_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:39548
I20260709 12:23:59.562971 12819 raft_consensus.cc:606] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Received request to transfer leadership to TS 4a58242bae09424e8951a4a882f57c39
I20260709 12:23:59.567255 12969 raft_consensus.cc:2468] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:23:59.568563 12785 leader_election.cc:304] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.569382 13022 raft_consensus.cc:2804] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.569252 12819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
mode: GRACEFUL
new_leader_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:39548
I20260709 12:23:59.569696 12895 raft_consensus.cc:2468] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:23:59.569988 13022 raft_consensus.cc:697] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:59.570055 12819 raft_consensus.cc:606] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Received request to transfer leadership to TS fc9b5699a29143a1b83240426cb8f202
I20260709 12:23:59.571023 13022 consensus_queue.cc:237] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.577759 12714 catalog_manager.cc:5697] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.696972 13022 consensus_queue.cc:1048] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.705099 13022 consensus_queue.cc:1048] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.763571 13022 consensus_queue.cc:1048] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.775044 13022 consensus_queue.cc:1048] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.786413 13060 consensus_queue.cc:1048] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.789343 13020 consensus_queue.cc:1048] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.797657 13060 raft_consensus.cc:993] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: : Instructing follower fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:23:59.798625 13061 raft_consensus.cc:1081] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Signalling peer fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:23:59.800276 13061 consensus_queue.cc:1048] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.804773 12970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:40720
I20260709 12:23:59.805716 12970 raft_consensus.cc:493] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.806211 12970 raft_consensus.cc:3060] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.813920 13059 raft_consensus.cc:993] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: : Instructing follower 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:23:59.814652 13059 raft_consensus.cc:1081] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Signalling peer 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:23:59.817181 12893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:51958
I20260709 12:23:59.818213 12893 raft_consensus.cc:493] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.818885 12893 raft_consensus.cc:3060] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.828663 12970 raft_consensus.cc:515] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.833515 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:59.834559 12819 raft_consensus.cc:3055] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.834978 12819 raft_consensus.cc:740] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:59.836301 12819 consensus_queue.cc:260] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.836643 12893 raft_consensus.cc:515] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.837730 12819 raft_consensus.cc:3060] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.841900 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6846b79d30024ea8837b42836e2fd819" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.842703 12894 raft_consensus.cc:3060] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.844511 12895 raft_consensus.cc:1240] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Rejecting Update request from peer b5da228e99e1425cb4b8e6ea09d9a3c1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:59.849032 12819 raft_consensus.cc:2468] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 2.
I20260709 12:23:59.857419 12936 leader_election.cc:304] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.858455 13020 raft_consensus.cc:2804] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.858201 13022 consensus_queue.cc:1059] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:59.859475 13022 raft_consensus.cc:3055] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.859906 13022 raft_consensus.cc:740] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:23:59.860383 12894 raft_consensus.cc:2468] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 2.
I20260709 12:23:59.860725 13020 raft_consensus.cc:697] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 2 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:23:59.861461 13022 consensus_queue.cc:260] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.863725 13022 raft_consensus.cc:3060] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.853760 12970 leader_election.cc:290] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:23:59.881718 13020 consensus_queue.cc:237] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.885878 13020 consensus_queue.cc:1048] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:59.886230 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:59.890713 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4494b1fc744048f2b08edbe9ef5b9d27" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.892117 12893 leader_election.cc:290] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.891472 12970 raft_consensus.cc:3060] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.907351 12970 raft_consensus.cc:2468] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:23:59.909065 12861 leader_election.cc:304] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.910179 13012 raft_consensus.cc:2804] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.910830 13012 raft_consensus.cc:697] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:59.910220 12714 catalog_manager.cc:5697] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 1 to 2, leader changed from b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129) to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.911950 12818 raft_consensus.cc:2468] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:23:59.911909 13012 consensus_queue.cc:237] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.921244 13096 raft_consensus.cc:993] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: : Instructing follower 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:23:59.921841 13096 raft_consensus.cc:1081] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Signalling peer 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:23:59.923986 12895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:51966
I20260709 12:23:59.924660 12895 raft_consensus.cc:493] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.925137 12895 raft_consensus.cc:3060] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.934752 12895 raft_consensus.cc:515] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.936702 12895 leader_election.cc:290] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.937764 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:23:59.938521 12818 raft_consensus.cc:3060] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.938452 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d61f30a9975498da59dc45ffe62993a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.939359 12970 raft_consensus.cc:3055] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.939677 12970 raft_consensus.cc:740] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:23:59.940526 12970 consensus_queue.cc:260] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.941696 12970 raft_consensus.cc:3060] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.941511 12714 catalog_manager.cc:5697] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 1 to 2, leader changed from b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129) to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.946625 12818 raft_consensus.cc:2468] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:23:59.949975 12970 raft_consensus.cc:2468] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:23:59.951181 12861 leader_election.cc:304] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:23:59.952039 13012 raft_consensus.cc:2804] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.952522 13012 raft_consensus.cc:697] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:59.953513 13012 consensus_queue.cc:237] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:23:59.959908 12714 catalog_manager.cc:5697] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 1 to 2, leader changed from fc9b5699a29143a1b83240426cb8f202 (127.3.7.131) to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.972114 13033 raft_consensus.cc:993] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:23:59.972606 13012 raft_consensus.cc:1081] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:23:59.974355 12818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:23:59.975072 12818 raft_consensus.cc:493] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.975530 12818 raft_consensus.cc:3060] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.981339 12818 raft_consensus.cc:515] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:59.984031 12818 leader_election.cc:290] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:23:59.984150 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:23:59.984860 12895 raft_consensus.cc:3055] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.985208 12895 raft_consensus.cc:740] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:23:59.985918 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d486d0e245e4a42a94cbe1aa4f8df56" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:23:59.986606 12970 raft_consensus.cc:3060] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.986171 12895 consensus_queue.cc:260] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:23:59.987773 12895 raft_consensus.cc:3060] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.991405 13039 raft_consensus.cc:993] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:23:59.991981 13039 raft_consensus.cc:1081] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:23:59.993963 12818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:23:59.994635 12818 raft_consensus.cc:493] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.995119 12818 raft_consensus.cc:3060] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.996047 12895 raft_consensus.cc:2468] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:23:59.996531 12970 raft_consensus.cc:2468] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:23:59.998574 12785 leader_election.cc:304] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:23:59.999764 13022 raft_consensus.cc:2804] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.000262 13022 raft_consensus.cc:697] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:00.001998 13022 consensus_queue.cc:237] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } }
I20260709 12:24:00.006418 12818 raft_consensus.cc:515] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:00.008785 12818 leader_election.cc:290] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:00.009707 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:00.010552 12895 raft_consensus.cc:3055] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.010372 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b8c17a33ce463e8d0e8558aa32bd07" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:00.010924 12895 raft_consensus.cc:740] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:00.011144 12970 raft_consensus.cc:3060] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.011225 12714 catalog_manager.cc:5697] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.011970 12895 consensus_queue.cc:260] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:00.013542 12895 raft_consensus.cc:3060] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.020035 12970 raft_consensus.cc:2468] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:00.021410 12785 leader_election.cc:304] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:00.021827 12895 raft_consensus.cc:2468] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:00.022418 13022 raft_consensus.cc:2804] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.022926 13022 raft_consensus.cc:697] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:00.024060 13022 consensus_queue.cc:237] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:00.031044 12714 catalog_manager.cc:5697] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.056641 13059 raft_consensus.cc:993] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: : Instructing follower 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:00.057200 13059 raft_consensus.cc:1081] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Signalling peer 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:00.058851 12895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:51958
I20260709 12:24:00.059603 12895 raft_consensus.cc:493] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.060017 12895 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.067379 12895 raft_consensus.cc:515] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:00.069375 12895 leader_election.cc:290] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:00.070403 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:00.070600 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:00.071339 12818 raft_consensus.cc:3055] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.071354 12970 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.071889 12818 raft_consensus.cc:740] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:00.072918 12818 consensus_queue.cc:260] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:00.074410 12818 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.080341 12970 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:00.081722 12861 leader_election.cc:304] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:00.081940 12818 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:00.082567 13012 raft_consensus.cc:2804] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.083112 13012 raft_consensus.cc:697] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:00.084067 13012 consensus_queue.cc:237] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:00.090816 12714 catalog_manager.cc:5697] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 1 to 2, leader changed from b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129) to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.125715 12895 raft_consensus.cc:1275] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.127051 13059 consensus_queue.cc:1048] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.136777 12970 raft_consensus.cc:1275] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.138394 13022 consensus_queue.cc:1048] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.331781 12895 raft_consensus.cc:1275] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.333273 13095 consensus_queue.cc:1048] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.337265 12818 raft_consensus.cc:1275] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.342442 13012 consensus_queue.cc:1048] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.342427 12818 raft_consensus.cc:1275] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.346692 13094 consensus_queue.cc:1048] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.354274 12970 raft_consensus.cc:1275] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.355661 12819 raft_consensus.cc:1275] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.356709 13012 consensus_queue.cc:1048] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.359440 13012 consensus_queue.cc:1048] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.370693 12969 raft_consensus.cc:1275] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.372825 13033 consensus_queue.cc:1048] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.470674 12970 raft_consensus.cc:1275] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.471972 13060 consensus_queue.cc:1048] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.481208 12895 raft_consensus.cc:1275] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.483049 13061 consensus_queue.cc:1048] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.550841 12895 raft_consensus.cc:1275] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.552147 13061 consensus_queue.cc:1048] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.561757 12970 raft_consensus.cc:1275] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.563585 13059 consensus_queue.cc:1048] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.638106 12970 raft_consensus.cc:1275] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.639911 13098 consensus_queue.cc:1048] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.651247 12818 raft_consensus.cc:1275] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.652949 13033 consensus_queue.cc:1048] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.614806 12715 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46010:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:02.618065 12715 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:02.675145 12803 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9c37202fca40e495a6cd4326f582ca (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:02.678155 12803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c37202fca40e495a6cd4326f582ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.678586 12955 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9c37202fca40e495a6cd4326f582ca (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:02.678750 12882 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9c37202fca40e495a6cd4326f582ca (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:02.680176 12955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c37202fca40e495a6cd4326f582ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.680522 12882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c37202fca40e495a6cd4326f582ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.690322 12802 tablet_service.cc:1511] Processing CreateTablet for tablet a6c38caf5131423a82e9141024b19710 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:02.692126 12802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c38caf5131423a82e9141024b19710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.694654 12952 tablet_service.cc:1511] Processing CreateTablet for tablet a6c38caf5131423a82e9141024b19710 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:02.696261 12952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c38caf5131423a82e9141024b19710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.697588 12881 tablet_service.cc:1511] Processing CreateTablet for tablet 8541f3eb0725493ea3d2c3b19d41ef15 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:02.692147 12883 tablet_service.cc:1511] Processing CreateTablet for tablet a6c38caf5131423a82e9141024b19710 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:02.699213 12881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8541f3eb0725493ea3d2c3b19d41ef15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.700179 12883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6c38caf5131423a82e9141024b19710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.701969 12809 tablet_service.cc:1511] Processing CreateTablet for tablet 8541f3eb0725493ea3d2c3b19d41ef15 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:02.703614 12809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8541f3eb0725493ea3d2c3b19d41ef15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.713608 12953 tablet_service.cc:1511] Processing CreateTablet for tablet 8541f3eb0725493ea3d2c3b19d41ef15 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:02.714545 12801 tablet_service.cc:1511] Processing CreateTablet for tablet f56b835953274bf68a8a7d3e101b7c36 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:02.715322 12953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8541f3eb0725493ea3d2c3b19d41ef15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.716009 12801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56b835953274bf68a8a7d3e101b7c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.715975 12879 tablet_service.cc:1511] Processing CreateTablet for tablet f56b835953274bf68a8a7d3e101b7c36 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:02.717311 12879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56b835953274bf68a8a7d3e101b7c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.745590 12958 tablet_service.cc:1511] Processing CreateTablet for tablet f56b835953274bf68a8a7d3e101b7c36 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:02.748917 12808 tablet_service.cc:1511] Processing CreateTablet for tablet ce9c75b98e2046119cf4287e09c42ed9 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:02.750598 12808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9c75b98e2046119cf4287e09c42ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.752803 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56b835953274bf68a8a7d3e101b7c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.754784 13121 tablet_bootstrap.cc:492] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:02.777361 12882 tablet_service.cc:1511] Processing CreateTablet for tablet ce9c75b98e2046119cf4287e09c42ed9 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:02.779717 12882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9c75b98e2046119cf4287e09c42ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.779435 12953 tablet_service.cc:1511] Processing CreateTablet for tablet ce9c75b98e2046119cf4287e09c42ed9 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:02.780855 12953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9c75b98e2046119cf4287e09c42ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.783771 13120 tablet_bootstrap.cc:492] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:02.789961 13121 tablet_bootstrap.cc:654] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.790885 12804 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6a1d33bc74414c9010665a9ea984e8 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:02.792445 12804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a1d33bc74414c9010665a9ea984e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.812837 13120 tablet_bootstrap.cc:654] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.820338 12881 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6a1d33bc74414c9010665a9ea984e8 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:02.821910 12881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a1d33bc74414c9010665a9ea984e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.837462 12958 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6a1d33bc74414c9010665a9ea984e8 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:02.839006 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6a1d33bc74414c9010665a9ea984e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.849112 13122 tablet_bootstrap.cc:492] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:02.851133 13121 tablet_bootstrap.cc:492] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:02.852029 13121 ts_tablet_manager.cc:1403] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.098s	user 0.005s	sys 0.019s
I20260709 12:24:02.857811 13121 raft_consensus.cc:359] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.858871 13121 raft_consensus.cc:385] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.859323 13121 raft_consensus.cc:740] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.862454 12808 tablet_service.cc:1511] Processing CreateTablet for tablet e4969452f1e349e2a203ef6a322b1ba7 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:02.862445 13121 consensus_queue.cc:260] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.864241 12808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4969452f1e349e2a203ef6a322b1ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.863682 12952 tablet_service.cc:1511] Processing CreateTablet for tablet e4969452f1e349e2a203ef6a322b1ba7 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:02.883388 12952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4969452f1e349e2a203ef6a322b1ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.884409 13120 tablet_bootstrap.cc:492] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:02.886312 13120 ts_tablet_manager.cc:1403] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.033s
I20260709 12:24:02.887390 12803 tablet_service.cc:1511] Processing CreateTablet for tablet 619587c4a4d94ab09bc3d84e4866139a (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:02.888769 12803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619587c4a4d94ab09bc3d84e4866139a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.880533 12882 tablet_service.cc:1511] Processing CreateTablet for tablet e4969452f1e349e2a203ef6a322b1ba7 (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:02.889642 13120 raft_consensus.cc:359] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.885231 13121 ts_tablet_manager.cc:1434] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 12:24:02.893950 12958 tablet_service.cc:1511] Processing CreateTablet for tablet 619587c4a4d94ab09bc3d84e4866139a (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:02.895999 13121 tablet_bootstrap.cc:492] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:02.893994 12881 tablet_service.cc:1511] Processing CreateTablet for tablet 619587c4a4d94ab09bc3d84e4866139a (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:02.899245 12881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619587c4a4d94ab09bc3d84e4866139a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.903716 13121 tablet_bootstrap.cc:654] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.906077 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619587c4a4d94ab09bc3d84e4866139a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.907008 13120 raft_consensus.cc:385] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.907411 13120 raft_consensus.cc:740] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.908185 13120 consensus_queue.cc:260] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.910820 13120 ts_tablet_manager.cc:1434] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:24:02.911859 13120 tablet_bootstrap.cc:492] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:02.915813 12882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4969452f1e349e2a203ef6a322b1ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.918711 13120 tablet_bootstrap.cc:654] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.896482 13122 tablet_bootstrap.cc:654] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.940363 13120 tablet_bootstrap.cc:492] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:02.940938 13120 ts_tablet_manager.cc:1403] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.003s
W20260709 12:24:02.944077 12764 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:02.944836 13120 raft_consensus.cc:359] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.945652 13120 raft_consensus.cc:385] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.946100 12808 tablet_service.cc:1511] Processing CreateTablet for tablet 8101dd02596e4702ad71d54ee0c4397c (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:02.948073 12808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8101dd02596e4702ad71d54ee0c4397c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.957625 13121 tablet_bootstrap.cc:492] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:02.958185 13121 ts_tablet_manager.cc:1403] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.021s
I20260709 12:24:02.945953 13120 raft_consensus.cc:740] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.950078 12881 tablet_service.cc:1511] Processing CreateTablet for tablet 8101dd02596e4702ad71d54ee0c4397c (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:02.952927 12958 tablet_service.cc:1511] Processing CreateTablet for tablet 8101dd02596e4702ad71d54ee0c4397c (DEFAULT_TABLE table=soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:02.960489 12881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8101dd02596e4702ad71d54ee0c4397c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.960489 12958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8101dd02596e4702ad71d54ee0c4397c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.960394 13120 consensus_queue.cc:260] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.963214 13120 ts_tablet_manager.cc:1434] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:24:02.964231 13120 tablet_bootstrap.cc:492] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:02.966027 13122 tablet_bootstrap.cc:492] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:02.966976 13122 ts_tablet_manager.cc:1403] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.004s
I20260709 12:24:02.970748 13122 raft_consensus.cc:359] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.971557 13122 raft_consensus.cc:385] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.971989 13122 raft_consensus.cc:740] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.973263 13121 raft_consensus.cc:359] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.974082 13121 raft_consensus.cc:385] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.974295 13120 tablet_bootstrap.cc:654] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:02.974398 13121 raft_consensus.cc:740] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.975450 13121 consensus_queue.cc:260] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.987027 13121 ts_tablet_manager.cc:1434] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:24:02.987560 13120 tablet_bootstrap.cc:492] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:02.991039 13120 ts_tablet_manager.cc:1403] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 12:24:02.988354 13121 tablet_bootstrap.cc:492] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:02.994573 13039 raft_consensus.cc:493] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.994357 13120 raft_consensus.cc:359] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.995173 13120 raft_consensus.cc:385] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:02.995148 13039 raft_consensus.cc:515] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.995796 13120 raft_consensus.cc:740] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:02.996838 13120 consensus_queue.cc:260] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.997598 13039 leader_election.cc:290] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:02.988821 13122 consensus_queue.cc:260] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:02.998857 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:02.999502 13120 ts_tablet_manager.cc:1434] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:03.000849 13120 tablet_bootstrap.cc:492] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
W20260709 12:24:03.000768 12861 leader_election.cc:343] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.001749 13122 ts_tablet_manager.cc:1434] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:24:03.003105 13121 tablet_bootstrap.cc:654] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.003798 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.004518 12969 raft_consensus.cc:2468] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.006166 12861 leader_election.cc:304] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.007079 13039 raft_consensus.cc:2804] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.007320 13122 tablet_bootstrap.cc:492] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.007512 13039 raft_consensus.cc:493] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.007931 13039 raft_consensus.cc:3060] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.008991 13120 tablet_bootstrap.cc:654] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.015875 13122 tablet_bootstrap.cc:654] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.017199 13039 raft_consensus.cc:515] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.020195 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
W20260709 12:24:03.021906 12861 leader_election.cc:343] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.023918 13039 leader_election.cc:290] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.025579 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.026414 12969 raft_consensus.cc:3060] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.027937 13120 tablet_bootstrap.cc:492] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:03.028684 13120 ts_tablet_manager.cc:1403] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 12:24:03.029767 13121 tablet_bootstrap.cc:492] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:03.030323 13121 ts_tablet_manager.cc:1403] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.003s
I20260709 12:24:03.032965 13120 raft_consensus.cc:359] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.033820 13120 raft_consensus.cc:385] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.033725 13121 raft_consensus.cc:359] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.034227 13120 raft_consensus.cc:740] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.034577 13121 raft_consensus.cc:385] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.034888 13121 raft_consensus.cc:740] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.035061 13120 consensus_queue.cc:260] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.037439 13120 ts_tablet_manager.cc:1434] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:03.038496 13120 tablet_bootstrap.cc:492] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:03.038419 13121 consensus_queue.cc:260] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.039119 13039 raft_consensus.cc:493] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.039695 13039 raft_consensus.cc:515] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.041823 13039 leader_election.cc:290] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.043047 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:03.043823 12818 raft_consensus.cc:2468] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.045707 13121 ts_tablet_manager.cc:1434] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:24:03.045509 12861 leader_election.cc:304] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.046408 13120 tablet_bootstrap.cc:654] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.045478 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.047124 13121 tablet_bootstrap.cc:492] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:03.047679 13039 raft_consensus.cc:2804] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.048125 13039 raft_consensus.cc:493] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.048868 13039 raft_consensus.cc:3060] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.047250 12970 raft_consensus.cc:2468] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.060000 13120 tablet_bootstrap.cc:492] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:03.060665 13120 ts_tablet_manager.cc:1403] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:24:03.061623 13121 tablet_bootstrap.cc:654] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.066008 13122 tablet_bootstrap.cc:492] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.066731 13122 ts_tablet_manager.cc:1403] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.005s
I20260709 12:24:03.069161 13120 raft_consensus.cc:359] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.070084 13120 raft_consensus.cc:385] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.070451 13120 raft_consensus.cc:740] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.071379 13122 raft_consensus.cc:359] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.072185 13122 raft_consensus.cc:385] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.072480 13122 raft_consensus.cc:740] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.073233 13122 consensus_queue.cc:260] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.076750 13122 ts_tablet_manager.cc:1434] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:24:03.077339 13120 consensus_queue.cc:260] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.079982 13120 ts_tablet_manager.cc:1434] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 12:24:03.080865 12969 raft_consensus.cc:2468] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.081050 13120 tablet_bootstrap.cc:492] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:03.084667 13122 tablet_bootstrap.cc:492] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.085428 12861 leader_election.cc:304] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.086745 13108 raft_consensus.cc:2804] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.088833 13120 tablet_bootstrap.cc:654] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.091935 13108 raft_consensus.cc:697] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.093039 13108 consensus_queue.cc:237] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.098279 13121 tablet_bootstrap.cc:492] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:03.099547 13121 ts_tablet_manager.cc:1403] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.004s
I20260709 12:24:03.098726 13039 raft_consensus.cc:515] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.105808 13122 tablet_bootstrap.cc:654] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.108048 13121 raft_consensus.cc:359] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.108938 13121 raft_consensus.cc:385] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.109236 13121 raft_consensus.cc:740] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.103610 13120 tablet_bootstrap.cc:492] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:03.110280 13120 ts_tablet_manager.cc:1403] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
I20260709 12:24:03.110083 13121 consensus_queue.cc:260] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.111203 13039 leader_election.cc:290] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.112015 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:03.112803 12818 raft_consensus.cc:3060] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.114181 13121 ts_tablet_manager.cc:1434] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:24:03.115447 13121 tablet_bootstrap.cc:492] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:03.122766 12818 raft_consensus.cc:2468] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.122251 12714 catalog_manager.cc:5697] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.124235 12861 leader_election.cc:304] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.124348 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.124969 12969 raft_consensus.cc:3060] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.125125 13121 tablet_bootstrap.cc:654] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.129287 13122 tablet_bootstrap.cc:492] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.129835 13122 ts_tablet_manager.cc:1403] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.006s
I20260709 12:24:03.115428 13120 raft_consensus.cc:359] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.130582 13120 raft_consensus.cc:385] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.130929 13120 raft_consensus.cc:740] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.131790 13120 consensus_queue.cc:260] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.134722 13120 ts_tablet_manager.cc:1434] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260709 12:24:03.138073 12969 raft_consensus.cc:2468] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.139325 13121 tablet_bootstrap.cc:492] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:03.139830 13120 tablet_bootstrap.cc:492] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:03.139935 13121 ts_tablet_manager.cc:1403] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 12:24:03.139506 13122 raft_consensus.cc:359] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.142251 13122 raft_consensus.cc:385] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.142223 13039 raft_consensus.cc:493] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.142979 13039 raft_consensus.cc:515] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.145473 13039 leader_election.cc:290] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.146306 13122 raft_consensus.cc:740] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.144621 13121 raft_consensus.cc:359] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.147728 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c38caf5131423a82e9141024b19710" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:03.147495 13122 consensus_queue.cc:260] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.148304 13121 raft_consensus.cc:385] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.148730 12818 raft_consensus.cc:2468] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.148707 13121 raft_consensus.cc:740] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.149902 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c38caf5131423a82e9141024b19710" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.150655 12969 raft_consensus.cc:2468] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.150738 13121 consensus_queue.cc:260] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.152000 13122 ts_tablet_manager.cc:1434] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:24:03.153229 13122 tablet_bootstrap.cc:492] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.154031 13121 ts_tablet_manager.cc:1434] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:24:03.155287 13121 tablet_bootstrap.cc:492] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:03.152484 12861 leader_election.cc:304] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.160013 13039 raft_consensus.cc:2804] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.160513 13039 raft_consensus.cc:493] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.161053 13039 raft_consensus.cc:3060] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.162925 13122 tablet_bootstrap.cc:654] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.162925 13121 tablet_bootstrap.cc:654] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.125223 13108 raft_consensus.cc:2804] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.166302 13108 raft_consensus.cc:697] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.167243 13108 consensus_queue.cc:237] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.173363 13022 raft_consensus.cc:493] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.173957 13121 tablet_bootstrap.cc:492] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:03.173956 13022 raft_consensus.cc:515] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.174618 13121 ts_tablet_manager.cc:1403] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:24:03.149513 13120 tablet_bootstrap.cc:654] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.176005 13022 leader_election.cc:290] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.177003 13039 raft_consensus.cc:515] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.178242 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.178678 13121 raft_consensus.cc:359] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.179421 13121 raft_consensus.cc:385] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.179683 13121 raft_consensus.cc:740] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.180408 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.180543 13121 consensus_queue.cc:260] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.182097 12969 raft_consensus.cc:2393] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate 4a58242bae09424e8951a4a882f57c39 in this term.
I20260709 12:24:03.183933 12785 leader_election.cc:304] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:03.187134 13121 ts_tablet_manager.cc:1434] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:24:03.186937 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c38caf5131423a82e9141024b19710" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:03.188155 12818 raft_consensus.cc:3060] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.188512 13121 tablet_bootstrap.cc:492] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:03.195940 13022 raft_consensus.cc:3060] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.202451 12818 raft_consensus.cc:2468] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.203855 13039 leader_election.cc:290] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.204851 12861 leader_election.cc:304] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.205857 13039 raft_consensus.cc:2804] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.205847 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c38caf5131423a82e9141024b19710" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.206692 12969 raft_consensus.cc:3060] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.206815 13039 raft_consensus.cc:697] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.208185 13121 tablet_bootstrap.cc:654] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.207916 13039 consensus_queue.cc:237] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.209061 13108 raft_consensus.cc:493] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.209756 13108 raft_consensus.cc:515] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.212560 13108 leader_election.cc:290] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.214766 12969 raft_consensus.cc:2468] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.206072 13120 tablet_bootstrap.cc:492] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:03.215672 13120 ts_tablet_manager.cc:1403] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.014s
I20260709 12:24:03.215922 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c75b98e2046119cf4287e09c42ed9" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
W20260709 12:24:03.218219 12861 leader_election.cc:343] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.215746 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c75b98e2046119cf4287e09c42ed9" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.219659 12970 raft_consensus.cc:2468] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.219246 13120 raft_consensus.cc:359] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.220629 13120 raft_consensus.cc:385] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.221293 13120 raft_consensus.cc:740] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.220606 13108 raft_consensus.cc:493] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.221632 12861 leader_election.cc:304] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.222187 13120 consensus_queue.cc:260] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.222229 13108 raft_consensus.cc:515] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.223549 13134 raft_consensus.cc:2804] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.224190 13134 raft_consensus.cc:493] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.224691 13134 raft_consensus.cc:3060] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.225114 13120 ts_tablet_manager.cc:1434] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:03.226539 13120 tablet_bootstrap.cc:492] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:03.222561 12714 catalog_manager.cc:5697] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.229596 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
W20260709 12:24:03.231573 12861 leader_election.cc:343] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.232048 13108 leader_election.cc:290] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.233371 13122 tablet_bootstrap.cc:492] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.234078 13122 ts_tablet_manager.cc:1403] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.003s
I20260709 12:24:03.233956 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.234778 12969 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 0.
I20260709 12:24:03.239197 13022 raft_consensus.cc:2749] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.242956 12861 leader_election.cc:304] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.245566 13121 tablet_bootstrap.cc:492] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:03.246222 13121 ts_tablet_manager.cc:1403] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.007s
I20260709 12:24:03.249933 13108 raft_consensus.cc:2804] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.249665 13121 raft_consensus.cc:359] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.250458 13108 raft_consensus.cc:493] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.250614 13121 raft_consensus.cc:385] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.250931 13108 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.251010 13121 raft_consensus.cc:740] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.255163 13134 raft_consensus.cc:515] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.258787 13120 tablet_bootstrap.cc:654] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.253089 13121 consensus_queue.cc:260] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.259325 13134 leader_election.cc:290] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.261512 13121 ts_tablet_manager.cc:1434] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:24:03.261361 13108 raft_consensus.cc:515] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.262593 13122 raft_consensus.cc:359] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.263079 13121 tablet_bootstrap.cc:492] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:03.263414 13122 raft_consensus.cc:385] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.263739 13122 raft_consensus.cc:740] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.264552 13122 consensus_queue.cc:260] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.265208 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c75b98e2046119cf4287e09c42ed9" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
W20260709 12:24:03.267190 12861 leader_election.cc:343] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.268792 13108 leader_election.cc:290] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.271908 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:03.272665 12818 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.274292 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.274972 13108 raft_consensus.cc:493] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.275336 13121 tablet_bootstrap.cc:654] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.269387 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c75b98e2046119cf4287e09c42ed9" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.275781 13108 raft_consensus.cc:515] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.276433 12969 raft_consensus.cc:3060] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.278162 12715 catalog_manager.cc:5697] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.279474 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:03.275041 12970 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:03.281349 12861 leader_election.cc:343] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.284276 12968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.285645 12969 raft_consensus.cc:2468] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
W20260709 12:24:03.286335 12861 leader_election.cc:343] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.287020 12861 leader_election.cc:304] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:03.288254 13144 raft_consensus.cc:2749] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.293341 12970 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.296413 13120 tablet_bootstrap.cc:492] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:03.296190 12818 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 1.
I20260709 12:24:03.297020 13120 ts_tablet_manager.cc:1403] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.004s
I20260709 12:24:03.301158 13122 ts_tablet_manager.cc:1434] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.067s	user 0.013s	sys 0.008s
I20260709 12:24:03.300827 13120 raft_consensus.cc:359] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.301703 13120 raft_consensus.cc:385] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.302135 13120 raft_consensus.cc:740] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.302237 13107 raft_consensus.cc:493] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.302973 13107 raft_consensus.cc:515] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.303185 13120 consensus_queue.cc:260] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.306713 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.307083 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:03.307507 12893 raft_consensus.cc:2468] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 0.
I20260709 12:24:03.308291 13121 tablet_bootstrap.cc:492] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
W20260709 12:24:03.308578 12936 leader_election.cc:343] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.308820 13121 ts_tablet_manager.cc:1403] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.008s
I20260709 12:24:03.306731 13107 leader_election.cc:290] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:03.309839 12935 leader_election.cc:304] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.312561 13121 raft_consensus.cc:359] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.313596 13121 raft_consensus.cc:385] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.313951 13121 raft_consensus.cc:740] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.313812 12861 leader_election.cc:304] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.317493 13039 raft_consensus.cc:2804] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.317344 13121 consensus_queue.cc:260] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.318008 13039 raft_consensus.cc:697] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.319428 12861 leader_election.cc:304] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:03.314116 13108 leader_election.cc:290] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.319772 13121 ts_tablet_manager.cc:1434] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:24:03.320680 13144 raft_consensus.cc:2804] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.321168 13144 raft_consensus.cc:697] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.321538 13122 tablet_bootstrap.cc:492] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.321594 13121 tablet_bootstrap.cc:492] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: Bootstrap starting.
I20260709 12:24:03.322031 13144 consensus_queue.cc:237] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.318889 13039 consensus_queue.cc:237] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.328693 13121 tablet_bootstrap.cc:654] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.328872 13122 tablet_bootstrap.cc:654] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.330940 13120 ts_tablet_manager.cc:1434] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.012s
I20260709 12:24:03.331640 13150 raft_consensus.cc:2804] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.332224 13120 tablet_bootstrap.cc:492] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: Bootstrap starting.
I20260709 12:24:03.332190 13150 raft_consensus.cc:493] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.332643 13150 raft_consensus.cc:3060] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.340533 12712 catalog_manager.cc:5697] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.341773 13150 raft_consensus.cc:515] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.348021 13150 leader_election.cc:290] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:03.348819 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
W20260709 12:24:03.350392 12936 leader_election.cc:343] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.350651 13121 tablet_bootstrap.cc:492] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: No bootstrap required, opened a new log
I20260709 12:24:03.351176 13121 ts_tablet_manager.cc:1403] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.005s
I20260709 12:24:03.352304 13120 tablet_bootstrap.cc:654] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.354139 13121 raft_consensus.cc:359] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.354869 13121 raft_consensus.cc:385] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.355212 13121 raft_consensus.cc:740] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.357270 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.358103 12893 raft_consensus.cc:3060] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.356216 13121 consensus_queue.cc:260] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.372504 13121 ts_tablet_manager.cc:1434] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:24:03.369599 12893 raft_consensus.cc:2468] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 1.
I20260709 12:24:03.375152 12935 leader_election.cc:304] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.375946 12715 catalog_manager.cc:5697] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.376994 13120 tablet_bootstrap.cc:492] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: No bootstrap required, opened a new log
I20260709 12:24:03.376823 13150 raft_consensus.cc:2804] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.377663 13120 ts_tablet_manager.cc:1403] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.016s
I20260709 12:24:03.377694 13150 raft_consensus.cc:697] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:03.380710 13120 raft_consensus.cc:359] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.379118 13150 consensus_queue.cc:237] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.381439 13120 raft_consensus.cc:385] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.381752 13120 raft_consensus.cc:740] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.382441 13120 consensus_queue.cc:260] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.384594 13120 ts_tablet_manager.cc:1434] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:03.388023 13122 tablet_bootstrap.cc:492] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.388909 13122 ts_tablet_manager.cc:1403] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.032s
I20260709 12:24:03.392047 13122 raft_consensus.cc:359] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.392776 13122 raft_consensus.cc:385] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.393066 13122 raft_consensus.cc:740] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.393805 13122 consensus_queue.cc:260] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.393290 12715 catalog_manager.cc:5697] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.397190 13122 ts_tablet_manager.cc:1434] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:24:03.398252 13122 tablet_bootstrap.cc:492] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.405303 13122 tablet_bootstrap.cc:654] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.411988 13122 tablet_bootstrap.cc:492] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.412582 13122 ts_tablet_manager.cc:1403] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:24:03.415954 13122 raft_consensus.cc:359] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.416736 13122 raft_consensus.cc:385] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.417128 13150 raft_consensus.cc:493] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.417485 13122 raft_consensus.cc:740] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.417815 13150 raft_consensus.cc:515] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.418349 13122 consensus_queue.cc:260] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.419888 13150 leader_election.cc:290] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:03.420615 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:03.420925 13122 ts_tablet_manager.cc:1434] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:03.421591 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
W20260709 12:24:03.421957 12936 leader_election.cc:343] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.422397 12893 raft_consensus.cc:2468] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 0.
I20260709 12:24:03.422890 13122 tablet_bootstrap.cc:492] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.423682 12935 leader_election.cc:304] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.424646 13150 raft_consensus.cc:2804] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.425045 13150 raft_consensus.cc:493] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.425422 13150 raft_consensus.cc:3060] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.429499 13122 tablet_bootstrap.cc:654] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.432813 13150 raft_consensus.cc:515] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.435065 13122 tablet_bootstrap.cc:492] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.435722 13122 ts_tablet_manager.cc:1403] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 12:24:03.436919 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:03.438038 13122 raft_consensus.cc:359] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
W20260709 12:24:03.438485 12936 leader_election.cc:343] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.438720 13122 raft_consensus.cc:385] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.439117 13122 raft_consensus.cc:740] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.439599 13150 leader_election.cc:290] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:03.439901 13122 consensus_queue.cc:260] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.440680 12893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.441289 12893 raft_consensus.cc:3060] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.442442 13122 ts_tablet_manager.cc:1434] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:03.443588 13122 tablet_bootstrap.cc:492] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.444308 13148 raft_consensus.cc:493] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.444844 13148 raft_consensus.cc:515] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.448727 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.449442 12895 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:24:03.450853 13122 tablet_bootstrap.cc:654] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.451128 12784 leader_election.cc:304] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.452059 13022 raft_consensus.cc:2804] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.452183 13150 raft_consensus.cc:493] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.452461 13022 raft_consensus.cc:493] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.453052 13022 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.453091 13150 raft_consensus.cc:515] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.453974 13148 leader_election.cc:290] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.455170 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.456112 12969 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 0.
I20260709 12:24:03.458351 13122 tablet_bootstrap.cc:492] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.458859 13122 ts_tablet_manager.cc:1403] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:24:03.461297 13022 raft_consensus.cc:515] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.461576 13122 raft_consensus.cc:359] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.461771 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8101dd02596e4702ad71d54ee0c4397c" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" is_pre_election: true
I20260709 12:24:03.462246 13122 raft_consensus.cc:385] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.462558 13150 leader_election.cc:290] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:03.464893 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
W20260709 12:24:03.465250 12936 leader_election.cc:343] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.465493 12894 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.465991 12893 raft_consensus.cc:2468] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 1.
I20260709 12:24:03.467260 12935 leader_election.cc:304] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.468130 13150 raft_consensus.cc:2804] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.468705 13150 raft_consensus.cc:697] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:03.469592 13150 consensus_queue.cc:237] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.462568 13122 raft_consensus.cc:740] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.463196 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8101dd02596e4702ad71d54ee0c4397c" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.471853 12895 raft_consensus.cc:2468] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 0.
I20260709 12:24:03.472369 12894 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:24:03.472102 13122 consensus_queue.cc:260] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.474293 13122 ts_tablet_manager.cc:1434] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:24:03.475956 13122 tablet_bootstrap.cc:492] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: Bootstrap starting.
I20260709 12:24:03.475610 12784 leader_election.cc:304] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.477563 13148 raft_consensus.cc:2804] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.478605 12935 leader_election.cc:304] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.479449 13148 raft_consensus.cc:697] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:03.479592 13107 raft_consensus.cc:2804] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:03.480083 13107 raft_consensus.cc:493] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.480428 13107 raft_consensus.cc:3060] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.480454 13148 consensus_queue.cc:237] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.482462 13122 tablet_bootstrap.cc:654] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:03.493364 13107 raft_consensus.cc:515] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.493737 12713 catalog_manager.cc:5697] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.495988 13107 leader_election.cc:290] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:03.496796 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8101dd02596e4702ad71d54ee0c4397c" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
W20260709 12:24:03.499068 12936 leader_election.cc:343] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:03.463368 13022 leader_election.cc:290] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.499787 13122 tablet_bootstrap.cc:492] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: No bootstrap required, opened a new log
I20260709 12:24:03.464439 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.500066 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8101dd02596e4702ad71d54ee0c4397c" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.500448 12969 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.500903 12894 raft_consensus.cc:3060] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.504858 13122 ts_tablet_manager.cc:1403] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 12:24:03.508116 12969 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 1.
I20260709 12:24:03.509527 13122 raft_consensus.cc:359] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.510274 13122 raft_consensus.cc:385] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:03.510533 13122 raft_consensus.cc:740] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Initialized, Role: FOLLOWER
I20260709 12:24:03.511226 13122 consensus_queue.cc:260] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.513339 13122 ts_tablet_manager.cc:1434] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:24:03.514019 12894 raft_consensus.cc:2468] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 1.
I20260709 12:24:03.514556 12713 catalog_manager.cc:5697] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.515187 12935 leader_election.cc:304] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.516291 13107 raft_consensus.cc:2804] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:03.516793 13107 raft_consensus.cc:697] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:03.517501 13107 consensus_queue.cc:237] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.527904 12715 catalog_manager.cc:5697] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.572937 13022 raft_consensus.cc:493] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.573508 13022 raft_consensus.cc:515] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.575250 13022 leader_election.cc:290] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.576071 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c75b98e2046119cf4287e09c42ed9" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.576395 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9c75b98e2046119cf4287e09c42ed9" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.577327 12969 raft_consensus.cc:2393] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate 4a58242bae09424e8951a4a882f57c39 in this term.
I20260709 12:24:03.578413 12785 leader_election.cc:304] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:03.579090 13022 raft_consensus.cc:3060] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.582688 12894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:24:03.583488 12894 raft_consensus.cc:606] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.584678 13022 raft_consensus.cc:2749] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.589288 12894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6c38caf5131423a82e9141024b19710"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:24:03.589902 12894 raft_consensus.cc:606] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.595510 12894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:24:03.596099 12894 raft_consensus.cc:606] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.601730 13039 consensus_queue.cc:1048] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.602614 12894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:51972
I20260709 12:24:03.603225 12894 raft_consensus.cc:606] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Received request to transfer leadership to TS b5da228e99e1425cb4b8e6ea09d9a3c1
I20260709 12:24:03.609490 13144 raft_consensus.cc:993] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.610425 13144 raft_consensus.cc:1081] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.613745 12819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:24:03.614387 12819 raft_consensus.cc:493] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.614756 12819 raft_consensus.cc:3060] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.616708 12969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
mode: GRACEFUL
new_leader_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:40728
I20260709 12:24:03.617455 12969 raft_consensus.cc:606] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Received request to transfer leadership to TS 4a58242bae09424e8951a4a882f57c39
I20260709 12:24:03.620347 13145 consensus_queue.cc:1048] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.621840 13145 consensus_queue.cc:1048] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.630230 12816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
mode: GRACEFUL
new_leader_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:39548
I20260709 12:24:03.630913 12816 raft_consensus.cc:606] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Received request to transfer leadership to TS 4a58242bae09424e8951a4a882f57c39
I20260709 12:24:03.634020 13148 raft_consensus.cc:493] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.634600 13148 raft_consensus.cc:515] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.637243 13148 leader_election.cc:290] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.638474 12970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8101dd02596e4702ad71d54ee0c4397c" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.639401 12968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
mode: GRACEFUL
new_leader_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:40728
I20260709 12:24:03.641273 12968 raft_consensus.cc:606] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Received request to transfer leadership to TS 4a58242bae09424e8951a4a882f57c39
I20260709 12:24:03.641263 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8101dd02596e4702ad71d54ee0c4397c" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.642261 12894 raft_consensus.cc:2393] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate fc9b5699a29143a1b83240426cb8f202 in this term.
I20260709 12:24:03.643921 13108 raft_consensus.cc:993] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.643561 12819 raft_consensus.cc:515] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.644376 13108 raft_consensus.cc:1081] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.644853 12818 raft_consensus.cc:1240] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Rejecting Update request from peer 4a58242bae09424e8951a4a882f57c39 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:03.647236 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.650096 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9c37202fca40e495a6cd4326f582ca" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.650285 12969 raft_consensus.cc:3060] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.650779 12894 raft_consensus.cc:3055] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.651119 12894 raft_consensus.cc:740] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.652027 12894 consensus_queue.cc:260] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.653194 12894 raft_consensus.cc:3060] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.655484 13039 consensus_queue.cc:1048] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.657744 12784 leader_election.cc:304] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:03.657964 12818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:24:03.659510 13148 raft_consensus.cc:3060] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.668823 12818 raft_consensus.cc:493] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.669391 12818 raft_consensus.cc:3060] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.672969 12894 raft_consensus.cc:2468] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.674448 12784 leader_election.cc:304] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.675266 13022 raft_consensus.cc:2804] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:03.675726 13022 raft_consensus.cc:697] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:03.666924 12969 raft_consensus.cc:2468] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.676458 13022 consensus_queue.cc:237] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.679028 12818 raft_consensus.cc:515] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.650143 12819 leader_election.cc:290] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.683535 13148 raft_consensus.cc:2749] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.685766 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.686208 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b835953274bf68a8a7d3e101b7c36" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.686504 12894 raft_consensus.cc:3055] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.686872 12894 raft_consensus.cc:740] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.686867 12969 raft_consensus.cc:3060] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.688292 12894 consensus_queue.cc:260] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.689481 12894 raft_consensus.cc:3060] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.694990 12969 raft_consensus.cc:2468] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.695158 12713 catalog_manager.cc:5697] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.696488 12785 leader_election.cc:304] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:03.696606 12818 leader_election.cc:290] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.697409 12894 raft_consensus.cc:2468] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.697537 13148 raft_consensus.cc:2804] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:03.698163 13148 raft_consensus.cc:697] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:03.699092 13148 consensus_queue.cc:237] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.706912 13108 consensus_queue.cc:1048] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.710868 12713 catalog_manager.cc:5697] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.717404 13134 consensus_queue.cc:1048] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.725103 13134 consensus_queue.cc:1048] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.743853 13145 consensus_queue.cc:1048] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.746687 13145 consensus_queue.cc:1048] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.756093 13134 consensus_queue.cc:1048] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.757261 13145 raft_consensus.cc:993] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.757925 13108 raft_consensus.cc:1081] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.759837 12819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:24:03.760483 12819 raft_consensus.cc:493] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.760906 12819 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.769522 13144 raft_consensus.cc:993] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.770049 13144 raft_consensus.cc:1081] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Signalling peer b5da228e99e1425cb4b8e6ea09d9a3c1 to start an election
I20260709 12:24:03.772452 12819 raft_consensus.cc:515] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.775699 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.776362 12894 raft_consensus.cc:3055] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.776700 12894 raft_consensus.cc:740] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.777532 12894 consensus_queue.cc:260] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.778682 12894 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.779984 12817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6c38caf5131423a82e9141024b19710"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
 from {username='slave'} at 127.0.0.1:39532
I20260709 12:24:03.781255 12817 raft_consensus.cc:493] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.781625 12817 raft_consensus.cc:3060] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.788602 12817 raft_consensus.cc:515] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.789583 12894 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.791033 12817 leader_election.cc:290] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.792011 12968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c38caf5131423a82e9141024b19710" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.793339 12968 raft_consensus.cc:3060] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.791229 12784 leader_election.cc:304] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:03.795020 13148 raft_consensus.cc:2804] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:03.795576 13148 raft_consensus.cc:697] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:03.792212 12894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6c38caf5131423a82e9141024b19710" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:03.797142 12819 leader_election.cc:290] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.798285 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:03.799161 12969 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.796538 13148 consensus_queue.cc:237] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.796518 12894 raft_consensus.cc:3055] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.802265 12968 raft_consensus.cc:2468] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.802456 12894 raft_consensus.cc:740] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:03.803659 12785 leader_election.cc:304] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:03.803666 12894 consensus_queue.cc:260] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.804637 13022 raft_consensus.cc:2804] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:03.804998 12894 raft_consensus.cc:3060] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.805088 13022 raft_consensus.cc:697] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Leader. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:03.805867 13022 consensus_queue.cc:237] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.806922 13164 raft_consensus.cc:493] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.807415 13164 raft_consensus.cc:515] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.809540 13164 leader_election.cc:290] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.810750 12968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.811144 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.812095 12894 raft_consensus.cc:2468] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.812770 12895 raft_consensus.cc:2393] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate fc9b5699a29143a1b83240426cb8f202 in this term.
I20260709 12:24:03.814791 12784 leader_election.cc:304] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:03.816021 13164 raft_consensus.cc:3060] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.816417 12969 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in term 2.
I20260709 12:24:03.817793 12715 catalog_manager.cc:5697] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.822860 13164 raft_consensus.cc:2749] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:03.831509 12715 catalog_manager.cc:5697] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 reported cstate change: term changed from 1 to 2, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.951148 13164 consensus_queue.cc:1048] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.956876 13164 raft_consensus.cc:493] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.957419 13164 raft_consensus.cc:515] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.959219 13022 raft_consensus.cc:993] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: : Instructing follower 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:03.959542 13164 leader_election.cc:290] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.959760 13022 raft_consensus.cc:1081] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Signalling peer 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:03.960675 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9b5699a29143a1b83240426cb8f202" is_pre_election: true
I20260709 12:24:03.965850 13107 consensus_queue.cc:1048] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.966711 13022 consensus_queue.cc:1048] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.969592 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a58242bae09424e8951a4a882f57c39" is_pre_election: true
I20260709 12:24:03.970434 12895 raft_consensus.cc:2393] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5da228e99e1425cb4b8e6ea09d9a3c1 in current term 1: Already voted for candidate fc9b5699a29143a1b83240426cb8f202 in this term.
I20260709 12:24:03.972393 12895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:51958
I20260709 12:24:03.973007 12895 raft_consensus.cc:493] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.974754 12895 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.977283 13107 consensus_queue.cc:1048] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:03.982044 12895 raft_consensus.cc:515] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.984686 12895 leader_election.cc:290] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:03.985502 12819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:03.986243 12819 raft_consensus.cc:3055] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.986578 12819 raft_consensus.cc:740] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:03.987655 12819 consensus_queue.cc:260] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:03.988732 12819 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.990968 12895 raft_consensus.cc:1240] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Rejecting Update request from peer b5da228e99e1425cb4b8e6ea09d9a3c1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:03.986486 12784 leader_election.cc:304] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:03.996551 13148 raft_consensus.cc:3060] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:03.998423 13150 raft_consensus.cc:993] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: : Instructing follower 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:04.000696 13150 raft_consensus.cc:1081] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Signalling peer 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:04.014081 13184 consensus_queue.cc:1048] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:04.022289 12894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:51966
I20260709 12:24:04.023962 12894 raft_consensus.cc:493] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.024399 12894 raft_consensus.cc:3060] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.024372 13185 consensus_queue.cc:1048] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:03.986611 12968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:04.022204 13148 raft_consensus.cc:2749] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:04.032405 13186 consensus_queue.cc:1048] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.037921 13186 consensus_queue.cc:1048] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:04.034616 12819 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:04.039448 12861 leader_election.cc:304] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:04.040253 13145 raft_consensus.cc:2804] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.040890 13145 raft_consensus.cc:697] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:04.041863 13145 consensus_queue.cc:237] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.054895 12894 raft_consensus.cc:515] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.061429 12894 leader_election.cc:290] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:04.061932 12969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:04.062584 12969 raft_consensus.cc:3055] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.062881 12969 raft_consensus.cc:740] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:04.061775 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6a1d33bc74414c9010665a9ea984e8" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:04.063756 12818 raft_consensus.cc:3060] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.063648 12969 consensus_queue.cc:260] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.064877 12969 raft_consensus.cc:3060] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.071215 12818 raft_consensus.cc:2468] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:04.071448 12969 raft_consensus.cc:2468] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:04.072600 12861 leader_election.cc:304] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:04.073406 13145 raft_consensus.cc:2804] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.073911 13145 raft_consensus.cc:697] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:04.074848 13145 consensus_queue.cc:237] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.084012 13186 raft_consensus.cc:993] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: : Instructing follower 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:04.084932 13186 raft_consensus.cc:1081] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Signalling peer 4a58242bae09424e8951a4a882f57c39 to start an election
I20260709 12:24:04.089545 12893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
 from {username='slave'} at 127.0.0.1:51966
I20260709 12:24:04.090145 12893 raft_consensus.cc:493] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.090525 12893 raft_consensus.cc:3060] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.098483 12894 raft_consensus.cc:1275] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.101094 13022 consensus_queue.cc:1048] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.102022 12893 raft_consensus.cc:515] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.103276 12895 raft_consensus.cc:1240] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Rejecting Update request from peer fc9b5699a29143a1b83240426cb8f202 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:04.105638 13186 consensus_queue.cc:1059] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:04.107529 13107 raft_consensus.cc:3055] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.107900 13107 raft_consensus.cc:740] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:04.108745 13107 consensus_queue.cc:260] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.109882 13107 raft_consensus.cc:3060] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.112995 12893 leader_election.cc:290] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), fc9b5699a29143a1b83240426cb8f202 (127.3.7.131:45809)
I20260709 12:24:04.113802 12969 raft_consensus.cc:1275] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.114849 12715 catalog_manager.cc:5697] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 1 to 2, leader changed from b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129) to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.115725 13164 consensus_queue.cc:1048] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.116598 12715 catalog_manager.cc:5697] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 1 to 2, leader changed from fc9b5699a29143a1b83240426cb8f202 (127.3.7.131) to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.118271 12970 raft_consensus.cc:1275] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.120283 13164 consensus_queue.cc:1048] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.124727 12894 raft_consensus.cc:1275] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.130637 13164 consensus_queue.cc:1048] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.132477 12968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
I20260709 12:24:04.134282 12818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619587c4a4d94ab09bc3d84e4866139a" candidate_uuid: "4a58242bae09424e8951a4a882f57c39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:04.134891 12818 raft_consensus.cc:3060] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.142140 12818 raft_consensus.cc:2468] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:04.143829 12968 raft_consensus.cc:2468] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a58242bae09424e8951a4a882f57c39 in term 2.
I20260709 12:24:04.145040 12861 leader_election.cc:304] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, b5da228e99e1425cb4b8e6ea09d9a3c1; no voters: 
I20260709 12:24:04.146167 13145 raft_consensus.cc:2804] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.146637 13145 raft_consensus.cc:697] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Leader. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:04.147559 13145 consensus_queue.cc:237] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:04.157519 12713 catalog_manager.cc:5697] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 reported cstate change: term changed from 1 to 2, leader changed from fc9b5699a29143a1b83240426cb8f202 (127.3.7.131) to 4a58242bae09424e8951a4a882f57c39 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "4a58242bae09424e8951a4a882f57c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.351994 12968 raft_consensus.cc:1275] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.353561 13164 consensus_queue.cc:1048] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.362275 12893 raft_consensus.cc:1275] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.369647 13161 consensus_queue.cc:1048] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.371992 12893 raft_consensus.cc:1275] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.374740 13161 consensus_queue.cc:1048] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.383456 12968 raft_consensus.cc:1275] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer b5da228e99e1425cb4b8e6ea09d9a3c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.387686 13164 consensus_queue.cc:1048] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.559239 12818 raft_consensus.cc:1275] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.560518 13145 consensus_queue.cc:1048] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.565121 12817 raft_consensus.cc:1275] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.566661 13039 consensus_queue.cc:1048] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.569988 12968 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.584694 12968 raft_consensus.cc:1275] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.586884 12968 raft_consensus.cc:1275] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.588053 13039 consensus_queue.cc:1048] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:04.592017 13039 consensus_queue.cc:1048] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.739985 12970 raft_consensus.cc:1275] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.741212 13192 consensus_queue.cc:1048] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.749253 12818 raft_consensus.cc:1275] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer 4a58242bae09424e8951a4a882f57c39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:04.750854 13039 consensus_queue.cc:1048] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.652204 12714 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46010:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:24:06.673839 12714 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46010:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:24:06.783565  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:24:06.958562 13218 log.cc:927] Time spent T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:24:07.011721 12785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:45809, user_credentials={real_user=slave}} blocked reactor thread for 77120.3us
W20260709 12:24:07.038087 12784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:40501, user_credentials={real_user=slave}} blocked reactor thread for 111193us
W20260709 12:24:07.044932 12861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:46469, user_credentials={real_user=slave}} blocked reactor thread for 58006us
W20260709 12:24:07.132216 13244 log.cc:927] Time spent T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: Append to log took a long time: real 0.098s	user 0.008s	sys 0.010s
I20260709 12:24:07.130887 13255 tablet.cc:1724] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.103684 13248 tablet.cc:1724] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:07.161875 13243 log.cc:927] Time spent T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: Append to log took a long time: real 0.116s	user 0.003s	sys 0.000s
I20260709 12:24:07.161358 13259 tablet.cc:1724] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.117538 13256 tablet.cc:1724] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.174326 13261 tablet.cc:1724] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:07.202291 12996 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:a6c38caf5131423a82e9141024b19710)
W20260709 12:24:07.208487 12996 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:a6c38caf5131423a82e9141024b19710)
W20260709 12:24:07.213457 12996 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:a6c38caf5131423a82e9141024b19710)
I20260709 12:24:07.148324 13254 tablet.cc:1724] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.222939 12817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
mode: GRACEFUL
new_leader_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:56794
I20260709 12:24:07.218997 13258 tablet.cc:1724] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.224016 12817 raft_consensus.cc:606] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Received request to transfer leadership to TS fc9b5699a29143a1b83240426cb8f202
W20260709 12:24:07.236037 13257 log.cc:927] Time spent T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:24:07.183915 13260 tablet.cc:1724] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.173739 13262 tablet.cc:1724] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.262919 13264 tablet.cc:1724] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.285756 13256 tablet.cc:1724] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.288594 13260 tablet.cc:1724] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.290840 13259 tablet.cc:1724] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.301179 13260 tablet.cc:1724] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.305697 13248 tablet.cc:1724] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.311188 13262 tablet.cc:1724] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.307713 13266 tablet.cc:1724] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.214555 13265 tablet.cc:1724] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.326637 13255 tablet.cc:1724] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.329555 13254 tablet.cc:1724] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.333669 13258 tablet.cc:1724] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.330806 13261 tablet.cc:1724] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.357627 13260 tablet.cc:1724] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.379962 13256 tablet.cc:1724] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.377354 13258 tablet.cc:1724] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.387229 13255 tablet.cc:1724] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.393553 13254 tablet.cc:1724] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:07.401464 12895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:53920
I20260709 12:24:07.402029 12895 raft_consensus.cc:606] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Received request to transfer leadership to TS fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:07.403947  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:24:07.404639  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:07.420836 12817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f"
dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
mode: GRACEFUL
new_leader_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:56794
I20260709 12:24:07.421519 12817 raft_consensus.cc:606] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Received request to transfer leadership to TS fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:07.424048 12714 catalog_manager.cc:6242] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da: soft_deleted_table [id=e411e1f447e444ac9af73613e93a4715] alter complete (version 1)
I20260709 12:24:07.426029 12895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48"
dest_uuid: "4a58242bae09424e8951a4a882f57c39"
mode: GRACEFUL
new_leader_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:53920
I20260709 12:24:07.426637 12895 raft_consensus.cc:606] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Received request to transfer leadership to TS fc9b5699a29143a1b83240426cb8f202
I20260709 12:24:07.428076 13249 raft_consensus.cc:993] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.428529 13249 raft_consensus.cc:1081] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Signalling peer fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.430123 12968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:40710
I20260709 12:24:07.430670 12968 raft_consensus.cc:493] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.431030 12968 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.434485  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:07.435262  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:07.437875 12968 raft_consensus.cc:515] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.440213 12968 leader_election.cc:290] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 3 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:07.441123 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:07.442582 12895 raft_consensus.cc:3055] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:07.442873 12895 raft_consensus.cc:740] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:07.443598 12895 consensus_queue.cc:260] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.444741 12895 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.441445 12817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bcd0c3747b74436b8ba0e0b11db3a48" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:07.446235 12817 raft_consensus.cc:3060] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.450336 12895 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 3.
I20260709 12:24:07.451558 12935 leader_election.cc:304] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:07.452135 12817 raft_consensus.cc:2468] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 3.
I20260709 12:24:07.452406 13234 raft_consensus.cc:2804] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:07.452943 13234 raft_consensus.cc:697] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 3 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:07.453804 13234 consensus_queue.cc:237] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.462625 12715 catalog_manager.cc:5697] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 2 to 3, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.562183 13198 raft_consensus.cc:993] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: : Instructing follower fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.562691 13249 raft_consensus.cc:1081] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Signalling peer fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.564299 12968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:40710
I20260709 12:24:07.564821 12968 raft_consensus.cc:493] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.565127 12968 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.570633 12968 raft_consensus.cc:515] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.572571 12968 leader_election.cc:290] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 3 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:07.573488 12817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:07.573740 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4969452f1e349e2a203ef6a322b1ba7" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:07.574087 12817 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.574308 12895 raft_consensus.cc:3055] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:07.574640 12895 raft_consensus.cc:740] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a58242bae09424e8951a4a882f57c39, State: Running, Role: LEADER
I20260709 12:24:07.575253 12895 consensus_queue.cc:260] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.576236 12895 raft_consensus.cc:3060] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.581102 12817 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 3.
I20260709 12:24:07.582470 12936 leader_election.cc:304] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5da228e99e1425cb4b8e6ea09d9a3c1, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:07.582659 12895 raft_consensus.cc:2468] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 3.
I20260709 12:24:07.583384 13234 raft_consensus.cc:2804] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:07.583873 13234 raft_consensus.cc:697] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 3 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:07.584632 13234 consensus_queue.cc:237] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.591223 12715 catalog_manager.cc:5697] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 2 to 3, leader changed from 4a58242bae09424e8951a4a882f57c39 (127.3.7.130) to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.636893 13217 raft_consensus.cc:993] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: : Instructing follower fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.637424 13217 raft_consensus.cc:1081] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Signalling peer fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.639489 12968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:40720
I20260709 12:24:07.639979 12968 raft_consensus.cc:493] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.640412 12968 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.649151 12968 raft_consensus.cc:515] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.650897 12968 leader_election.cc:290] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 3 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:07.651736 12817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:07.651947 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8541f3eb0725493ea3d2c3b19d41ef15" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:07.652423 12817 raft_consensus.cc:3055] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:07.652446 12895 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.652956 12817 raft_consensus.cc:740] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:07.653802 12817 consensus_queue.cc:260] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.655035 12817 raft_consensus.cc:3060] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.660460 12895 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 3.
I20260709 12:24:07.661988 12935 leader_election.cc:304] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:07.662726 13234 raft_consensus.cc:2804] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:07.662703 12817 raft_consensus.cc:2468] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 3.
I20260709 12:24:07.663538 13234 raft_consensus.cc:697] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 3 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:07.664368 13234 consensus_queue.cc:237] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.670993 12715 catalog_manager.cc:5697] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 2 to 3, leader changed from b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129) to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.794955 13217 raft_consensus.cc:993] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: : Instructing follower fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.795492 13242 raft_consensus.cc:1081] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Signalling peer fc9b5699a29143a1b83240426cb8f202 to start an election
I20260709 12:24:07.797063 12968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f"
dest_uuid: "fc9b5699a29143a1b83240426cb8f202"
 from {username='slave'} at 127.0.0.1:40720
I20260709 12:24:07.797652 12968 raft_consensus.cc:493] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.797974 12968 raft_consensus.cc:3060] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.803411 12968 raft_consensus.cc:515] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.805181 12968 leader_election.cc:290] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 2 election: Requested vote from peers b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469), 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501)
I20260709 12:24:07.806283 12817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1"
I20260709 12:24:07.806262 12895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c57746c93c492ab4f50be15abfe86f" candidate_uuid: "fc9b5699a29143a1b83240426cb8f202" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a58242bae09424e8951a4a882f57c39"
I20260709 12:24:07.807157 12817 raft_consensus.cc:3055] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.807209 12895 raft_consensus.cc:3060] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.807663 12817 raft_consensus.cc:740] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5da228e99e1425cb4b8e6ea09d9a3c1, State: Running, Role: LEADER
I20260709 12:24:07.808606 12817 consensus_queue.cc:260] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.809840 12817 raft_consensus.cc:3060] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.814781 12895 raft_consensus.cc:2468] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 2.
I20260709 12:24:07.816133 12935 leader_election.cc:304] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a58242bae09424e8951a4a882f57c39, fc9b5699a29143a1b83240426cb8f202; no voters: 
I20260709 12:24:07.816942 13234 raft_consensus.cc:2804] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.817273 12817 raft_consensus.cc:2468] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc9b5699a29143a1b83240426cb8f202 in term 2.
I20260709 12:24:07.817466 13234 raft_consensus.cc:697] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 2 LEADER]: Becoming Leader. State: Replica: fc9b5699a29143a1b83240426cb8f202, State: Running, Role: LEADER
I20260709 12:24:07.818816 13234 consensus_queue.cc:237] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } }
I20260709 12:24:07.826521 12715 catalog_manager.cc:5697] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 reported cstate change: term changed from 1 to 2, leader changed from b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129) to fc9b5699a29143a1b83240426cb8f202 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "fc9b5699a29143a1b83240426cb8f202" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc9b5699a29143a1b83240426cb8f202" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.894742 12817 raft_consensus.cc:1275] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.896256 13234 consensus_queue.cc:1048] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:07.906667 12895 raft_consensus.cc:1275] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.908999 13267 consensus_queue.cc:1048] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:07.995275 12893 raft_consensus.cc:1275] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:07.996713 13234 consensus_queue.cc:1048] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.008235 12817 raft_consensus.cc:1275] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:08.011627 13280 consensus_queue.cc:1048] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:08.045607 12817 raft_consensus.cc:1275] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:08.047084 13280 consensus_queue.cc:1048] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.055135 12893 raft_consensus.cc:1275] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:08.056500 13234 consensus_queue.cc:1048] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.289932 12893 raft_consensus.cc:1275] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.291064 13234 consensus_queue.cc:1048] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a58242bae09424e8951a4a882f57c39" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.302717 12817 raft_consensus.cc:1275] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Refusing update from remote peer fc9b5699a29143a1b83240426cb8f202: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.304250 13234 consensus_queue.cc:1048] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5da228e99e1425cb4b8e6ea09d9a3c1" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 46469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.436455  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:08.443348  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:08.443933  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.451472  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:08.451960  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.453115  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:09.458547  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:09.459095  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.464241  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:09.464694  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:10.466050  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:10.473039  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:10.473745  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.479575  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:10.479936  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:11.481060  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:11.487726  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:11.488292  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.494367  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:11.494789  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:12.495911  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:12.502259  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:12.502656  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:12.507210  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:12.507563  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:13.508556  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:13.513618  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:13.514058  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.519101  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:13.519572  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:14.520633  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:14.525833  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:14.526336  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:14.531045  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:14.531502  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:15.532569  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:15.538817  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:15.539333  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.544276  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:15.544672  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:16.545827  3102 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:24:16.551697  3102 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:24:16.552201  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.557893  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:16.558382  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:17.630402  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
W20260709 12:24:17.636401 12936 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:24:17.642944 12936 consensus_peers.cc:597] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:17.674428 12936 consensus_peers.cc:597] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.686245  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:17.690882  3102 tablet_replica.cc:333] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.692795  3102 raft_consensus.cc:2243] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:17.693193 12861 consensus_peers.cc:597] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.694435  3102 raft_consensus.cc:2272] T 619587c4a4d94ab09bc3d84e4866139a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:17.695086 12861 consensus_peers.cc:597] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.698186  3102 tablet_replica.cc:333] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.699366  3102 raft_consensus.cc:2243] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.700103  3102 raft_consensus.cc:2272] T 8101dd02596e4702ad71d54ee0c4397c P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.704100  3102 tablet_replica.cc:333] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.705206  3102 raft_consensus.cc:2243] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.706234  3102 raft_consensus.cc:2272] T 8b6a1d33bc74414c9010665a9ea984e8 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.709525  3102 tablet_replica.cc:333] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.710376  3102 raft_consensus.cc:2243] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.711187  3102 raft_consensus.cc:2272] T ce9c75b98e2046119cf4287e09c42ed9 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.714497  3102 tablet_replica.cc:333] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.715369  3102 raft_consensus.cc:2243] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.716400  3102 raft_consensus.cc:2272] T e4969452f1e349e2a203ef6a322b1ba7 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.719098  3102 tablet_replica.cc:333] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.719875  3102 raft_consensus.cc:2243] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.721038  3102 raft_consensus.cc:2272] T a6c38caf5131423a82e9141024b19710 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.724283  3102 tablet_replica.cc:333] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.725018  3102 raft_consensus.cc:2243] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.725683  3102 raft_consensus.cc:2272] T 6846b79d30024ea8837b42836e2fd819 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.729389  3102 tablet_replica.cc:333] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.730352  3102 raft_consensus.cc:2243] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.732232  3102 raft_consensus.cc:2272] T f56b835953274bf68a8a7d3e101b7c36 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:17.735044 12936 consensus_peers.cc:597] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.736739  3102 tablet_replica.cc:333] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.737985  3102 raft_consensus.cc:2243] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.738590  3102 raft_consensus.cc:2272] T 8541f3eb0725493ea3d2c3b19d41ef15 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.741451  3102 tablet_replica.cc:333] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.742271  3102 raft_consensus.cc:2243] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.743578  3102 raft_consensus.cc:2272] T 1e9c37202fca40e495a6cd4326f582ca P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.747994  3102 tablet_replica.cc:333] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.749024  3102 raft_consensus.cc:2243] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.749548  3102 raft_consensus.cc:2272] T 77b57f9c807747bab426c65049fcf252 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.752487  3102 tablet_replica.cc:333] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.753129  3102 raft_consensus.cc:2243] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.753706  3102 raft_consensus.cc:2272] T 4494b1fc744048f2b08edbe9ef5b9d27 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.756788  3102 tablet_replica.cc:333] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.757429  3102 raft_consensus.cc:2243] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.758538  3102 raft_consensus.cc:2272] T f320dc5ffca54822a8b937396332dbc6 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.761554  3102 tablet_replica.cc:333] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.762138  3102 raft_consensus.cc:2243] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.762774  3102 raft_consensus.cc:2272] T 6d61f30a9975498da59dc45ffe62993a P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.765547  3102 tablet_replica.cc:333] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.766295  3102 raft_consensus.cc:2243] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.767454  3102 raft_consensus.cc:2272] T 2d486d0e245e4a42a94cbe1aa4f8df56 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.770220  3102 tablet_replica.cc:333] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.770843  3102 raft_consensus.cc:2243] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.771538  3102 raft_consensus.cc:2272] T 7bcd0c3747b74436b8ba0e0b11db3a48 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.774441  3102 tablet_replica.cc:333] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.775004  3102 raft_consensus.cc:2243] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.776177  3102 raft_consensus.cc:2272] T 19b8c17a33ce463e8d0e8558aa32bd07 P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.779443  3102 tablet_replica.cc:333] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1: stopping tablet replica
I20260709 12:24:17.779984  3102 raft_consensus.cc:2243] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.780531  3102 raft_consensus.cc:2272] T 04c57746c93c492ab4f50be15abfe86f P b5da228e99e1425cb4b8e6ea09d9a3c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:17.820423 12936 consensus_peers.cc:597] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.839597  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
I20260709 12:24:17.890954  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
W20260709 12:24:17.928910 12935 consensus_peers.cc:597] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 -> Peer 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501): Couldn't send request to peer 4a58242bae09424e8951a4a882f57c39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:17.933815 12861 consensus_peers.cc:597] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:46469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:17.934410 12861 consensus_peers.cc:597] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:46469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.936494  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:17.937510  3102 tablet_replica.cc:333] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.938423  3102 raft_consensus.cc:2243] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.939685  3102 raft_consensus.cc:2272] T 619587c4a4d94ab09bc3d84e4866139a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.942409  3102 tablet_replica.cc:333] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.943181  3102 raft_consensus.cc:2243] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.943934  3102 raft_consensus.cc:2272] T 8101dd02596e4702ad71d54ee0c4397c P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.947018  3102 tablet_replica.cc:333] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.947921  3102 raft_consensus.cc:2243] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.948971  3102 raft_consensus.cc:2272] T 8b6a1d33bc74414c9010665a9ea984e8 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.951759  3102 tablet_replica.cc:333] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.952476  3102 raft_consensus.cc:2243] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.953465  3102 raft_consensus.cc:2272] T ce9c75b98e2046119cf4287e09c42ed9 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.956240  3102 tablet_replica.cc:333] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.956921  3102 raft_consensus.cc:2243] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.957489  3102 raft_consensus.cc:2272] T e4969452f1e349e2a203ef6a322b1ba7 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.960209  3102 tablet_replica.cc:333] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.960897  3102 raft_consensus.cc:2243] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.961571  3102 raft_consensus.cc:2272] T a6c38caf5131423a82e9141024b19710 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.964381  3102 tablet_replica.cc:333] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.965142  3102 raft_consensus.cc:2243] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.965883  3102 raft_consensus.cc:2272] T 8541f3eb0725493ea3d2c3b19d41ef15 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.969215  3102 tablet_replica.cc:333] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.969995  3102 raft_consensus.cc:2243] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.970643  3102 raft_consensus.cc:2272] T 1e9c37202fca40e495a6cd4326f582ca P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:17.971822 12936 consensus_peers.cc:597] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:46469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.973852  3102 tablet_replica.cc:333] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.974694  3102 raft_consensus.cc:2243] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.975605  3102 raft_consensus.cc:2272] T f56b835953274bf68a8a7d3e101b7c36 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.978451  3102 tablet_replica.cc:333] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.979136  3102 raft_consensus.cc:2243] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.979785  3102 raft_consensus.cc:2272] T 6846b79d30024ea8837b42836e2fd819 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.984014  3102 tablet_replica.cc:333] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.985090  3102 raft_consensus.cc:2243] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.985870  3102 raft_consensus.cc:2272] T 7bcd0c3747b74436b8ba0e0b11db3a48 P 4a58242bae09424e8951a4a882f57c39 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:17.985924 12861 consensus_peers.cc:597] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:46469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:17.989176  3102 tablet_replica.cc:333] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.989921  3102 raft_consensus.cc:2243] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.990509  3102 raft_consensus.cc:2272] T 2d486d0e245e4a42a94cbe1aa4f8df56 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.993216  3102 tablet_replica.cc:333] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.993853  3102 raft_consensus.cc:2243] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:17.995014  3102 raft_consensus.cc:2272] T 6d61f30a9975498da59dc45ffe62993a P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.998493  3102 tablet_replica.cc:333] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:17.999254  3102 raft_consensus.cc:2243] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.999972  3102 raft_consensus.cc:2272] T f320dc5ffca54822a8b937396332dbc6 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.002743  3102 tablet_replica.cc:333] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:18.003428  3102 raft_consensus.cc:2243] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.003983  3102 raft_consensus.cc:2272] T 19b8c17a33ce463e8d0e8558aa32bd07 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.006557  3102 tablet_replica.cc:333] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:18.007118  3102 raft_consensus.cc:2243] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.008263  3102 raft_consensus.cc:2272] T 4494b1fc744048f2b08edbe9ef5b9d27 P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.010890  3102 tablet_replica.cc:333] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:18.011471  3102 raft_consensus.cc:2243] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.012501  3102 raft_consensus.cc:2272] T 77b57f9c807747bab426c65049fcf252 P 4a58242bae09424e8951a4a882f57c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.015683  3102 tablet_replica.cc:333] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39: stopping tablet replica
I20260709 12:24:18.016261  3102 raft_consensus.cc:2243] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.016774  3102 raft_consensus.cc:2272] T 04c57746c93c492ab4f50be15abfe86f P 4a58242bae09424e8951a4a882f57c39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.063870  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
W20260709 12:24:18.079452 12935 consensus_peers.cc:597] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 -> Peer 4a58242bae09424e8951a4a882f57c39 (127.3.7.130:40501): Couldn't send request to peer 4a58242bae09424e8951a4a882f57c39. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.130:40501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:18.102135 12936 consensus_peers.cc:597] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 -> Peer b5da228e99e1425cb4b8e6ea09d9a3c1 (127.3.7.129:46469): Couldn't send request to peer b5da228e99e1425cb4b8e6ea09d9a3c1. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:46469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:18.109934  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
I20260709 12:24:18.143111  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:18.143872  3102 tablet_replica.cc:333] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.144743  3102 raft_consensus.cc:2243] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.145447  3102 raft_consensus.cc:2272] T 619587c4a4d94ab09bc3d84e4866139a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.148109  3102 tablet_replica.cc:333] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.148669  3102 raft_consensus.cc:2243] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.149350  3102 raft_consensus.cc:2272] T ce9c75b98e2046119cf4287e09c42ed9 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.151780  3102 tablet_replica.cc:333] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.152335  3102 raft_consensus.cc:2243] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.153210  3102 raft_consensus.cc:2272] T 8101dd02596e4702ad71d54ee0c4397c P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.155449  3102 tablet_replica.cc:333] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.156011  3102 raft_consensus.cc:2243] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.156497  3102 raft_consensus.cc:2272] T 8b6a1d33bc74414c9010665a9ea984e8 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.158613  3102 tablet_replica.cc:333] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.159197  3102 raft_consensus.cc:2243] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.160104  3102 raft_consensus.cc:2272] T e4969452f1e349e2a203ef6a322b1ba7 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.162324  3102 tablet_replica.cc:333] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.162850  3102 raft_consensus.cc:2243] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.163398  3102 raft_consensus.cc:2272] T a6c38caf5131423a82e9141024b19710 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.165503  3102 tablet_replica.cc:333] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.166231  3102 raft_consensus.cc:2243] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.167006  3102 raft_consensus.cc:2272] T 8541f3eb0725493ea3d2c3b19d41ef15 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.169234  3102 tablet_replica.cc:333] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.169744  3102 raft_consensus.cc:2243] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.170202  3102 raft_consensus.cc:2272] T 1e9c37202fca40e495a6cd4326f582ca P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.172278  3102 tablet_replica.cc:333] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.172783  3102 raft_consensus.cc:2243] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.173339  3102 raft_consensus.cc:2272] T f56b835953274bf68a8a7d3e101b7c36 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.175475  3102 tablet_replica.cc:333] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.176055  3102 raft_consensus.cc:2243] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.176955  3102 raft_consensus.cc:2272] T 6846b79d30024ea8837b42836e2fd819 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.179075  3102 tablet_replica.cc:333] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.179648  3102 raft_consensus.cc:2243] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.180467  3102 raft_consensus.cc:2272] T 04c57746c93c492ab4f50be15abfe86f P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.182618  3102 tablet_replica.cc:333] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.183168  3102 raft_consensus.cc:2243] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.184002  3102 raft_consensus.cc:2272] T 7bcd0c3747b74436b8ba0e0b11db3a48 P fc9b5699a29143a1b83240426cb8f202 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.186044  3102 tablet_replica.cc:333] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.186570  3102 raft_consensus.cc:2243] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.187041  3102 raft_consensus.cc:2272] T 2d486d0e245e4a42a94cbe1aa4f8df56 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.189275  3102 tablet_replica.cc:333] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.189810  3102 raft_consensus.cc:2243] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.190264  3102 raft_consensus.cc:2272] T f320dc5ffca54822a8b937396332dbc6 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.192462  3102 tablet_replica.cc:333] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.193011  3102 raft_consensus.cc:2243] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.193454  3102 raft_consensus.cc:2272] T 6d61f30a9975498da59dc45ffe62993a P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.195402  3102 tablet_replica.cc:333] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.195958  3102 raft_consensus.cc:2243] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.196403  3102 raft_consensus.cc:2272] T 4494b1fc744048f2b08edbe9ef5b9d27 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.198395  3102 tablet_replica.cc:333] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.198890  3102 raft_consensus.cc:2243] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.199362  3102 raft_consensus.cc:2272] T 77b57f9c807747bab426c65049fcf252 P fc9b5699a29143a1b83240426cb8f202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.201359  3102 tablet_replica.cc:333] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202: stopping tablet replica
I20260709 12:24:18.201835  3102 raft_consensus.cc:2243] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.202297  3102 raft_consensus.cc:2272] T 19b8c17a33ce463e8d0e8558aa32bd07 P fc9b5699a29143a1b83240426cb8f202 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.245468  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
I20260709 12:24:18.285638  3102 master.cc:562] Master@127.3.7.190:33427 shutting down...
I20260709 12:24:18.308586  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:18.309270  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.309625  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P afc94e5c04da4a4c96337c51793ab6da: stopping tablet replica
I20260709 12:24:18.331924  3102 master.cc:584] Master@127.3.7.190:33427 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20673 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:24:18.392386  3102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.7.190:36393
I20260709 12:24:18.393688  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:18.400290 13309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.400364 13308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.401330 13311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.401767  3102 server_base.cc:1061] running on GCE node
I20260709 12:24:18.402808  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:18.403002  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:18.403232  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599858403195 us; error 0 us; skew 500 ppm
I20260709 12:24:18.403914  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:18.406587  3102 webserver.cc:533] Webserver started at http://127.3.7.190:43625/ using document root <none> and password file <none>
I20260709 12:24:18.407171  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:18.407428  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:18.407732  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:18.408927  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/master-0-root/instance:
uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.413833  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:18.417258 13316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.417991  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:18.418293  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/master-0-root
uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.418586  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:18.442060  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:18.443421  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:18.483629  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.190:36393
I20260709 12:24:18.483728 13368 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.190:36393 every 8 connection(s)
I20260709 12:24:18.487598 13369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:18.499543 13369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6: Bootstrap starting.
I20260709 12:24:18.505041 13369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:18.509968 13369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6: No bootstrap required, opened a new log
I20260709 12:24:18.512446 13369 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" member_type: VOTER }
I20260709 12:24:18.512887 13369 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:18.513147 13369 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0fb9b7bf5a432f9af0a6e3092216f6, State: Initialized, Role: FOLLOWER
I20260709 12:24:18.513780 13369 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" member_type: VOTER }
I20260709 12:24:18.514232 13369 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:18.514423 13369 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:18.514643 13369 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:18.519805 13369 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" member_type: VOTER }
I20260709 12:24:18.520383 13369 leader_election.cc:304] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b0fb9b7bf5a432f9af0a6e3092216f6; no voters: 
I20260709 12:24:18.521603 13369 leader_election.cc:290] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:18.522028 13372 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:18.523506 13372 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b0fb9b7bf5a432f9af0a6e3092216f6, State: Running, Role: LEADER
I20260709 12:24:18.524156 13372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" member_type: VOTER }
I20260709 12:24:18.524556 13369 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:18.528743 13373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" member_type: VOTER } }
I20260709 12:24:18.529668 13374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b0fb9b7bf5a432f9af0a6e3092216f6. Latest consensus state: current_term: 1 leader_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0fb9b7bf5a432f9af0a6e3092216f6" member_type: VOTER } }
I20260709 12:24:18.530283 13373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:18.530375 13374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:18.532295 13380 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:18.537370 13380 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:18.539798  3102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:18.546661 13380 catalog_manager.cc:1383] Generated new cluster ID: 98c02b13361d40d3ba1c6dcff29f208d
I20260709 12:24:18.546967 13380 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:18.582109 13380 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:18.583487 13380 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:18.604511 13380 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6: Generated new TSK 0
I20260709 12:24:18.605199 13380 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:18.670778  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:18.677206 13390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.678498 13391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.680186  3102 server_base.cc:1061] running on GCE node
W20260709 12:24:18.680106 13393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.681483  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:18.681665  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:18.681784  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599858681774 us; error 0 us; skew 500 ppm
I20260709 12:24:18.682241  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:18.684952  3102 webserver.cc:533] Webserver started at http://127.3.7.129:41611/ using document root <none> and password file <none>
I20260709 12:24:18.685423  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:18.685591  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:18.685827  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:18.686977  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-0-root/instance:
uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.692081  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:18.695493 13398 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.696321  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:24:18.696655  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-0-root
uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.697010  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:18.715809  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:18.717226  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:18.718848  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:18.721347  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:18.721616  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.721882  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:18.722110  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.767999  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.129:38909
I20260709 12:24:18.768136 13460 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.129:38909 every 8 connection(s)
I20260709 12:24:18.774467  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:18.781852 13465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.782733 13466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.786386  3102 server_base.cc:1061] running on GCE node
W20260709 12:24:18.787187 13469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.788437  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:18.788714  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:18.788939  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599858788916 us; error 0 us; skew 500 ppm
I20260709 12:24:18.789678  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:18.792685  3102 webserver.cc:533] Webserver started at http://127.3.7.130:40805/ using document root <none> and password file <none>
I20260709 12:24:18.793187  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:18.793416  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:18.793738  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:18.795240  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-1-root/instance:
uuid: "fa1ef25482c44f83be85e85166ffe7a1"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.795331 13461 heartbeater.cc:344] Connected to a master server at 127.3.7.190:36393
I20260709 12:24:18.795900 13461 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:18.796692 13461 heartbeater.cc:507] Master 127.3.7.190:36393 requested a full tablet report, sending...
I20260709 12:24:18.799381 13333 ts_manager.cc:194] Registered new tserver with Master: 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909)
I20260709 12:24:18.800653  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:24:18.801502 13333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35960
I20260709 12:24:18.805002 13473 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.806075  3102 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:24:18.806427  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-1-root
uuid: "fa1ef25482c44f83be85e85166ffe7a1"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.806725  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:18.832093  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:18.833395  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:18.835021  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:18.837412  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:18.837653  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.837903  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:18.838099  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.880463  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.130:35201
I20260709 12:24:18.880569 13535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.130:35201 every 8 connection(s)
I20260709 12:24:18.885661  3102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:18.894008 13539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:18.895503 13540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.899011  3102 server_base.cc:1061] running on GCE node
W20260709 12:24:18.899531 13542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:18.900260 13536 heartbeater.cc:344] Connected to a master server at 127.3.7.190:36393
I20260709 12:24:18.900695 13536 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:18.900758  3102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:18.901072  3102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:18.901276  3102 hybrid_clock.cc:648] HybridClock initialized: now 1783599858901255 us; error 0 us; skew 500 ppm
I20260709 12:24:18.901623 13536 heartbeater.cc:507] Master 127.3.7.190:36393 requested a full tablet report, sending...
I20260709 12:24:18.902122  3102 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:18.904176 13333 ts_manager.cc:194] Registered new tserver with Master: fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:18.905326  3102 webserver.cc:533] Webserver started at http://127.3.7.131:35661/ using document root <none> and password file <none>
I20260709 12:24:18.906008  3102 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:18.906126 13333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35962
I20260709 12:24:18.906255  3102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:18.906690  3102 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:18.908370  3102 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-2-root/instance:
uuid: "488176bf4fdd4537a6953ae238bb7441"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.913484  3102 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:18.917209 13547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.918100  3102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:24:18.918378  3102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-2-root
uuid: "488176bf4fdd4537a6953ae238bb7441"
format_stamp: "Formatted at 2026-07-09 12:24:18 on dist-test-slave-6qf7"
I20260709 12:24:18.918634  3102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskoY04dV/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599520970844-3102-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:18.937634  3102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:18.938944  3102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:18.940486  3102 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:18.942831  3102 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:18.943106  3102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.943394  3102 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:18.943584  3102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:18.985922  3102 rpc_server.cc:307] RPC server started. Bound to: 127.3.7.131:45199
I20260709 12:24:18.986080 13610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.7.131:45199 every 8 connection(s)
I20260709 12:24:19.000905 13611 heartbeater.cc:344] Connected to a master server at 127.3.7.190:36393
I20260709 12:24:19.001420 13611 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:19.002231 13611 heartbeater.cc:507] Master 127.3.7.190:36393 requested a full tablet report, sending...
I20260709 12:24:19.004364 13333 ts_manager.cc:194] Registered new tserver with Master: 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.005234  3102 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015893969s
I20260709 12:24:19.005839 13333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35968
I20260709 12:24:19.032300 13333 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35972:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:19.035274 13333 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:19.110112 13426 tablet_service.cc:1511] Processing CreateTablet for tablet df4ce7abbf254a6fbc03dbeea9850383 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:19.110782 13425 tablet_service.cc:1511] Processing CreateTablet for tablet f0e2465e8ed04355896d0754343cdd4e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:19.111861 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4ce7abbf254a6fbc03dbeea9850383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.112579 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2465e8ed04355896d0754343cdd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.125720 13424 tablet_service.cc:1511] Processing CreateTablet for tablet eabd02aceca3424dbd7e5f479734fcb0 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:19.128888 13575 tablet_service.cc:1511] Processing CreateTablet for tablet df4ce7abbf254a6fbc03dbeea9850383 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:19.130465 13575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4ce7abbf254a6fbc03dbeea9850383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.132340 13570 tablet_service.cc:1511] Processing CreateTablet for tablet f9475349e61c4760b9b47bcaecc3f167 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:19.133926 13570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9475349e61c4760b9b47bcaecc3f167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.136695 13574 tablet_service.cc:1511] Processing CreateTablet for tablet f0e2465e8ed04355896d0754343cdd4e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:19.137184 13418 tablet_service.cc:1511] Processing CreateTablet for tablet bdf49c79077d4d54b7504995830ad23e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:19.138382 13574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2465e8ed04355896d0754343cdd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.140674 13573 tablet_service.cc:1511] Processing CreateTablet for tablet eabd02aceca3424dbd7e5f479734fcb0 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:19.142225 13573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabd02aceca3424dbd7e5f479734fcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.142535 13501 tablet_service.cc:1511] Processing CreateTablet for tablet df4ce7abbf254a6fbc03dbeea9850383 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:19.144007 13501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4ce7abbf254a6fbc03dbeea9850383. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.144621 13422 tablet_service.cc:1511] Processing CreateTablet for tablet f2ea9537e8354b86b59dbfc432cebaa8 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:19.147647 13571 tablet_service.cc:1511] Processing CreateTablet for tablet f2ea9537e8354b86b59dbfc432cebaa8 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:19.149264 13571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ea9537e8354b86b59dbfc432cebaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.150281 13500 tablet_service.cc:1511] Processing CreateTablet for tablet f0e2465e8ed04355896d0754343cdd4e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:19.151822 13500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e2465e8ed04355896d0754343cdd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.152607 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcb5d0265e749b0b1ed8928e970cde2 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:19.156757 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 98f42c0cf5ca45d484d873062771a3a8 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:19.159775 13568 tablet_service.cc:1511] Processing CreateTablet for tablet 98f42c0cf5ca45d484d873062771a3a8 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:19.161543 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f42c0cf5ca45d484d873062771a3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.164390 13567 tablet_service.cc:1511] Processing CreateTablet for tablet bdf49c79077d4d54b7504995830ad23e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:19.166191 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf49c79077d4d54b7504995830ad23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.168978 13572 tablet_service.cc:1511] Processing CreateTablet for tablet ff1b76e8876c43ecb5d1812adad4172e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:19.170830 13572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1b76e8876c43ecb5d1812adad4172e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.172519 13423 tablet_service.cc:1511] Processing CreateTablet for tablet ff1b76e8876c43ecb5d1812adad4172e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:19.174398 13421 tablet_service.cc:1511] Processing CreateTablet for tablet f9475349e61c4760b9b47bcaecc3f167 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:19.176281 13569 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcb5d0265e749b0b1ed8928e970cde2 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:19.178053 13569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcb5d0265e749b0b1ed8928e970cde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.179571 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabd02aceca3424dbd7e5f479734fcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.181295 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcb5d0265e749b0b1ed8928e970cde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.182862 13422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ea9537e8354b86b59dbfc432cebaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.184484 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9475349e61c4760b9b47bcaecc3f167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.186128 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f42c0cf5ca45d484d873062771a3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.187742 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1b76e8876c43ecb5d1812adad4172e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.193013 13499 tablet_service.cc:1511] Processing CreateTablet for tablet eabd02aceca3424dbd7e5f479734fcb0 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:19.194823 13499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabd02aceca3424dbd7e5f479734fcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.210445 13498 tablet_service.cc:1511] Processing CreateTablet for tablet ff1b76e8876c43ecb5d1812adad4172e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:19.212594 13498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1b76e8876c43ecb5d1812adad4172e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.223903 13497 tablet_service.cc:1511] Processing CreateTablet for tablet f2ea9537e8354b86b59dbfc432cebaa8 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:19.226046 13497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ea9537e8354b86b59dbfc432cebaa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.250685 13496 tablet_service.cc:1511] Processing CreateTablet for tablet f9475349e61c4760b9b47bcaecc3f167 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:19.252337 13496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9475349e61c4760b9b47bcaecc3f167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.264760 13418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf49c79077d4d54b7504995830ad23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.292209 13495 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcb5d0265e749b0b1ed8928e970cde2 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:19.293859 13495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcb5d0265e749b0b1ed8928e970cde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.369082 13494 tablet_service.cc:1511] Processing CreateTablet for tablet 98f42c0cf5ca45d484d873062771a3a8 (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:19.370904 13494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f42c0cf5ca45d484d873062771a3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.377879 13493 tablet_service.cc:1511] Processing CreateTablet for tablet bdf49c79077d4d54b7504995830ad23e (DEFAULT_TABLE table=test-workload [id=9494b9e62f88459caf76415d4a3828eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:19.380061 13493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf49c79077d4d54b7504995830ad23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:19.392220 13629 tablet_bootstrap.cc:492] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:19.392580 13627 tablet_bootstrap.cc:492] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:19.401877 13628 tablet_bootstrap.cc:492] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.418757 13628 tablet_bootstrap.cc:654] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.423935 13627 tablet_bootstrap.cc:654] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.428172 13629 tablet_bootstrap.cc:654] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.442322 13628 tablet_bootstrap.cc:492] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.442878 13628 ts_tablet_manager.cc:1403] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.011s
I20260709 12:24:19.446398 13628 raft_consensus.cc:359] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.447259 13628 raft_consensus.cc:385] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.447614 13628 raft_consensus.cc:740] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.448230 13629 tablet_bootstrap.cc:492] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:19.448379 13627 tablet_bootstrap.cc:492] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:19.448812 13629 ts_tablet_manager.cc:1403] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.009s
I20260709 12:24:19.449028 13627 ts_tablet_manager.cc:1403] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260709 12:24:19.448624 13628 consensus_queue.cc:260] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.452023 13629 raft_consensus.cc:359] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.452706 13629 raft_consensus.cc:385] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.453011 13629 raft_consensus.cc:740] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.453204 13627 raft_consensus.cc:359] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:19.453984 13629 consensus_queue.cc:260] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.454090 13611 heartbeater.cc:499] Master 127.3.7.190:36393 was elected leader, sending a full tablet report...
I20260709 12:24:19.454145 13627 raft_consensus.cc:385] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.454872 13627 raft_consensus.cc:740] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.455705 13628 ts_tablet_manager.cc:1434] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.005s
I20260709 12:24:19.456121 13627 consensus_queue.cc:260] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:19.456836 13628 tablet_bootstrap.cc:492] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.462687 13627 ts_tablet_manager.cc:1434] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:24:19.463521 13461 heartbeater.cc:499] Master 127.3.7.190:36393 was elected leader, sending a full tablet report...
I20260709 12:24:19.464282 13628 tablet_bootstrap.cc:654] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.471271 13627 tablet_bootstrap.cc:492] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:19.476918 13536 heartbeater.cc:499] Master 127.3.7.190:36393 was elected leader, sending a full tablet report...
I20260709 12:24:19.477422 13629 ts_tablet_manager.cc:1434] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.019s
I20260709 12:24:19.478534 13629 tablet_bootstrap.cc:492] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:19.482573 13627 tablet_bootstrap.cc:654] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.485131 13629 tablet_bootstrap.cc:654] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.486465 13635 raft_consensus.cc:493] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.487166 13635 raft_consensus.cc:515] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
W20260709 12:24:19.490350 13612 tablet.cc:2406] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:19.492841 13635 leader_election.cc:290] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:19.498744 13628 tablet_bootstrap.cc:492] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.499382 13628 ts_tablet_manager.cc:1403] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.019s
I20260709 12:24:19.502790 13628 raft_consensus.cc:359] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.503506 13628 raft_consensus.cc:385] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.503790 13628 raft_consensus.cc:740] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.504633 13628 consensus_queue.cc:260] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.507236 13628 ts_tablet_manager.cc:1434] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:24:19.508416 13628 tablet_bootstrap.cc:492] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.516134 13628 tablet_bootstrap.cc:654] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.522809 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
W20260709 12:24:19.535511 13401 leader_election.cc:343] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:19.540825 13382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:19.540621 13511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
W20260709 12:24:19.542551 13401 leader_election.cc:343] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.543110 13401 leader_election.cc:304] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5; no voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:19.543956 13629 tablet_bootstrap.cc:492] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:19.544118 13635 raft_consensus.cc:2749] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:19.544579 13629 ts_tablet_manager.cc:1403] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.066s	user 0.041s	sys 0.015s
I20260709 12:24:19.546053 13628 tablet_bootstrap.cc:492] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.546638 13628 ts_tablet_manager.cc:1403] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.009s
I20260709 12:24:19.548115 13629 raft_consensus.cc:359] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.548993 13629 raft_consensus.cc:385] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.549305 13629 raft_consensus.cc:740] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.550222 13628 raft_consensus.cc:359] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.550145 13629 consensus_queue.cc:260] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.551026 13628 raft_consensus.cc:385] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.551432 13628 raft_consensus.cc:740] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.552701 13629 ts_tablet_manager.cc:1434] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:24:19.552335 13628 consensus_queue.cc:260] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.553844 13629 tablet_bootstrap.cc:492] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:19.555220 13628 ts_tablet_manager.cc:1434] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 12:24:19.556340 13628 tablet_bootstrap.cc:492] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.543330 13627 tablet_bootstrap.cc:492] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:19.559381 13627 ts_tablet_manager.cc:1403] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.014s
I20260709 12:24:19.561580 13629 tablet_bootstrap.cc:654] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.562750 13627 raft_consensus.cc:359] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.563562 13627 raft_consensus.cc:385] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.563850 13627 raft_consensus.cc:740] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.564512 13628 tablet_bootstrap.cc:654] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.565740 13627 consensus_queue.cc:260] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.570366 13627 ts_tablet_manager.cc:1434] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:24:19.571451 13627 tablet_bootstrap.cc:492] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:19.573596 13629 tablet_bootstrap.cc:492] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:19.574147 13629 ts_tablet_manager.cc:1403] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:24:19.574652 13628 tablet_bootstrap.cc:492] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.575227 13628 ts_tablet_manager.cc:1403] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 12:24:19.577149 13629 raft_consensus.cc:359] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.577936 13629 raft_consensus.cc:385] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.578272 13629 raft_consensus.cc:740] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.578064 13628 raft_consensus.cc:359] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.578826 13628 raft_consensus.cc:385] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.579152 13628 raft_consensus.cc:740] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.579097 13629 consensus_queue.cc:260] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.579982 13627 tablet_bootstrap.cc:654] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.580816 13628 consensus_queue.cc:260] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.581591 13629 ts_tablet_manager.cc:1434] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:19.583227 13629 tablet_bootstrap.cc:492] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:19.585944 13628 ts_tablet_manager.cc:1434] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:24:19.587112 13628 tablet_bootstrap.cc:492] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.591461 13627 tablet_bootstrap.cc:492] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:19.591467 13629 tablet_bootstrap.cc:654] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.592262 13627 ts_tablet_manager.cc:1403] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:24:19.593854 13628 tablet_bootstrap.cc:654] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.595961 13627 raft_consensus.cc:359] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.597026 13627 raft_consensus.cc:385] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.597404 13627 raft_consensus.cc:740] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.598763 13627 consensus_queue.cc:260] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.602306 13627 ts_tablet_manager.cc:1434] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:24:19.603672 13627 tablet_bootstrap.cc:492] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:19.611361 13628 tablet_bootstrap.cc:492] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.611438 13629 tablet_bootstrap.cc:492] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:19.612134 13628 ts_tablet_manager.cc:1403] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:24:19.612234 13629 ts_tablet_manager.cc:1403] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.006s
I20260709 12:24:19.612689 13627 tablet_bootstrap.cc:654] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.615504 13628 raft_consensus.cc:359] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:19.616585 13628 raft_consensus.cc:385] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.616353 13629 raft_consensus.cc:359] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.617060 13628 raft_consensus.cc:740] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.617252 13629 raft_consensus.cc:385] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.617673 13629 raft_consensus.cc:740] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.618153 13628 consensus_queue.cc:260] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:19.618583 13629 consensus_queue.cc:260] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.621440 13628 ts_tablet_manager.cc:1434] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:19.622859 13628 tablet_bootstrap.cc:492] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.624013 13633 raft_consensus.cc:493] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.624549 13633 raft_consensus.cc:515] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:19.625946 13629 ts_tablet_manager.cc:1434] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:24:19.627130 13629 tablet_bootstrap.cc:492] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:19.627279 13633 leader_election.cc:290] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:19.630802 13634 raft_consensus.cc:493] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.631395 13634 raft_consensus.cc:515] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.631814 13628 tablet_bootstrap.cc:654] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.631970 13627 tablet_bootstrap.cc:492] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:19.632702 13627 ts_tablet_manager.cc:1403] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 12:24:19.633843 13629 tablet_bootstrap.cc:654] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.635987 13627 raft_consensus.cc:359] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.636883 13627 raft_consensus.cc:385] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.637275 13627 raft_consensus.cc:740] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.638255 13627 consensus_queue.cc:260] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.642793 13634 leader_election.cc:290] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.643913 13627 ts_tablet_manager.cc:1434] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:24:19.645251 13627 tablet_bootstrap.cc:492] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:19.654217 13627 tablet_bootstrap.cc:654] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.655891 13633 raft_consensus.cc:493] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.656538 13633 raft_consensus.cc:515] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.659278 13633 leader_election.cc:290] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:19.691756 13634 raft_consensus.cc:493] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.692654 13634 raft_consensus.cc:515] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.695760 13634 leader_election.cc:290] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.697702 13633 raft_consensus.cc:493] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.698720 13633 raft_consensus.cc:515] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.701333 13633 leader_election.cc:290] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:19.737995 13635 raft_consensus.cc:493] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.738966 13635 raft_consensus.cc:515] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.742102 13635 leader_election.cc:290] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.745498 13511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
W20260709 12:24:19.758365 13401 leader_election.cc:343] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.773545 13633 raft_consensus.cc:493] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.774413 13633 raft_consensus.cc:515] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.777392 13633 leader_election.cc:290] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:19.779325 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:19.780292 13585 raft_consensus.cc:2468] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 0.
I20260709 12:24:19.790380 13401 leader_election.cc:304] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:19.797326 13627 tablet_bootstrap.cc:492] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:19.797477 13628 tablet_bootstrap.cc:492] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.831950 13628 ts_tablet_manager.cc:1403] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.209s	user 0.053s	sys 0.096s
I20260709 12:24:19.833613 13627 ts_tablet_manager.cc:1403] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.188s	user 0.055s	sys 0.088s
I20260709 12:24:19.836258 13634 raft_consensus.cc:493] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.840309 13628 raft_consensus.cc:359] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.842031 13628 raft_consensus.cc:385] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.841719 13634 raft_consensus.cc:515] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.842396 13628 raft_consensus.cc:740] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.845244 13634 leader_election.cc:290] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.845435 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:19.836927 13635 raft_consensus.cc:2804] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:19.847004 13635 raft_consensus.cc:493] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.846220 13627 raft_consensus.cc:359] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.847568 13635 raft_consensus.cc:3060] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.847725 13627 raft_consensus.cc:385] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.848394 13627 raft_consensus.cc:740] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.849701 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcb5d0265e749b0b1ed8928e970cde2" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:19.849838 13627 consensus_queue.cc:260] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
W20260709 12:24:19.853019 13476 leader_election.cc:343] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.853636 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9475349e61c4760b9b47bcaecc3f167" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:19.854373 13628 consensus_queue.cc:260] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.839147 13629 tablet_bootstrap.cc:492] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:19.855546 13584 raft_consensus.cc:2468] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:19.856236 13629 ts_tablet_manager.cc:1403] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.229s	user 0.075s	sys 0.097s
W20260709 12:24:19.856627 13476 leader_election.cc:343] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.862111 13476 leader_election.cc:304] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:19.861989 13629 raft_consensus.cc:359] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.863689 13634 raft_consensus.cc:2804] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:19.864267 13634 raft_consensus.cc:493] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.864706 13634 raft_consensus.cc:3060] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.870936 13659 raft_consensus.cc:493] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.872071 13659 raft_consensus.cc:515] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.877533 13628 ts_tablet_manager.cc:1434] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.005s
I20260709 12:24:19.863157 13629 raft_consensus.cc:385] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.880010 13629 raft_consensus.cc:740] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.881825 13627 ts_tablet_manager.cc:1434] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.022s
I20260709 12:24:19.884122 13627 tablet_bootstrap.cc:492] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:19.885243 13628 tablet_bootstrap.cc:492] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:19.886328 13629 consensus_queue.cc:260] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.888268 13436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.888763 13435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcb5d0265e749b0b1ed8928e970cde2" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.889703 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:19.890815 13584 raft_consensus.cc:2468] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:19.889794 13435 raft_consensus.cc:2468] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:19.888314 13659 leader_election.cc:290] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.892534 13476 leader_election.cc:304] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:19.895622 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9475349e61c4760b9b47bcaecc3f167" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.896262 13659 raft_consensus.cc:2804] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:19.896732 13659 raft_consensus.cc:493] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.896662 13434 raft_consensus.cc:2468] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:19.897320 13659 raft_consensus.cc:3060] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.902287 13627 tablet_bootstrap.cc:654] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.904232 13511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:19.906682 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:19.908898 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:19.913388 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:19.915032 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
W20260709 12:24:19.919526 13476 leader_election.cc:343] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.920107 13476 leader_election.cc:304] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:19.920751 13629 ts_tablet_manager.cc:1434] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.016s
I20260709 12:24:19.923308 13629 tablet_bootstrap.cc:492] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:19.923671 13660 raft_consensus.cc:2749] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:19.917640 13550 leader_election.cc:343] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:19.925532 13550 leader_election.cc:343] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:19.926368 13550 leader_election.cc:343] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.926890 13635 raft_consensus.cc:515] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.928318 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.929162 13433 raft_consensus.cc:2468] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 0.
I20260709 12:24:19.923064 13476 leader_election.cc:304] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:19.930404 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:19.931502 13660 raft_consensus.cc:2804] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:19.931946 13660 raft_consensus.cc:493] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.906841 13634 raft_consensus.cc:515] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.932300 13660 raft_consensus.cc:3060] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:19.932305 13401 leader_election.cc:343] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.933669 13550 leader_election.cc:304] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
W20260709 12:24:19.931026 13476 leader_election.cc:343] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.934999 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.935413 13435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.935703 13633 raft_consensus.cc:2804] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:19.936033 13434 raft_consensus.cc:2393] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 488176bf4fdd4537a6953ae238bb7441 in current term 1: Already voted for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in this term.
I20260709 12:24:19.936101 13633 raft_consensus.cc:493] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.936699 13633 raft_consensus.cc:3060] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.936784 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.938212 13629 tablet_bootstrap.cc:654] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.938831 13659 raft_consensus.cc:515] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.941452 13510 raft_consensus.cc:2393] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 488176bf4fdd4537a6953ae238bb7441 in current term 1: Already voted for candidate fa1ef25482c44f83be85e85166ffe7a1 in this term.
I20260709 12:24:19.943708 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:19.943234 13659 leader_election.cc:290] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.948669 13628 tablet_bootstrap.cc:654] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:19.954320 13633 raft_consensus.cc:515] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:19.955480 13634 leader_election.cc:290] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.956600 13633 leader_election.cc:290] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:19.958266 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcb5d0265e749b0b1ed8928e970cde2" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
W20260709 12:24:19.958444 13476 leader_election.cc:343] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.958933 13433 raft_consensus.cc:3060] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.960160 13635 leader_election.cc:290] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.966012 13660 raft_consensus.cc:515] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.959177 13634 raft_consensus.cc:493] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.967918 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:19.970649 13634 raft_consensus.cc:515] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.968828 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:19.972226 13660 leader_election.cc:290] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.970860 13434 raft_consensus.cc:3060] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.974509 13435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9475349e61c4760b9b47bcaecc3f167" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:19.975063 13435 raft_consensus.cc:3060] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:19.975996 13627 tablet_bootstrap.cc:492] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:19.976635 13627 ts_tablet_manager.cc:1403] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.033s
W20260709 12:24:19.969777 13550 leader_election.cc:343] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.973006 13634 leader_election.cc:290] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:19.979562 13550 leader_election.cc:304] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:19.980367 13633 raft_consensus.cc:2749] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:19.968452 13433 raft_consensus.cc:2468] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:19.980611 13627 raft_consensus.cc:359] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.981041 13550 leader_election.cc:304] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:19.981511 13627 raft_consensus.cc:385] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:19.981930 13627 raft_consensus.cc:740] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:19.982084 13633 raft_consensus.cc:3060] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:19.982788 13550 leader_election.cc:343] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:19.983356 13550 leader_election.cc:304] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:19.983197 13627 consensus_queue.cc:260] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.986286 13476 leader_election.cc:304] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:19.987171 13634 raft_consensus.cc:2804] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:19.987717 13634 raft_consensus.cc:697] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:19.988317 13434 raft_consensus.cc:2468] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 1.
I20260709 12:24:19.989328 13628 tablet_bootstrap.cc:492] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:19.989063 13634 consensus_queue.cc:237] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.989964 13628 ts_tablet_manager.cc:1403] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.105s	user 0.029s	sys 0.007s
I20260709 12:24:19.991899 13435 raft_consensus.cc:2468] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:19.993173 13476 leader_election.cc:304] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:19.994099 13660 raft_consensus.cc:2804] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:19.993793 13628 raft_consensus.cc:359] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.994313 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:19.994870 13660 raft_consensus.cc:697] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:19.995322 13627 ts_tablet_manager.cc:1434] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:24:20.001233 13633 raft_consensus.cc:2749] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.001652 13627 tablet_bootstrap.cc:492] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:20.002308 13633 raft_consensus.cc:3060] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.001664 13629 tablet_bootstrap.cc:492] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:20.005748 13629 ts_tablet_manager.cc:1403] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.003s
I20260709 12:24:19.996341 13660 consensus_queue.cc:237] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.994881 13628 raft_consensus.cc:385] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.007817 13628 raft_consensus.cc:740] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.008702 13628 consensus_queue.cc:260] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:19.995236 13433 raft_consensus.cc:2468] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:20.011550 13629 raft_consensus.cc:359] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.012133 13476 leader_election.cc:304] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:20.012557 13629 raft_consensus.cc:385] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.012864 13629 raft_consensus.cc:740] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.014115 13627 tablet_bootstrap.cc:654] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.013072 13659 raft_consensus.cc:2804] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:20.019095 13659 raft_consensus.cc:493] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.014300 13629 consensus_queue.cc:260] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.019621 13659 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.020589 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.020360 13330 catalog_manager.cc:5697] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.021528 13629 ts_tablet_manager.cc:1434] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:24:20.023058 13629 tablet_bootstrap.cc:492] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:20.028266 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.030027 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcb5d0265e749b0b1ed8928e970cde2" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.030766 13583 raft_consensus.cc:3060] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.032944 13628 ts_tablet_manager.cc:1434] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.005s
I20260709 12:24:20.033408 13629 tablet_bootstrap.cc:654] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.034732 13628 tablet_bootstrap.cc:492] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:20.042546 13582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9475349e61c4760b9b47bcaecc3f167" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.044626 13582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:20.045608 13584 raft_consensus.cc:2468] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 1.
W20260709 12:24:20.046021 13550 leader_election.cc:343] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:20.046838 13550 leader_election.cc:304] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.047784 13664 raft_consensus.cc:2804] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.049342 13583 raft_consensus.cc:2468] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:20.037516 13659 raft_consensus.cc:515] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.054360 13659 leader_election.cc:290] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:20.057355 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:20.058370 13433 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.067628 13635 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.068269 13635 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.068605 13401 leader_election.cc:304] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.069962 13658 raft_consensus.cc:2804] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.070710 13635 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
W20260709 12:24:20.068491 13476 leader_election.cc:343] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:20.081259 13669 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.082120 13669 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.079519 13664 raft_consensus.cc:697] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:20.087489 13669 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:20.096225 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:20.096881 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.096776 13664 consensus_queue.cc:237] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:20.099082 13627 tablet_bootstrap.cc:492] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:20.099660 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:20.099886 13627 ts_tablet_manager.cc:1403] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.012s
W20260709 12:24:20.094591 13476 leader_election.cc:343] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:20.104995 13550 leader_election.cc:343] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:20.105195 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:20.108276 13435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.111420 13583 raft_consensus.cc:2468] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 0.
I20260709 12:24:20.107287 13633 raft_consensus.cc:2749] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.111981 13435 raft_consensus.cc:2468] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 0.
W20260709 12:24:20.108047 13401 leader_election.cc:343] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:20.108726 13476 leader_election.cc:343] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:20.112839 13628 tablet_bootstrap.cc:654] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.116987 13401 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.117523 13629 tablet_bootstrap.cc:492] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:20.118080 13629 ts_tablet_manager.cc:1403] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.014s
I20260709 12:24:20.118216 13635 raft_consensus.cc:2804] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:20.118645 13635 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.118991 13635 raft_consensus.cc:3060] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.120941 13433 raft_consensus.cc:2468] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:20.121592 13629 raft_consensus.cc:359] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:20.122431 13629 raft_consensus.cc:385] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.122723 13629 raft_consensus.cc:740] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.122929 13476 leader_election.cc:304] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:20.123462 13660 raft_consensus.cc:493] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.123728 13629 consensus_queue.cc:260] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:20.123960 13660 raft_consensus.cc:515] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.124876 13634 raft_consensus.cc:2804] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.125365 13634 raft_consensus.cc:697] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:20.110428 13658 raft_consensus.cc:697] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:20.126143 13660 leader_election.cc:290] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:20.126230 13634 consensus_queue.cc:237] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.127823 13658 consensus_queue.cc:237] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.131553 13629 ts_tablet_manager.cc:1434] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:24:20.132910 13629 tablet_bootstrap.cc:492] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:20.135003 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.135495 13585 raft_consensus.cc:2468] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:20.136667 13627 raft_consensus.cc:359] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.137977 13627 raft_consensus.cc:385] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.138571 13627 raft_consensus.cc:740] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.139873 13627 consensus_queue.cc:260] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.141353 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e2465e8ed04355896d0754343cdd4e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:20.142373 13583 raft_consensus.cc:2393] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1ef25482c44f83be85e85166ffe7a1 in current term 1: Already voted for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in this term.
I20260709 12:24:20.143405 13550 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.143497 13333 catalog_manager.cc:5697] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 0 to 1, leader changed from <none> to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.145848 13627 ts_tablet_manager.cc:1434] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.006s
I20260709 12:24:20.147981 13627 tablet_bootstrap.cc:492] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:20.148854 13476 leader_election.cc:304] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:20.150359 13664 raft_consensus.cc:2804] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:20.150604 13661 raft_consensus.cc:3060] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.150916 13664 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.151573 13664 raft_consensus.cc:3060] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.133602 13635 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.162833 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:20.164471 13661 raft_consensus.cc:2749] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:20.164566 13401 leader_election.cc:343] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:20.166726 13476 leader_election.cc:304] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:20.168736 13635 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:20.169764 13627 tablet_bootstrap.cc:654] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.172441 13634 raft_consensus.cc:2804] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.172613 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.173375 13634 raft_consensus.cc:697] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:20.174526 13634 consensus_queue.cc:237] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.177193 13628 tablet_bootstrap.cc:492] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:20.177744 13628 ts_tablet_manager.cc:1403] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.014s
I20260709 12:24:20.178301 13629 tablet_bootstrap.cc:654] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.181824 13628 raft_consensus.cc:359] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.182638 13627 tablet_bootstrap.cc:492] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:20.182667 13628 raft_consensus.cc:385] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.183219 13628 raft_consensus.cc:740] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.183490 13627 ts_tablet_manager.cc:1403] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.011s
I20260709 12:24:20.177708 13664 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.185250 13585 raft_consensus.cc:2393] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in current term 1: Already voted for candidate 488176bf4fdd4537a6953ae238bb7441 in this term.
I20260709 12:24:20.187153 13401 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5; no voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.189180 13635 raft_consensus.cc:2749] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.189319 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:20.189778 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:20.189397 13628 consensus_queue.cc:260] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.190407 13433 raft_consensus.cc:2393] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 488176bf4fdd4537a6953ae238bb7441 in current term 1: Already voted for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in this term.
I20260709 12:24:20.187135 13627 raft_consensus.cc:359] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.191139 13627 raft_consensus.cc:385] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:20.191231 13550 leader_election.cc:343] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:20.191766 13627 raft_consensus.cc:740] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.192309 13550 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.192863 13628 ts_tablet_manager.cc:1434] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:24:20.192623 13627 consensus_queue.cc:260] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.193225 13673 raft_consensus.cc:2749] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.191058 13664 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:20.194977 13628 tablet_bootstrap.cc:492] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:20.195576 13627 ts_tablet_manager.cc:1434] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:24:20.196936 13627 tablet_bootstrap.cc:492] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:20.195998 13332 catalog_manager.cc:5697] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.201269 13629 tablet_bootstrap.cc:492] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:20.203719 13629 ts_tablet_manager.cc:1403] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.008s
I20260709 12:24:20.204169 13627 tablet_bootstrap.cc:654] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.206800 13629 raft_consensus.cc:359] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.207921 13629 raft_consensus.cc:385] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.208271 13629 raft_consensus.cc:740] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.202596 13628 tablet_bootstrap.cc:654] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.209203 13629 consensus_queue.cc:260] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.215346 13629 ts_tablet_manager.cc:1434] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:24:20.216534 13629 tablet_bootstrap.cc:492] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:20.215907 13627 tablet_bootstrap.cc:492] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:20.217062 13627 ts_tablet_manager.cc:1403] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:24:20.220189 13627 raft_consensus.cc:359] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.221100 13627 raft_consensus.cc:385] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.221443 13627 raft_consensus.cc:740] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.222434 13627 consensus_queue.cc:260] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.225603 13627 ts_tablet_manager.cc:1434] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:20.229130 13629 tablet_bootstrap.cc:654] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:20.234543 13628 tablet_bootstrap.cc:492] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:20.235047 13628 ts_tablet_manager.cc:1403] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.009s
I20260709 12:24:20.235319 13629 tablet_bootstrap.cc:492] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:20.235864 13629 ts_tablet_manager.cc:1403] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:24:20.236016 13333 catalog_manager.cc:5697] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.237862 13628 raft_consensus.cc:359] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.238682 13628 raft_consensus.cc:385] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.238619 13629 raft_consensus.cc:359] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.239197 13628 raft_consensus.cc:740] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.239609 13629 raft_consensus.cc:385] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:20.239905 13629 raft_consensus.cc:740] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:20.240103 13628 consensus_queue.cc:260] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.242377 13628 ts_tablet_manager.cc:1434] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:20.238452 13333 catalog_manager.cc:5697] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.240717 13629 consensus_queue.cc:260] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.243747 13333 catalog_manager.cc:5697] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.245200 13629 ts_tablet_manager.cc:1434] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:20.343214 13634 raft_consensus.cc:493] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.343794 13634 raft_consensus.cc:515] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.345765 13634 leader_election.cc:290] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:20.346709 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.346994 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:20.347502 13433 raft_consensus.cc:2468] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:20.347697 13585 raft_consensus.cc:2468] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:20.348675 13476 leader_election.cc:304] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:20.349300 13634 raft_consensus.cc:2804] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:20.349619 13634 raft_consensus.cc:493] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.349942 13634 raft_consensus.cc:3060] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.355918 13634 raft_consensus.cc:515] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.357597 13634 leader_election.cc:290] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:20.358654 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:20.358989 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:20.359336 13433 raft_consensus.cc:3060] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.359717 13585 raft_consensus.cc:3060] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.364768 13433 raft_consensus.cc:2468] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:20.364884 13585 raft_consensus.cc:2468] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:20.366154 13476 leader_election.cc:304] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:20.366792 13634 raft_consensus.cc:2804] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.367288 13634 raft_consensus.cc:697] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:20.368141 13634 consensus_queue.cc:237] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.375155 13330 catalog_manager.cc:5697] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.400859 13585 raft_consensus.cc:3060] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.408198 13634 consensus_queue.cc:1048] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.421627 13661 consensus_queue.cc:1048] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.438262 13664 raft_consensus.cc:493] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.438936 13664 raft_consensus.cc:515] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.441495 13664 leader_election.cc:290] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:20.442183 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.442646 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:20.443007 13433 raft_consensus.cc:2468] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 0.
I20260709 12:24:20.443430 13510 raft_consensus.cc:2468] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 0.
I20260709 12:24:20.444250 13550 leader_election.cc:304] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:20.444870 13664 raft_consensus.cc:2804] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:20.445230 13664 raft_consensus.cc:493] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.445528 13664 raft_consensus.cc:3060] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.450493 13664 raft_consensus.cc:515] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.452152 13664 leader_election.cc:290] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:20.453063 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:20.453425 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:20.453614 13433 raft_consensus.cc:3060] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.454066 13510 raft_consensus.cc:3060] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.459156 13433 raft_consensus.cc:2468] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 1.
I20260709 12:24:20.460122 13661 raft_consensus.cc:493] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.460307 13550 leader_election.cc:304] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:20.460707 13510 raft_consensus.cc:2468] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 1.
I20260709 12:24:20.461123 13664 raft_consensus.cc:2804] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:20.460753 13661 raft_consensus.cc:515] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:20.461812 13664 raft_consensus.cc:697] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:20.462693 13664 consensus_queue.cc:237] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.463352 13661 leader_election.cc:290] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199), 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909)
I20260709 12:24:20.464098 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:20.464463 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.465284 13433 raft_consensus.cc:2393] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1ef25482c44f83be85e85166ffe7a1 in current term 1: Already voted for candidate 488176bf4fdd4537a6953ae238bb7441 in this term.
I20260709 12:24:20.466715 13476 leader_election.cc:304] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:20.467725 13661 raft_consensus.cc:3060] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.471513 13331 catalog_manager.cc:5697] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 0 to 1, leader changed from <none> to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:20.473733 13661 raft_consensus.cc:2749] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.491169 13664 raft_consensus.cc:493] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.491809 13664 raft_consensus.cc:515] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.493573 13664 leader_election.cc:290] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:20.494441 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.494642 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:20.495208 13433 raft_consensus.cc:2393] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 488176bf4fdd4537a6953ae238bb7441 in current term 1: Already voted for candidate fa1ef25482c44f83be85e85166ffe7a1 in this term.
I20260709 12:24:20.496307 13550 leader_election.cc:304] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:20.496984 13664 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.502849 13664 raft_consensus.cc:2749] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.509981 13661 consensus_queue.cc:1048] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.523500 13661 consensus_queue.cc:1048] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.526795 13664 consensus_queue.cc:1048] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.537294 13659 consensus_queue.cc:1048] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.540908 13661 consensus_queue.cc:1048] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:20.545964 13382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:20.550171 13661 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.551818 13664 consensus_queue.cc:1048] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.550817 13661 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:20.566642 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:20.567149 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:20.568081 13585 raft_consensus.cc:2393] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1ef25482c44f83be85e85166ffe7a1 in current term 1: Already voted for candidate 488176bf4fdd4537a6953ae238bb7441 in this term.
I20260709 12:24:20.567734 13434 raft_consensus.cc:3060] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.567253 13661 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:20.567833 13433 raft_consensus.cc:2393] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1ef25482c44f83be85e85166ffe7a1 in current term 1: Already voted for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in this term.
I20260709 12:24:20.576996 13476 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:20.580734 13661 raft_consensus.cc:3060] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:20.583809 13659 consensus_queue.cc:1048] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:20.591210 13661 raft_consensus.cc:2749] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:20.605763 13659 consensus_queue.cc:1048] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.644631 13635 consensus_queue.cc:1048] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.657531 13635 consensus_queue.cc:1048] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.855427 13659 consensus_queue.cc:1048] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:20.867713 13661 consensus_queue.cc:1048] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:21.011380 13664 consensus_queue.cc:1048] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:21.025089 13673 consensus_queue.cc:1048] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:24:21.549355 13382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:21.721287 13712 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.721843 13712 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.723779 13712 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:21.724624 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:21.724773 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:21.725267 13510 raft_consensus.cc:2468] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 1.
I20260709 12:24:21.725435 13585 raft_consensus.cc:2468] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 1.
I20260709 12:24:21.726449 13401 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:21.727083 13712 raft_consensus.cc:2804] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:21.727425 13712 raft_consensus.cc:493] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.727699 13712 raft_consensus.cc:3060] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.733378 13712 raft_consensus.cc:515] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.735162 13712 leader_election.cc:290] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:21.736151 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:21.736536 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabd02aceca3424dbd7e5f479734fcb0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:21.736756 13510 raft_consensus.cc:3060] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.737164 13585 raft_consensus.cc:3060] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.742133 13510 raft_consensus.cc:2468] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:21.742702 13585 raft_consensus.cc:2468] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:21.743455 13401 leader_election.cc:304] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:21.744318 13712 raft_consensus.cc:2804] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.745285 13712 raft_consensus.cc:697] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:21.745985 13712 consensus_queue.cc:237] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.754860 13330 catalog_manager.cc:5697] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.800352 13585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
mode: GRACEFUL
new_leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50958
I20260709 12:24:21.801034 13585 raft_consensus.cc:606] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Received request to transfer leadership to TS 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:21.822639 13510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
mode: GRACEFUL
new_leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:52030
I20260709 12:24:21.823220 13510 raft_consensus.cc:606] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Received request to transfer leadership to TS 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:21.828766 13659 raft_consensus.cc:993] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: : Instructing follower 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:21.829238 13634 raft_consensus.cc:1081] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Signalling peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:21.830868 13433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50058
I20260709 12:24:21.831425 13433 raft_consensus.cc:493] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.831815 13433 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.837574 13585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
mode: GRACEFUL
new_leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
 from {username='slave'} at 127.0.0.1:50958
I20260709 12:24:21.838268 13585 raft_consensus.cc:606] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Received request to transfer leadership to TS fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:21.838364 13433 raft_consensus.cc:515] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.840252 13433 leader_election.cc:290] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:21.841321 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:21.841882 13510 raft_consensus.cc:3055] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.842170 13510 raft_consensus.cc:740] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:21.842897 13510 consensus_queue.cc:260] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.844061 13510 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.843971 13509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
mode: GRACEFUL
new_leader_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:52030
I20260709 12:24:21.844717 13509 raft_consensus.cc:606] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Received request to transfer leadership to TS 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:21.850034 13510 raft_consensus.cc:2468] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:21.850927 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:21.851056 13401 leader_election.cc:304] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:21.851742 13585 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.852023 13712 raft_consensus.cc:2804] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.852527 13712 raft_consensus.cc:697] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:21.853286 13712 consensus_queue.cc:237] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.857987 13585 raft_consensus.cc:2468] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:21.861348 13330 catalog_manager.cc:5697] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 1 to 2, leader changed from fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130) to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.867558 13673 raft_consensus.cc:993] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: : Instructing follower fa1ef25482c44f83be85e85166ffe7a1 to start an election
I20260709 12:24:21.868165 13664 raft_consensus.cc:1081] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Signalling peer fa1ef25482c44f83be85e85166ffe7a1 to start an election
I20260709 12:24:21.869699 13510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
 from {username='slave'} at 127.0.0.1:52652
I20260709 12:24:21.870173 13510 raft_consensus.cc:493] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.870464 13510 raft_consensus.cc:3060] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.875888 13510 raft_consensus.cc:515] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.877607 13510 leader_election.cc:290] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 2 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:21.878697 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:21.878970 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f42c0cf5ca45d484d873062771a3a8" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:21.879484 13433 raft_consensus.cc:3060] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.879581 13585 raft_consensus.cc:3055] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.880033 13585 raft_consensus.cc:740] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:21.880942 13585 consensus_queue.cc:260] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.882375 13585 raft_consensus.cc:3060] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.888024 13433 raft_consensus.cc:2468] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 2.
I20260709 12:24:21.889561 13476 leader_election.cc:304] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:21.890419 13634 raft_consensus.cc:2804] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.890506 13585 raft_consensus.cc:2468] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 2.
I20260709 12:24:21.890895 13634 raft_consensus.cc:697] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:21.891868 13634 consensus_queue.cc:237] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.898401 13330 catalog_manager.cc:5697] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 1 to 2, leader changed from 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131) to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.950070 13659 raft_consensus.cc:993] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: : Instructing follower 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:21.950572 13634 raft_consensus.cc:1081] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Signalling peer 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:21.952245 13585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:50314
I20260709 12:24:21.952826 13585 raft_consensus.cc:493] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.953157 13585 raft_consensus.cc:3060] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.958626 13585 raft_consensus.cc:515] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.960795 13585 leader_election.cc:290] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 2 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:21.961668 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:21.962430 13433 raft_consensus.cc:3060] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.962488 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf49c79077d4d54b7504995830ad23e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:21.963201 13510 raft_consensus.cc:3055] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.963616 13510 raft_consensus.cc:740] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:21.964506 13510 consensus_queue.cc:260] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.965893 13510 raft_consensus.cc:3060] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.971153 13433 raft_consensus.cc:2468] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 2.
I20260709 12:24:21.972689 13550 leader_election.cc:304] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:21.973474 13664 raft_consensus.cc:2804] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.973891 13510 raft_consensus.cc:2468] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 2.
I20260709 12:24:21.974072 13664 raft_consensus.cc:697] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 2 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:21.975174 13664 consensus_queue.cc:237] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:21.983258 13330 catalog_manager.cc:5697] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 1 to 2, leader changed from fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130) to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:22.134721 13673 raft_consensus.cc:993] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: : Instructing follower 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:22.135416 13664 raft_consensus.cc:1081] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Signalling peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:22.137336 13433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50042
I20260709 12:24:22.137936 13433 raft_consensus.cc:493] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:22.138298 13433 raft_consensus.cc:3060] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.141070 13510 raft_consensus.cc:1275] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:22.143236 13712 consensus_queue.cc:1048] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:22.146654 13585 raft_consensus.cc:1275] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:22.147948 13433 raft_consensus.cc:515] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:22.148655 13713 consensus_queue.cc:1048] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:22.150786 13433 leader_election.cc:290] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Requested vote from peers 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:22.152151 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:22.152899 13510 raft_consensus.cc:3060] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.165570 13510 raft_consensus.cc:2468] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:22.166851 13401 leader_election.cc:304] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:22.167222 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4ce7abbf254a6fbc03dbeea9850383" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:22.168088 13583 raft_consensus.cc:3055] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:22.168454 13583 raft_consensus.cc:740] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:22.168605 13713 raft_consensus.cc:2804] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:22.169217 13713 raft_consensus.cc:697] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:22.169282 13583 consensus_queue.cc:260] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:22.170677 13583 raft_consensus.cc:3060] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.170315 13713 consensus_queue.cc:237] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } }
I20260709 12:24:22.179585 13583 raft_consensus.cc:2468] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:22.180703 13510 raft_consensus.cc:1240] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Rejecting Update request from peer 488176bf4fdd4537a6953ae238bb7441 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:22.192129 13331 catalog_manager.cc:5697] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 1 to 2, leader changed from 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131) to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:22.282192 13510 raft_consensus.cc:1275] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.283715 13713 consensus_queue.cc:1048] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.294162 13583 raft_consensus.cc:1275] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.295864 13713 consensus_queue.cc:1048] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.446139 13583 raft_consensus.cc:1275] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer fa1ef25482c44f83be85e85166ffe7a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.447777 13634 consensus_queue.cc:1048] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.453573 13433 raft_consensus.cc:1275] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Refusing update from remote peer fa1ef25482c44f83be85e85166ffe7a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.455416 13634 consensus_queue.cc:1048] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.494117 13510 raft_consensus.cc:1275] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.495648 13664 consensus_queue.cc:1048] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.506590 13433 raft_consensus.cc:1275] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.508740 13673 consensus_queue.cc:1048] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:22.580683 13583 raft_consensus.cc:1275] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.582350 13713 consensus_queue.cc:1048] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:22.594700 13510 raft_consensus.cc:1275] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:22.597081 13730 consensus_queue.cc:1048] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.874086 13333 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47390:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:24.876947 13333 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:24.931989 13422 tablet_service.cc:1511] Processing CreateTablet for tablet f84225ab11394f269d73a3abf64f751c (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:24.932967 13493 tablet_service.cc:1511] Processing CreateTablet for tablet f84225ab11394f269d73a3abf64f751c (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:24.933712 13422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84225ab11394f269d73a3abf64f751c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.934443 13493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84225ab11394f269d73a3abf64f751c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.934099 13572 tablet_service.cc:1511] Processing CreateTablet for tablet f84225ab11394f269d73a3abf64f751c (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:24.938558 13499 tablet_service.cc:1511] Processing CreateTablet for tablet 60225dc5aee746a3829866701714f1c7 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:24.938732 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 60225dc5aee746a3829866701714f1c7 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:24.939993 13499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60225dc5aee746a3829866701714f1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.940115 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60225dc5aee746a3829866701714f1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.947886 13572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84225ab11394f269d73a3abf64f751c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.948829 13498 tablet_service.cc:1511] Processing CreateTablet for tablet 2663c712388549fc84888c6f55292559 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:24.949672 13573 tablet_service.cc:1511] Processing CreateTablet for tablet 2663c712388549fc84888c6f55292559 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:24.950291 13498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2663c712388549fc84888c6f55292559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.951113 13573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2663c712388549fc84888c6f55292559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.960489 13423 tablet_service.cc:1511] Processing CreateTablet for tablet d8b6a9b4de5d4433813a7f8b6486187e (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:24.961977 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b6a9b4de5d4433813a7f8b6486187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.952565 13501 tablet_service.cc:1511] Processing CreateTablet for tablet 66b5ce8bed884538a834a25ded17ca70 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:24.960502 13500 tablet_service.cc:1511] Processing CreateTablet for tablet d8b6a9b4de5d4433813a7f8b6486187e (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:24.964587 13501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5ce8bed884538a834a25ded17ca70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.967689 13500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b6a9b4de5d4433813a7f8b6486187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.972266 13569 tablet_service.cc:1511] Processing CreateTablet for tablet d8b6a9b4de5d4433813a7f8b6486187e (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:24.974336 13569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b6a9b4de5d4433813a7f8b6486187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.973917 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 9344f3a002754802ac715f986f4ff26b (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:24.975782 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9344f3a002754802ac715f986f4ff26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.977142 13495 tablet_service.cc:1511] Processing CreateTablet for tablet 9344f3a002754802ac715f986f4ff26b (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:24.954380 13418 tablet_service.cc:1511] Processing CreateTablet for tablet 66b5ce8bed884538a834a25ded17ca70 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:24.981109 13418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5ce8bed884538a834a25ded17ca70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.985287 13575 tablet_service.cc:1511] Processing CreateTablet for tablet 9344f3a002754802ac715f986f4ff26b (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:24.955494 13568 tablet_service.cc:1511] Processing CreateTablet for tablet 66b5ce8bed884538a834a25ded17ca70 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:24.947147 13570 tablet_service.cc:1511] Processing CreateTablet for tablet 60225dc5aee746a3829866701714f1c7 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:24.956595 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 2663c712388549fc84888c6f55292559 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:24.990016 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2663c712388549fc84888c6f55292559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.995869 13497 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb8f6fcadbc496daefe749bbeaf2638 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:24.996950 13574 tablet_service.cc:1511] Processing CreateTablet for tablet 87767538766e40ebab186c49e35971e0 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:24.999373 13425 tablet_service.cc:1511] Processing CreateTablet for tablet c27d58c9237a4f68a5b763018bb200fd (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:25.000216 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 87767538766e40ebab186c49e35971e0 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:25.005002 13496 tablet_service.cc:1511] Processing CreateTablet for tablet c27d58c9237a4f68a5b763018bb200fd (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:25.008317 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb8f6fcadbc496daefe749bbeaf2638 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:25.014930 13571 tablet_service.cc:1511] Processing CreateTablet for tablet c27d58c9237a4f68a5b763018bb200fd (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:25.016733 13567 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb8f6fcadbc496daefe749bbeaf2638 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:24.994436 13494 tablet_service.cc:1511] Processing CreateTablet for tablet 87767538766e40ebab186c49e35971e0 (DEFAULT_TABLE table=soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:25.029701 13575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9344f3a002754802ac715f986f4ff26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.035812 13570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60225dc5aee746a3829866701714f1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.039791 13567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb8f6fcadbc496daefe749bbeaf2638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.979133 13495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9344f3a002754802ac715f986f4ff26b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.048380 13574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87767538766e40ebab186c49e35971e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.049656 13494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87767538766e40ebab186c49e35971e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.052372 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5ce8bed884538a834a25ded17ca70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.052891 13496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27d58c9237a4f68a5b763018bb200fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.069784 13571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27d58c9237a4f68a5b763018bb200fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.077876 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb8f6fcadbc496daefe749bbeaf2638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.079067 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27d58c9237a4f68a5b763018bb200fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.085136 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87767538766e40ebab186c49e35971e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.106159 13497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb8f6fcadbc496daefe749bbeaf2638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.107136 13757 tablet_bootstrap.cc:492] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.185520 13756 tablet_bootstrap.cc:492] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.193847 13757 tablet_bootstrap.cc:654] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.224336 13756 tablet_bootstrap.cc:654] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.253931 13754 tablet_bootstrap.cc:492] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.283149 13754 tablet_bootstrap.cc:654] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.291805 13756 tablet_bootstrap.cc:492] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.292424 13756 ts_tablet_manager.cc:1403] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.004s
I20260709 12:24:25.293474 13754 tablet_bootstrap.cc:492] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.294021 13754 ts_tablet_manager.cc:1403] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.008s
I20260709 12:24:25.295650 13757 tablet_bootstrap.cc:492] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.295560 13756 raft_consensus.cc:359] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.296481 13756 raft_consensus.cc:385] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.296782 13756 raft_consensus.cc:740] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.296741 13754 raft_consensus.cc:359] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.297557 13754 raft_consensus.cc:385] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.296222 13757 ts_tablet_manager.cc:1403] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.023s
I20260709 12:24:25.297892 13754 raft_consensus.cc:740] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.297739 13756 consensus_queue.cc:260] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.299289 13754 consensus_queue.cc:260] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.300253 13756 ts_tablet_manager.cc:1434] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:25.301554 13756 tablet_bootstrap.cc:492] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.304797 13757 raft_consensus.cc:359] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.305558 13757 raft_consensus.cc:385] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.305850 13757 raft_consensus.cc:740] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.309262 13757 consensus_queue.cc:260] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.311136 13757 ts_tablet_manager.cc:1434] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:24:25.308197 13756 tablet_bootstrap.cc:654] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.307869 13754 ts_tablet_manager.cc:1434] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 12:24:25.312450 13754 tablet_bootstrap.cc:492] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.320237 13757 tablet_bootstrap.cc:492] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.324295 13754 tablet_bootstrap.cc:654] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.326639 13756 tablet_bootstrap.cc:492] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.327283 13756 ts_tablet_manager.cc:1403] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 12:24:25.329365 13757 tablet_bootstrap.cc:654] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.331647 13756 raft_consensus.cc:359] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.332803 13756 raft_consensus.cc:385] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.333263 13756 raft_consensus.cc:740] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.334250 13756 consensus_queue.cc:260] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.336100 13754 tablet_bootstrap.cc:492] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.336684 13754 ts_tablet_manager.cc:1403] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.012s
I20260709 12:24:25.336802 13756 ts_tablet_manager.cc:1434] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:25.338349 13756 tablet_bootstrap.cc:492] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.339936 13757 tablet_bootstrap.cc:492] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.339989 13754 raft_consensus.cc:359] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.340627 13757 ts_tablet_manager.cc:1403] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 12:24:25.340900 13754 raft_consensus.cc:385] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.341229 13754 raft_consensus.cc:740] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.342006 13754 consensus_queue.cc:260] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.344496 13754 ts_tablet_manager.cc:1434] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:24:25.344399 13757 raft_consensus.cc:359] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.345372 13757 raft_consensus.cc:385] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.346169 13756 tablet_bootstrap.cc:654] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.346220 13757 raft_consensus.cc:740] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.347409 13757 consensus_queue.cc:260] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.345606 13754 tablet_bootstrap.cc:492] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.350083 13757 ts_tablet_manager.cc:1434] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:25.351231 13757 tablet_bootstrap.cc:492] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.357388 13739 raft_consensus.cc:493] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.358016 13739 raft_consensus.cc:515] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.360334 13739 leader_election.cc:290] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:25.361846 13754 tablet_bootstrap.cc:654] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.362380 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
W20260709 12:24:25.364212 13550 leader_election.cc:343] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.364499 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
W20260709 12:24:25.366062 13550 leader_election.cc:343] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.367041 13550 leader_election.cc:304] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:25.371232 13756 tablet_bootstrap.cc:492] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.372192 13756 ts_tablet_manager.cc:1403] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.007s
I20260709 12:24:25.374011 13739 raft_consensus.cc:2749] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.376701 13756 raft_consensus.cc:359] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.377787 13756 raft_consensus.cc:385] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.378172 13756 raft_consensus.cc:740] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.379170 13756 consensus_queue.cc:260] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.381340 13757 tablet_bootstrap.cc:654] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.382448 13756 ts_tablet_manager.cc:1434] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:24:25.383905 13756 tablet_bootstrap.cc:492] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.388394 13754 tablet_bootstrap.cc:492] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.389032 13754 ts_tablet_manager.cc:1403] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.006s
I20260709 12:24:25.391497 13756 tablet_bootstrap.cc:654] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.392266 13754 raft_consensus.cc:359] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.393092 13754 raft_consensus.cc:385] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.393394 13754 raft_consensus.cc:740] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.394263 13754 consensus_queue.cc:260] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.397508 13754 ts_tablet_manager.cc:1434] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:25.400126 13754 tablet_bootstrap.cc:492] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.401402 13757 tablet_bootstrap.cc:492] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.401968 13757 ts_tablet_manager.cc:1403] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.009s
I20260709 12:24:25.405059 13757 raft_consensus.cc:359] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.405809 13757 raft_consensus.cc:385] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.406144 13757 raft_consensus.cc:740] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.406984 13757 consensus_queue.cc:260] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.409240 13754 tablet_bootstrap.cc:654] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.409525 13757 ts_tablet_manager.cc:1434] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:24:25.410588 13757 tablet_bootstrap.cc:492] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.414608 13756 tablet_bootstrap.cc:492] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.415179 13756 ts_tablet_manager.cc:1403] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.005s
I20260709 12:24:25.415433 13754 tablet_bootstrap.cc:492] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.415930 13754 ts_tablet_manager.cc:1403] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 12:24:25.417104 13757 tablet_bootstrap.cc:654] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.418426 13756 raft_consensus.cc:359] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.418738 13754 raft_consensus.cc:359] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.419234 13756 raft_consensus.cc:385] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.419503 13754 raft_consensus.cc:385] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.419633 13756 raft_consensus.cc:740] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.420089 13754 raft_consensus.cc:740] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.420950 13754 consensus_queue.cc:260] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.423501 13754 ts_tablet_manager.cc:1434] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:25.424446 13754 tablet_bootstrap.cc:492] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.421114 13756 consensus_queue.cc:260] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.425860 13757 tablet_bootstrap.cc:492] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.427826 13756 ts_tablet_manager.cc:1434] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 12:24:25.428892 13756 tablet_bootstrap.cc:492] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.429636 13757 ts_tablet_manager.cc:1403] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:24:25.431118 13754 tablet_bootstrap.cc:654] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.433081 13757 raft_consensus.cc:359] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.436805 13757 raft_consensus.cc:385] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.437150 13757 raft_consensus.cc:740] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.438090 13757 consensus_queue.cc:260] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.440177 13756 tablet_bootstrap.cc:654] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.440757 13757 ts_tablet_manager.cc:1434] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:24:25.441955 13757 tablet_bootstrap.cc:492] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.451638 13757 tablet_bootstrap.cc:654] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.458546 13755 raft_consensus.cc:493] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.459120 13755 raft_consensus.cc:515] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.459597 13754 tablet_bootstrap.cc:492] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.460136 13754 ts_tablet_manager.cc:1403] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.013s
I20260709 12:24:25.461328 13755 leader_election.cc:290] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.463075 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.463374 13754 raft_consensus.cc:359] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.464148 13754 raft_consensus.cc:385] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.464416 13754 raft_consensus.cc:740] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.463093 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
W20260709 12:24:25.464722 13476 leader_election.cc:343] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.465219 13754 consensus_queue.cc:260] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
W20260709 12:24:25.466058 13476 leader_election.cc:343] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.466527 13476 leader_election.cc:304] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:25.466717 13757 tablet_bootstrap.cc:492] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.467235 13755 raft_consensus.cc:2749] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:25.467803 13754 ts_tablet_manager.cc:1434] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:25.468119 13757 ts_tablet_manager.cc:1403] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:24:25.469367 13754 tablet_bootstrap.cc:492] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.469478 13756 tablet_bootstrap.cc:492] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.470124 13756 ts_tablet_manager.cc:1403] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.005s
I20260709 12:24:25.471208 13757 raft_consensus.cc:359] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.472009 13757 raft_consensus.cc:385] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.472301 13757 raft_consensus.cc:740] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.473116 13757 consensus_queue.cc:260] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.475447 13757 ts_tablet_manager.cc:1434] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:25.475602 13756 raft_consensus.cc:359] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.476457 13757 tablet_bootstrap.cc:492] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.478654 13756 raft_consensus.cc:385] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.479041 13754 tablet_bootstrap.cc:654] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.479063 13756 raft_consensus.cc:740] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.480134 13756 consensus_queue.cc:260] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.483767 13757 tablet_bootstrap.cc:654] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.485217 13754 tablet_bootstrap.cc:492] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.485728 13754 ts_tablet_manager.cc:1403] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 12:24:25.485975 13756 ts_tablet_manager.cc:1434] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:24:25.487159 13756 tablet_bootstrap.cc:492] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.488822 13754 raft_consensus.cc:359] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.489574 13754 raft_consensus.cc:385] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.489861 13754 raft_consensus.cc:740] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.490710 13754 consensus_queue.cc:260] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.493057 13754 ts_tablet_manager.cc:1434] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:25.494056 13754 tablet_bootstrap.cc:492] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.498528 13755 raft_consensus.cc:493] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.499357 13755 raft_consensus.cc:515] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.500315 13756 tablet_bootstrap.cc:654] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.500929 13757 tablet_bootstrap.cc:492] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.501385 13757 ts_tablet_manager.cc:1403] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.012s
I20260709 12:24:25.501540 13755 leader_election.cc:290] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.502015 13736 raft_consensus.cc:493] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.502504 13736 raft_consensus.cc:515] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.504875 13736 leader_election.cc:290] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.504716 13757 raft_consensus.cc:359] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.505978 13757 raft_consensus.cc:385] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.506371 13757 raft_consensus.cc:740] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.505897 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b6a9b4de5d4433813a7f8b6486187e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.506978 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60225dc5aee746a3829866701714f1c7" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.507573 13433 raft_consensus.cc:2468] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.507375 13757 consensus_queue.cc:260] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
W20260709 12:24:25.508072 13476 leader_election.cc:343] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.508623 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b6a9b4de5d4433813a7f8b6486187e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.509254 13434 raft_consensus.cc:2468] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.509595 13754 tablet_bootstrap.cc:654] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.505729 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60225dc5aee746a3829866701714f1c7" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.513010 13757 ts_tablet_manager.cc:1434] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:24:25.514053 13756 tablet_bootstrap.cc:492] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.514195 13757 tablet_bootstrap.cc:492] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.514662 13756 ts_tablet_manager.cc:1403] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 12:24:25.517843 13756 raft_consensus.cc:359] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.518684 13756 raft_consensus.cc:385] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.519017 13756 raft_consensus.cc:740] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.519857 13756 consensus_queue.cc:260] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.513841 13476 leader_election.cc:304] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.521741 13756 ts_tablet_manager.cc:1434] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:24:25.522819 13756 tablet_bootstrap.cc:492] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.523792 13755 raft_consensus.cc:2804] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.524253 13755 raft_consensus.cc:493] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.524609 13755 raft_consensus.cc:3060] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.525750 13757 tablet_bootstrap.cc:654] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.529357 13476 leader_election.cc:304] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:25.530370 13736 raft_consensus.cc:2804] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.531028 13756 tablet_bootstrap.cc:654] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.531224 13736 raft_consensus.cc:493] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.531903 13736 raft_consensus.cc:3060] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.538014 13758 raft_consensus.cc:493] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.538635 13476 leader_election.cc:343] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.538597 13758 raft_consensus.cc:515] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.541698 13757 tablet_bootstrap.cc:492] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.542459 13736 raft_consensus.cc:515] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.549015 13757 ts_tablet_manager.cc:1403] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.011s
I20260709 12:24:25.549316 13758 leader_election.cc:290] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.545651 13756 tablet_bootstrap.cc:492] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.550529 13736 leader_election.cc:290] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.550715 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84225ab11394f269d73a3abf64f751c" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:25.552148 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b6a9b4de5d4433813a7f8b6486187e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.552793 13434 raft_consensus.cc:3060] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.553524 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b6a9b4de5d4433813a7f8b6486187e" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.554275 13757 raft_consensus.cc:359] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.555287 13757 raft_consensus.cc:385] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.555718 13757 raft_consensus.cc:740] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.557065 13758 raft_consensus.cc:493] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.556751 13757 consensus_queue.cc:260] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.557636 13758 raft_consensus.cc:515] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.552966 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84225ab11394f269d73a3abf64f751c" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.558951 13583 raft_consensus.cc:2468] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 0.
W20260709 12:24:25.559759 13401 leader_election.cc:343] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.560127 13757 ts_tablet_manager.cc:1434] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:24:25.560592 13401 leader_election.cc:304] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:25.561520 13757 tablet_bootstrap.cc:492] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.561820 13743 raft_consensus.cc:2804] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.562304 13743 raft_consensus.cc:493] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.562604 13758 leader_election.cc:290] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.562647 13743 raft_consensus.cc:3060] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.566074 13754 tablet_bootstrap.cc:492] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.567418 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:25.567646 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.568188 13510 raft_consensus.cc:2468] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 0.
I20260709 12:24:25.568331 13583 raft_consensus.cc:2468] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 0.
I20260709 12:24:25.569414 13736 raft_consensus.cc:493] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.569717 13401 leader_election.cc:304] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:25.570106 13757 tablet_bootstrap.cc:654] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.569898 13736 raft_consensus.cc:515] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.576721 13743 raft_consensus.cc:515] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.577961 13758 raft_consensus.cc:2804] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.578339 13758 raft_consensus.cc:493] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.578703 13736 leader_election.cc:290] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.570727 13754 ts_tablet_manager.cc:1403] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.015s
I20260709 12:24:25.580576 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84225ab11394f269d73a3abf64f751c" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.581218 13583 raft_consensus.cc:3060] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.581326 13434 raft_consensus.cc:2468] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
W20260709 12:24:25.572284 13476 leader_election.cc:343] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.551117 13756 ts_tablet_manager.cc:1403] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 12:24:25.580624 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84225ab11394f269d73a3abf64f751c" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:25.584113 13755 raft_consensus.cc:515] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.586181 13755 leader_election.cc:290] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.579043 13743 leader_election.cc:290] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.586766 13756 raft_consensus.cc:359] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.578693 13758 raft_consensus.cc:3060] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.589535 13476 leader_election.cc:304] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 488176bf4fdd4537a6953ae238bb7441
W20260709 12:24:25.590610 13382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:25.590461 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.591125 13736 raft_consensus.cc:2804] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:25.591853 13401 leader_election.cc:343] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.591866 13757 tablet_bootstrap.cc:492] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.593004 13757 ts_tablet_manager.cc:1403] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.002s
I20260709 12:24:25.593087 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.593768 13585 raft_consensus.cc:2468] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.593798 13754 raft_consensus.cc:359] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.594431 13754 raft_consensus.cc:385] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.594734 13754 raft_consensus.cc:740] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.594951 13736 raft_consensus.cc:697] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:25.595489 13754 consensus_queue.cc:260] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.587692 13756 raft_consensus.cc:385] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.596459 13756 raft_consensus.cc:740] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.596699 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60225dc5aee746a3829866701714f1c7" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.597414 13434 raft_consensus.cc:3060] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.597909 13754 ts_tablet_manager.cc:1434] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:24:25.597522 13756 consensus_queue.cc:260] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.597689 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60225dc5aee746a3829866701714f1c7" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.599078 13754 tablet_bootstrap.cc:492] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.598942 13476 leader_election.cc:304] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.595757 13757 raft_consensus.cc:359] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.596131 13736 consensus_queue.cc:237] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.599737 13757 raft_consensus.cc:385] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.600082 13757 raft_consensus.cc:740] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.600765 13757 consensus_queue.cc:260] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.602816 13757 ts_tablet_manager.cc:1434] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:24:25.606472 13756 ts_tablet_manager.cc:1434] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:24:25.607568 13756 tablet_bootstrap.cc:492] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.611809 13782 raft_consensus.cc:2804] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.612332 13782 raft_consensus.cc:493] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.612704 13782 raft_consensus.cc:3060] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.612481 13583 raft_consensus.cc:2468] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 1.
I20260709 12:24:25.616593 13401 leader_election.cc:304] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:25.618974 13743 raft_consensus.cc:2804] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.619578 13743 raft_consensus.cc:697] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:25.620914 13743 consensus_queue.cc:237] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.621544 13757 tablet_bootstrap.cc:492] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: Bootstrap starting.
I20260709 12:24:25.622267 13754 tablet_bootstrap.cc:654] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:25.619628 13476 leader_election.cc:343] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:25.624320 13476 leader_election.cc:343] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.627144 13782 raft_consensus.cc:515] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.632652 13782 leader_election.cc:290] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.632827 13754 tablet_bootstrap.cc:492] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.630657 13756 tablet_bootstrap.cc:654] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.633409 13754 ts_tablet_manager.cc:1403] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:24:25.629765 13757 tablet_bootstrap.cc:654] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.633495 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.635851 13331 catalog_manager.cc:5697] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.636689 13434 raft_consensus.cc:2468] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.638375 13754 raft_consensus.cc:359] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.639384 13754 raft_consensus.cc:385] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.639736 13754 raft_consensus.cc:740] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.640641 13754 consensus_queue.cc:260] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.641065 13583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.641871 13583 raft_consensus.cc:3060] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:25.644302 13476 leader_election.cc:343] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:25.645061 13476 leader_election.cc:304] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:25.645376 13756 tablet_bootstrap.cc:492] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.645898 13736 raft_consensus.cc:2804] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.646024 13756 ts_tablet_manager.cc:1403] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.004s
I20260709 12:24:25.647310 13736 raft_consensus.cc:697] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:25.648375 13736 consensus_queue.cc:237] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.651038 13756 raft_consensus.cc:359] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.652002 13756 raft_consensus.cc:385] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.652328 13756 raft_consensus.cc:740] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.653146 13756 consensus_queue.cc:260] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.656093 13754 ts_tablet_manager.cc:1434] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.002s
I20260709 12:24:25.656450 13782 raft_consensus.cc:493] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.657148 13754 tablet_bootstrap.cc:492] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Bootstrap starting.
I20260709 12:24:25.630579 13758 raft_consensus.cc:515] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.656916 13782 raft_consensus.cc:515] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.658970 13782 leader_election.cc:290] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.665387 13756 ts_tablet_manager.cc:1434] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:24:25.659193 13330 catalog_manager.cc:5697] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.669734 13756 tablet_bootstrap.cc:492] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: Bootstrap starting.
I20260709 12:24:25.671487 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.671820 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.672358 13584 raft_consensus.cc:2468] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.672811 13434 raft_consensus.cc:2468] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.661106 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.659080 13758 leader_election.cc:290] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.674645 13585 raft_consensus.cc:3060] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.675572 13476 leader_election.cc:304] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.676746 13782 raft_consensus.cc:2804] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.677409 13782 raft_consensus.cc:493] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.677979 13782 raft_consensus.cc:3060] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.663100 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:25.679149 13509 raft_consensus.cc:3060] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.682085 13756 tablet_bootstrap.cc:654] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.687963 13754 tablet_bootstrap.cc:654] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:25.700320 13782 raft_consensus.cc:515] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.701079 13754 tablet_bootstrap.cc:492] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: No bootstrap required, opened a new log
I20260709 12:24:25.701069 13585 raft_consensus.cc:2468] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 1.
I20260709 12:24:25.701941 13754 ts_tablet_manager.cc:1403] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.007s
I20260709 12:24:25.702700 13401 leader_election.cc:304] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:25.703631 13739 raft_consensus.cc:493] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.703773 13789 raft_consensus.cc:2804] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.704260 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.704195 13739 raft_consensus.cc:515] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.705090 13434 raft_consensus.cc:3060] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.705317 13756 tablet_bootstrap.cc:492] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: No bootstrap required, opened a new log
I20260709 12:24:25.705907 13756 ts_tablet_manager.cc:1403] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 12:24:25.702726 13782 leader_election.cc:290] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.704483 13789 raft_consensus.cc:697] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:25.707192 13739 leader_election.cc:290] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:25.705724 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.707945 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.708293 13584 raft_consensus.cc:3060] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.708673 13433 raft_consensus.cc:2468] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 0.
I20260709 12:24:25.708217 13789 consensus_queue.cc:237] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.708961 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:25.710157 13550 leader_election.cc:304] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:25.710141 13510 raft_consensus.cc:2468] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 0.
I20260709 12:24:25.711045 13782 raft_consensus.cc:493] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.711683 13782 raft_consensus.cc:515] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.712527 13739 raft_consensus.cc:2804] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.712997 13739 raft_consensus.cc:493] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.713351 13739 raft_consensus.cc:3060] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.715798 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9344f3a002754802ac715f986f4ff26b" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.716454 13433 raft_consensus.cc:2468] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.717532 13476 leader_election.cc:304] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.718684 13736 raft_consensus.cc:2804] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.719003 13782 leader_election.cc:290] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.719183 13736 raft_consensus.cc:493] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.720279 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9344f3a002754802ac715f986f4ff26b" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.719849 13736 raft_consensus.cc:3060] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.720458 13754 raft_consensus.cc:359] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.720971 13585 raft_consensus.cc:2468] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.721338 13754 raft_consensus.cc:385] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.722282 13509 raft_consensus.cc:2468] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 1.
I20260709 12:24:25.721644 13754 raft_consensus.cc:740] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.723989 13583 raft_consensus.cc:2468] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.723877 13754 consensus_queue.cc:260] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.725286 13476 leader_election.cc:304] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:25.726176 13754 ts_tablet_manager.cc:1434] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:24:25.726517 13782 raft_consensus.cc:2804] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.727108 13782 raft_consensus.cc:697] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:25.728600 13782 consensus_queue.cc:237] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.736037 13434 raft_consensus.cc:2468] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.737798 13757 tablet_bootstrap.cc:492] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: No bootstrap required, opened a new log
I20260709 12:24:25.737721 13476 leader_election.cc:304] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.738380 13757 ts_tablet_manager.cc:1403] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.033s
I20260709 12:24:25.738670 13755 raft_consensus.cc:2804] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.746256 13757 raft_consensus.cc:359] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.745584 13739 raft_consensus.cc:515] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.747931 13757 raft_consensus.cc:385] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.750705 13757 raft_consensus.cc:740] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.743795 13756 raft_consensus.cc:359] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.751784 13756 raft_consensus.cc:385] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:25.752074 13756 raft_consensus.cc:740] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Initialized, Role: FOLLOWER
I20260709 12:24:25.752871 13757 consensus_queue.cc:260] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.755259 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.756104 13434 raft_consensus.cc:3060] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.757069 13756 consensus_queue.cc:260] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.754272 13584 raft_consensus.cc:2468] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.765604 13739 leader_election.cc:290] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:25.759744 13736 raft_consensus.cc:515] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.767237 13755 raft_consensus.cc:697] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:25.776062 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:25.774837 13756 ts_tablet_manager.cc:1434] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.013s
I20260709 12:24:25.776702 13509 raft_consensus.cc:3060] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.779706 13736 leader_election.cc:290] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.781664 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9344f3a002754802ac715f986f4ff26b" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.782297 13433 raft_consensus.cc:3060] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.782655 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9344f3a002754802ac715f986f4ff26b" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.783702 13584 raft_consensus.cc:3060] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.784132 13757 ts_tablet_manager.cc:1434] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.009s
I20260709 12:24:25.792044 13433 raft_consensus.cc:2468] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.793375 13476 leader_election.cc:304] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.794653 13800 raft_consensus.cc:2804] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.795140 13800 raft_consensus.cc:697] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:25.795498 13584 raft_consensus.cc:2468] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.796417 13800 consensus_queue.cc:237] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.793737 13509 raft_consensus.cc:2468] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 1.
I20260709 12:24:25.791508 13434 raft_consensus.cc:2468] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 1.
I20260709 12:24:25.801863 13550 leader_election.cc:304] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.776816 13755 consensus_queue.cc:237] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.805951 13739 raft_consensus.cc:2804] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.807127 13739 raft_consensus.cc:697] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:25.812067 13739 consensus_queue.cc:237] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.809852 13782 raft_consensus.cc:493] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.815054 13782 raft_consensus.cc:515] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.817404 13782 leader_election.cc:290] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.818974 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:25.825037 13434 raft_consensus.cc:2468] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.826084 13476 leader_election.cc:304] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.823105 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:25.828064 13584 raft_consensus.cc:2468] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 0.
I20260709 12:24:25.827356 13782 raft_consensus.cc:2804] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:25.830745 13330 catalog_manager.cc:5697] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.831856 13782 raft_consensus.cc:493] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.832275 13782 raft_consensus.cc:3060] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.832603 13330 catalog_manager.cc:5697] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.834339 13330 catalog_manager.cc:5697] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.835852 13330 catalog_manager.cc:5697] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.840083 13782 raft_consensus.cc:515] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.842111 13782 leader_election.cc:290] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:25.843107 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:25.843354 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:25.843859 13434 raft_consensus.cc:3060] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.843962 13584 raft_consensus.cc:3060] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:25.845822 13331 catalog_manager.cc:5697] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 0 to 1, leader changed from <none> to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 1 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.851370 13434 raft_consensus.cc:2468] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.850939 13333 catalog_manager.cc:5697] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 1 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.853564 13476 leader_election.cc:304] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:25.853806 13584 raft_consensus.cc:2468] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 1.
I20260709 12:24:25.854453 13782 raft_consensus.cc:2804] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:25.854997 13782 raft_consensus.cc:697] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:25.855912 13782 consensus_queue.cc:237] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:25.864576 13331 catalog_manager.cc:5697] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 1 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.904170 13509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60225dc5aee746a3829866701714f1c7"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
mode: GRACEFUL
new_leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:52030
I20260709 12:24:25.904830 13509 raft_consensus.cc:606] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Received request to transfer leadership to TS 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:25.910111 13509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
mode: GRACEFUL
new_leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:52030
I20260709 12:24:25.910642 13509 raft_consensus.cc:606] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Received request to transfer leadership to TS 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:25.916139 13584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2663c712388549fc84888c6f55292559"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
mode: GRACEFUL
new_leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50958
I20260709 12:24:25.916682 13584 raft_consensus.cc:606] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Received request to transfer leadership to TS 3430bc1b0ce94ed8a5eafb8d71c95fd5
I20260709 12:24:25.939143 13434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
mode: GRACEFUL
new_leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
 from {username='slave'} at 127.0.0.1:58302
I20260709 12:24:25.939805 13434 raft_consensus.cc:606] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Received request to transfer leadership to TS fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:25.945350 13509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
mode: GRACEFUL
new_leader_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:52030
I20260709 12:24:25.945926 13509 raft_consensus.cc:606] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Received request to transfer leadership to TS 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:25.997912 13739 raft_consensus.cc:493] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.998683 13739 raft_consensus.cc:515] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.000560 13739 leader_election.cc:290] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:26.001538 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b6a9b4de5d4433813a7f8b6486187e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:26.001854 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b6a9b4de5d4433813a7f8b6486187e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:26.002269 13434 raft_consensus.cc:2393] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 488176bf4fdd4537a6953ae238bb7441 in current term 1: Already voted for candidate fa1ef25482c44f83be85e85166ffe7a1 in this term.
I20260709 12:24:26.003522 13550 leader_election.cc:304] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:26.004125 13739 raft_consensus.cc:3060] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.010545 13739 raft_consensus.cc:2749] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.055948 13782 raft_consensus.cc:493] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.056667 13782 raft_consensus.cc:515] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.058393 13782 leader_election.cc:290] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:26.059258 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84225ab11394f269d73a3abf64f751c" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" is_pre_election: true
I20260709 12:24:26.059545 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84225ab11394f269d73a3abf64f751c" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:26.060426 13584 raft_consensus.cc:2393] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1ef25482c44f83be85e85166ffe7a1 in current term 1: Already voted for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in this term.
I20260709 12:24:26.061316 13476 leader_election.cc:304] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1ef25482c44f83be85e85166ffe7a1; no voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:26.061942 13782 raft_consensus.cc:3060] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.069010 13782 raft_consensus.cc:2749] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.098327 13789 consensus_queue.cc:1048] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.106127 13758 raft_consensus.cc:493] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.106396 13784 raft_consensus.cc:993] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: : Instructing follower fa1ef25482c44f83be85e85166ffe7a1 to start an election
I20260709 12:24:26.106935 13784 raft_consensus.cc:1081] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Signalling peer fa1ef25482c44f83be85e85166ffe7a1 to start an election
I20260709 12:24:26.106659 13758 raft_consensus.cc:515] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.109378 13758 leader_election.cc:290] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:26.109567 13510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
 from {username='slave'} at 127.0.0.1:52648
I20260709 12:24:26.110908 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "488176bf4fdd4537a6953ae238bb7441" is_pre_election: true
I20260709 12:24:26.111392 13511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87767538766e40ebab186c49e35971e0" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1" is_pre_election: true
I20260709 12:24:26.111812 13584 raft_consensus.cc:2393] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in current term 1: Already voted for candidate fa1ef25482c44f83be85e85166ffe7a1 in this term.
I20260709 12:24:26.116528 13401 leader_election.cc:304] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5; no voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1
I20260709 12:24:26.117913 13510 raft_consensus.cc:493] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.118165 13758 raft_consensus.cc:3060] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.118363 13510 raft_consensus.cc:3060] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.120482 13743 consensus_queue.cc:1048] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.126969 13758 raft_consensus.cc:2749] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:26.128109 13510 raft_consensus.cc:515] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.132537 13510 leader_election.cc:290] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 2 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:26.133456 13434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:26.133482 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb8f6fcadbc496daefe749bbeaf2638" candidate_uuid: "fa1ef25482c44f83be85e85166ffe7a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:26.134155 13434 raft_consensus.cc:3055] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:26.134258 13584 raft_consensus.cc:3060] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.134553 13434 raft_consensus.cc:740] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:26.135538 13434 consensus_queue.cc:260] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.136739 13434 raft_consensus.cc:3060] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.141396 13584 raft_consensus.cc:2468] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 2.
I20260709 12:24:26.143082 13476 leader_election.cc:304] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:26.144013 13434 raft_consensus.cc:2468] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1ef25482c44f83be85e85166ffe7a1 in term 2.
I20260709 12:24:26.144343 13800 raft_consensus.cc:2804] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.144909 13800 raft_consensus.cc:697] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 LEADER]: Becoming Leader. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:26.145757 13782 consensus_queue.cc:1048] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.145792 13800 consensus_queue.cc:237] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.158942 13800 consensus_queue.cc:1048] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.158120 13333 catalog_manager.cc:5697] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 reported cstate change: term changed from 1 to 2, leader changed from 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129) to fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130). New cstate: current_term: 2 leader_uuid: "fa1ef25482c44f83be85e85166ffe7a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.178167 13789 consensus_queue.cc:1048] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.184989 13789 consensus_queue.cc:1048] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.185117 13800 consensus_queue.cc:1048] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.195367 13583 raft_consensus.cc:3060] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:26.206171 13800 consensus_queue.cc:1048] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:26.210989 13800 consensus_queue.cc:1048] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.226116 13801 consensus_queue.cc:1048] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.226576 13736 raft_consensus.cc:993] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: : Instructing follower 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:26.227334 13736 raft_consensus.cc:1081] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Signalling peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:26.229264 13434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50058
I20260709 12:24:26.229869 13434 raft_consensus.cc:493] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.230262 13434 raft_consensus.cc:3060] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.239486 13800 consensus_queue.cc:1048] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:24:26.255136 13800 consensus_queue.cc:1048] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.256534 13800 consensus_queue.cc:1048] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.258165 13434 raft_consensus.cc:515] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.264850 13433 raft_consensus.cc:1240] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Rejecting Update request from peer fa1ef25482c44f83be85e85166ffe7a1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:26.268720 13434 leader_election.cc:290] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:26.269384 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:26.270033 13510 raft_consensus.cc:3055] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:26.270390 13510 raft_consensus.cc:740] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:26.271500 13510 consensus_queue.cc:260] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.273064 13510 raft_consensus.cc:3060] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.274497 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5ce8bed884538a834a25ded17ca70" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:26.275097 13585 raft_consensus.cc:3060] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.283927 13585 raft_consensus.cc:2468] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:26.283951 13510 raft_consensus.cc:2468] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:26.284986 13401 leader_election.cc:304] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:26.285964 13789 raft_consensus.cc:2804] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.286481 13789 raft_consensus.cc:697] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:26.288786 13789 consensus_queue.cc:237] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.298604 13800 consensus_queue.cc:1048] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.304563 13801 raft_consensus.cc:993] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: : Instructing follower 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:26.306258 13755 raft_consensus.cc:1081] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Signalling peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:26.310622 13435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60225dc5aee746a3829866701714f1c7"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50058
I20260709 12:24:26.311214 13435 raft_consensus.cc:493] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.311718 13435 raft_consensus.cc:3060] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.314321 13331 catalog_manager.cc:5697] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 1 to 2, leader changed from fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130) to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.319599 13435 raft_consensus.cc:515] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.321800 13435 leader_election.cc:290] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:26.323405 13585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60225dc5aee746a3829866701714f1c7" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:26.324033 13585 raft_consensus.cc:3060] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.323405 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60225dc5aee746a3829866701714f1c7" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:26.326017 13510 raft_consensus.cc:3055] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:26.326323 13510 raft_consensus.cc:740] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:26.327014 13510 consensus_queue.cc:260] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.328202 13510 raft_consensus.cc:3060] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.334009 13585 raft_consensus.cc:2468] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:26.334713 13510 raft_consensus.cc:2468] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:26.335177 13401 leader_election.cc:304] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:26.336037 13743 raft_consensus.cc:2804] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.336460 13743 raft_consensus.cc:697] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:26.337218 13743 consensus_queue.cc:237] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.338229 13795 consensus_queue.cc:1048] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.344673 13331 catalog_manager.cc:5697] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 1 to 2, leader changed from fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130) to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.346520 13800 consensus_queue.cc:1048] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.351563 13739 raft_consensus.cc:993] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: : Instructing follower 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:26.352823 13795 raft_consensus.cc:1081] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Signalling peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 to start an election
I20260709 12:24:26.354447 13433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2663c712388549fc84888c6f55292559"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
 from {username='slave'} at 127.0.0.1:50042
I20260709 12:24:26.354988 13433 raft_consensus.cc:493] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.355275 13433 raft_consensus.cc:3060] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.362792 13433 raft_consensus.cc:515] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.363584 13434 raft_consensus.cc:1240] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Rejecting Update request from peer 488176bf4fdd4537a6953ae238bb7441 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:26.366089 13795 consensus_queue.cc:1059] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.367624 13433 leader_election.cc:290] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Requested vote from peers fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201), 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131:45199)
I20260709 12:24:26.368672 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:26.369277 13509 raft_consensus.cc:3060] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.370810 13739 raft_consensus.cc:3055] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:26.371261 13739 raft_consensus.cc:740] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:26.372129 13739 consensus_queue.cc:260] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.373061 13739 raft_consensus.cc:3060] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.378158 13584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2663c712388549fc84888c6f55292559" candidate_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
I20260709 12:24:26.379559 13755 consensus_queue.cc:1048] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:26.384297 13509 raft_consensus.cc:2468] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:26.384986 13510 raft_consensus.cc:1240] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Rejecting Update request from peer 488176bf4fdd4537a6953ae238bb7441 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:26.387573 13401 leader_election.cc:304] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:26.388306 13743 raft_consensus.cc:2804] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.390532 13743 raft_consensus.cc:697] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Leader. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:26.391707 13743 consensus_queue.cc:237] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.390465 13584 raft_consensus.cc:2468] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3430bc1b0ce94ed8a5eafb8d71c95fd5 in term 2.
I20260709 12:24:26.402935 13800 raft_consensus.cc:993] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: : Instructing follower 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:26.403677 13800 raft_consensus.cc:1081] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Signalling peer 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:26.405710 13330 catalog_manager.cc:5697] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 reported cstate change: term changed from 1 to 2, leader changed from 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131) to 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129). New cstate: current_term: 2 leader_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.407791 13585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:50314
I20260709 12:24:26.408813 13585 raft_consensus.cc:493] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.409507 13585 raft_consensus.cc:3060] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.417222 13585 raft_consensus.cc:515] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.418653 13585 leader_election.cc:290] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 2 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:26.420032 13510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:26.420758 13510 raft_consensus.cc:3055] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:26.420889 13433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27d58c9237a4f68a5b763018bb200fd" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:26.421149 13510 raft_consensus.cc:740] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:26.421537 13433 raft_consensus.cc:3060] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.422020 13510 consensus_queue.cc:260] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.423465 13510 raft_consensus.cc:3060] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.430531 13433 raft_consensus.cc:2468] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 2.
I20260709 12:24:26.430663 13510 raft_consensus.cc:2468] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 2.
I20260709 12:24:26.431821 13550 leader_election.cc:304] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:26.432540 13739 raft_consensus.cc:2804] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.433229 13739 raft_consensus.cc:697] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 2 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:26.434165 13739 consensus_queue.cc:237] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:26.442481 13330 catalog_manager.cc:5697] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 1 to 2, leader changed from fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130) to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:26.596087 13433 raft_consensus.cc:1275] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Refusing update from remote peer fa1ef25482c44f83be85e85166ffe7a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.597348 13755 consensus_queue.cc:1048] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.607568 13585 raft_consensus.cc:1275] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer fa1ef25482c44f83be85e85166ffe7a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.609232 13755 consensus_queue.cc:1048] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:26.777922 13585 raft_consensus.cc:1275] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.779158 13743 consensus_queue.cc:1048] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.788801 13510 raft_consensus.cc:1275] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.790267 13743 consensus_queue.cc:1048] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.817297 13434 raft_consensus.cc:1275] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.818678 13739 consensus_queue.cc:1048] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.819469 13585 raft_consensus.cc:1275] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.821131 13743 consensus_queue.cc:1048] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.826412 13510 raft_consensus.cc:1275] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.829341 13829 consensus_queue.cc:1048] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.833778 13509 raft_consensus.cc:1275] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.839432 13831 consensus_queue.cc:1048] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.847991 13584 raft_consensus.cc:1275] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.851369 13743 consensus_queue.cc:1048] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.864413 13510 raft_consensus.cc:1275] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 3430bc1b0ce94ed8a5eafb8d71c95fd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:26.865737 13831 consensus_queue.cc:1048] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:28.949083 13330 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47390:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:24:28.969396 13330 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47390:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:24:29.111342  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:29.168119 13476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.129:38909, user_credentials={real_user=slave}} blocked reactor thread for 52445.3us
W20260709 12:24:29.196879 13865 log.cc:927] Time spent T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:24:29.243959 13887 tablet.cc:1724] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.267218 13879 tablet.cc:1724] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.291548 13899 tablet.cc:1724] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:29.297073 13476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.131:45199, user_credentials={real_user=slave}} blocked reactor thread for 87883.7us
I20260709 12:24:29.311235 13897 tablet.cc:1724] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:29.313800 13890 log.cc:927] Time spent T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:29.298457 13891 tablet.cc:1724] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:29.345299 13896 log.cc:927] Time spent T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:29.325004 13901 tablet.cc:1724] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.358045 13879 tablet.cc:1724] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.353878 13894 tablet.cc:1724] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.296183 13893 tablet.cc:1724] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.387488 13905 tablet.cc:1724] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:24:29.417569 13550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.7.130:35201, user_credentials={real_user=slave}} blocked reactor thread for 51257.8us
I20260709 12:24:29.423424 13897 tablet.cc:1724] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.428146 13901 tablet.cc:1724] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.436206 13331 catalog_manager.cc:5789] TS 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909) does not have the latest schema for tablet 2663c712388549fc84888c6f55292559 (table soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]). Expected version 1 got 0
I20260709 12:24:29.441857 13331 catalog_manager.cc:5789] TS 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909) does not have the latest schema for tablet 66b5ce8bed884538a834a25ded17ca70 (table soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66]). Expected version 1 got 0
I20260709 12:24:29.438042 13891 tablet.cc:1724] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.442938 13887 tablet.cc:1724] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.445853 13509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8"
dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
mode: GRACEFUL
new_leader_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:52034
I20260709 12:24:29.452337 13509 raft_consensus.cc:606] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Received request to transfer leadership to TS 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:29.449451 13894 tablet.cc:1724] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.445892 13901 tablet.cc:1724] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.453665 13897 tablet.cc:1724] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.460604 13909 tablet.cc:1724] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.464393 13898 raft_consensus.cc:993] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: : Instructing follower 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:29.464900 13898 raft_consensus.cc:1081] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Signalling peer 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:29.465853 13899 tablet.cc:1724] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.478822 13907 tablet.cc:1724] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.484490 13893 tablet.cc:1724] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.486047 13879 tablet.cc:1724] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.495648 13905 tablet.cc:1724] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.502470 13891 tablet.cc:1724] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.494475 13897 tablet.cc:1724] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.466518 13908 tablet.cc:1724] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.467470 13581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:50314
I20260709 12:24:29.512315 13581 raft_consensus.cc:493] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:29.512831 13581 raft_consensus.cc:3060] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:29.533506 13581 raft_consensus.cc:515] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:29.537918 13905 tablet.cc:1724] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:24:29.543286 13435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:29.543951 13435 raft_consensus.cc:3060] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:29.561728 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ea9537e8354b86b59dbfc432cebaa8" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:29.562440 13509 raft_consensus.cc:3055] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:29.562769 13509 raft_consensus.cc:740] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa1ef25482c44f83be85e85166ffe7a1, State: Running, Role: LEADER
I20260709 12:24:29.557545 13435 raft_consensus.cc:2468] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 2.
I20260709 12:24:29.565980 13509 consensus_queue.cc:260] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:29.566870 13550 leader_election.cc:304] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3430bc1b0ce94ed8a5eafb8d71c95fd5, 488176bf4fdd4537a6953ae238bb7441; no voters: 
I20260709 12:24:29.567319 13509 raft_consensus.cc:3060] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:29.567844 13910 raft_consensus.cc:2804] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:29.568382 13910 raft_consensus.cc:697] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:29.569200 13910 consensus_queue.cc:237] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:29.560022 13581 leader_election.cc:290] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 2 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:29.574563 13435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e"
dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
mode: GRACEFUL
new_leader_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:58312
I20260709 12:24:29.575229 13435 raft_consensus.cc:606] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Received request to transfer leadership to TS 488176bf4fdd4537a6953ae238bb7441
I20260709 12:24:29.576838  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:29.577479  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:29.584599 13509 raft_consensus.cc:2468] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 2.
I20260709 12:24:29.588204 13333 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6: soft_deleted_table [id=b9d04b2196174895b0fefdc6868afb66] alter complete (version 1)
I20260709 12:24:29.597862 13331 catalog_manager.cc:5697] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 1 to 2, leader changed from fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130) to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 2 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:29.706586 13875 raft_consensus.cc:993] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: : Instructing follower 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:29.707125 13875 raft_consensus.cc:1081] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Signalling peer 488176bf4fdd4537a6953ae238bb7441 to start an election
I20260709 12:24:29.708642 13581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e"
dest_uuid: "488176bf4fdd4537a6953ae238bb7441"
 from {username='slave'} at 127.0.0.1:50312
I20260709 12:24:29.709056 13581 raft_consensus.cc:493] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:29.709304 13581 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.715446 13581 raft_consensus.cc:515] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:29.716964 13581 leader_election.cc:290] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 3 election: Requested vote from peers 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909), fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201)
I20260709 12:24:29.717790 13435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5"
I20260709 12:24:29.718058 13509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1b76e8876c43ecb5d1812adad4172e" candidate_uuid: "488176bf4fdd4537a6953ae238bb7441" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa1ef25482c44f83be85e85166ffe7a1"
I20260709 12:24:29.718441 13435 raft_consensus.cc:3055] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:29.718677 13509 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.718838 13435 raft_consensus.cc:740] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3430bc1b0ce94ed8a5eafb8d71c95fd5, State: Running, Role: LEADER
I20260709 12:24:29.719851 13435 consensus_queue.cc:260] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:29.721071 13435 raft_consensus.cc:3060] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.724839 13509 raft_consensus.cc:2468] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 3.
I20260709 12:24:29.726039 13550 leader_election.cc:304] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 488176bf4fdd4537a6953ae238bb7441, fa1ef25482c44f83be85e85166ffe7a1; no voters: 
I20260709 12:24:29.726784 13910 raft_consensus.cc:2804] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:29.728176 13910 raft_consensus.cc:697] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 3 LEADER]: Becoming Leader. State: Replica: 488176bf4fdd4537a6953ae238bb7441, State: Running, Role: LEADER
I20260709 12:24:29.729185 13435 raft_consensus.cc:2468] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 488176bf4fdd4537a6953ae238bb7441 in term 3.
I20260709 12:24:29.729336 13910 consensus_queue.cc:237] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } }
I20260709 12:24:29.738431 13331 catalog_manager.cc:5697] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 reported cstate change: term changed from 2 to 3, leader changed from 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129) to 488176bf4fdd4537a6953ae238bb7441 (127.3.7.131). New cstate: current_term: 3 leader_uuid: "488176bf4fdd4537a6953ae238bb7441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "488176bf4fdd4537a6953ae238bb7441" member_type: VOTER last_known_addr { host: "127.3.7.131" port: 45199 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.113510 13432 raft_consensus.cc:1275] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:30.115442 13892 consensus_queue.cc:1048] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:30.130816 13509 raft_consensus.cc:1275] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:30.132510 13910 consensus_queue.cc:1048] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:30.176607 13432 raft_consensus.cc:1275] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 3 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:30.177901 13910 consensus_queue.cc:1048] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3430bc1b0ce94ed8a5eafb8d71c95fd5" member_type: VOTER last_known_addr { host: "127.3.7.129" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:30.189960 13509 raft_consensus.cc:1275] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 3 FOLLOWER]: Refusing update from remote peer 488176bf4fdd4537a6953ae238bb7441: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:30.191751 13910 consensus_queue.cc:1048] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1ef25482c44f83be85e85166ffe7a1" member_type: VOTER last_known_addr { host: "127.3.7.130" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:30.579097  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:30.587637  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:30.588047  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:31.589188  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:31.595177  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:31.595706  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:32.596781  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:32.602888  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:32.603559  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.604606  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.609711  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:33.610147  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:34.611143  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:34.616248  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:34.616667  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:35.617636  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:35.623014  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:35.623453  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:36.624472  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.629746  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:36.630286  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:37.631264  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:37.637259  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:37.637815  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:38.638993  3102 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:38.645344  3102 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:38.645754  3102 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:39.708103  3102 tablet_server.cc:179] TabletServer@127.3.7.129:0 shutting down...
W20260709 12:24:39.719265 13550 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 12:24:39.724934 13550 consensus_peers.cc:597] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.758332  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:39.759560  3102 tablet_replica.cc:333] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.761055  3102 raft_consensus.cc:2243] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.761802  3102 raft_consensus.cc:2272] T c27d58c9237a4f68a5b763018bb200fd P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.764919  3102 tablet_replica.cc:333] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.765560  3102 raft_consensus.cc:2243] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.766420  3102 raft_consensus.cc:2272] T 66b5ce8bed884538a834a25ded17ca70 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.768730  3102 tablet_replica.cc:333] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.769376  3102 raft_consensus.cc:2243] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.769961  3102 raft_consensus.cc:2272] T 8bb8f6fcadbc496daefe749bbeaf2638 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.772568  3102 tablet_replica.cc:333] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.773216  3102 raft_consensus.cc:2243] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.773780  3102 raft_consensus.cc:2272] T 9344f3a002754802ac715f986f4ff26b P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.776242  3102 tablet_replica.cc:333] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.776887  3102 raft_consensus.cc:2243] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.777354  3102 raft_consensus.cc:2272] T ff1b76e8876c43ecb5d1812adad4172e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.779695  3102 tablet_replica.cc:333] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.780298  3102 raft_consensus.cc:2243] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.780848  3102 raft_consensus.cc:2272] T d8b6a9b4de5d4433813a7f8b6486187e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.784019  3102 tablet_replica.cc:333] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.784622  3102 raft_consensus.cc:2243] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.785220  3102 raft_consensus.cc:2272] T 87767538766e40ebab186c49e35971e0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:39.786723 13476 consensus_peers.cc:597] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.788180  3102 tablet_replica.cc:333] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.789281  3102 raft_consensus.cc:2243] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.789906  3102 raft_consensus.cc:2272] T f9475349e61c4760b9b47bcaecc3f167 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.793008  3102 tablet_replica.cc:333] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.793663  3102 raft_consensus.cc:2243] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.794150  3102 raft_consensus.cc:2272] T f2ea9537e8354b86b59dbfc432cebaa8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.796473  3102 tablet_replica.cc:333] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.797035  3102 raft_consensus.cc:2243] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.797960  3102 raft_consensus.cc:2272] T 2663c712388549fc84888c6f55292559 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.800387  3102 tablet_replica.cc:333] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.801007  3102 raft_consensus.cc:2243] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.801515  3102 raft_consensus.cc:2272] T 98f42c0cf5ca45d484d873062771a3a8 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.803797  3102 tablet_replica.cc:333] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.804407  3102 raft_consensus.cc:2243] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.805285  3102 raft_consensus.cc:2272] T f84225ab11394f269d73a3abf64f751c P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.808369  3102 tablet_replica.cc:333] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.809121  3102 raft_consensus.cc:2243] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.809880  3102 raft_consensus.cc:2272] T bdf49c79077d4d54b7504995830ad23e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.812491  3102 tablet_replica.cc:333] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.813082  3102 raft_consensus.cc:2243] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.813997  3102 raft_consensus.cc:2272] T eabd02aceca3424dbd7e5f479734fcb0 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.816500  3102 tablet_replica.cc:333] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.817098  3102 raft_consensus.cc:2243] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.817940  3102 raft_consensus.cc:2272] T 60225dc5aee746a3829866701714f1c7 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.820523  3102 tablet_replica.cc:333] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.821167  3102 raft_consensus.cc:2243] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:39.821631  3102 raft_consensus.cc:2272] T 5dcb5d0265e749b0b1ed8928e970cde2 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.823951  3102 tablet_replica.cc:333] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.824496  3102 raft_consensus.cc:2243] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.825395  3102 raft_consensus.cc:2272] T df4ce7abbf254a6fbc03dbeea9850383 P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.827976  3102 tablet_replica.cc:333] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5: stopping tablet replica
I20260709 12:24:39.828513  3102 raft_consensus.cc:2243] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.829500  3102 raft_consensus.cc:2272] T f0e2465e8ed04355896d0754343cdd4e P 3430bc1b0ce94ed8a5eafb8d71c95fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:39.865655 13550 connection.cc:573] client connection to 127.3.7.129:38909 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:24:39.869407 13550 consensus_peers.cc:597] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.881064  3102 tablet_server.cc:196] TabletServer@127.3.7.129:0 shutdown complete.
W20260709 12:24:39.891993 13550 consensus_peers.cc:597] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:39.908093 13550 consensus_peers.cc:597] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:39.942003  3102 tablet_server.cc:179] TabletServer@127.3.7.130:0 shutting down...
W20260709 12:24:39.942670 13476 consensus_peers.cc:597] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:39.958947 13476 consensus_peers.cc:597] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.001212  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:40.002609  3102 tablet_replica.cc:333] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.004716  3102 raft_consensus.cc:2243] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.005800  3102 raft_consensus.cc:2272] T 66b5ce8bed884538a834a25ded17ca70 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.010506  3102 tablet_replica.cc:333] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.012121  3102 raft_consensus.cc:2243] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.014765  3102 raft_consensus.cc:2272] T 8bb8f6fcadbc496daefe749bbeaf2638 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.018822  3102 tablet_replica.cc:333] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.020015  3102 raft_consensus.cc:2243] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.021245  3102 raft_consensus.cc:2272] T c27d58c9237a4f68a5b763018bb200fd P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.024505  3102 tablet_replica.cc:333] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.025264  3102 raft_consensus.cc:2243] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.027139  3102 raft_consensus.cc:2272] T 9344f3a002754802ac715f986f4ff26b P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.030085  3102 tablet_replica.cc:333] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.031086  3102 raft_consensus.cc:2243] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.031795  3102 raft_consensus.cc:2272] T ff1b76e8876c43ecb5d1812adad4172e P fa1ef25482c44f83be85e85166ffe7a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.036263  3102 tablet_replica.cc:333] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.037437  3102 raft_consensus.cc:2243] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:40.039369 13550 consensus_peers.cc:597] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 -> Peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Couldn't send request to peer fa1ef25482c44f83be85e85166ffe7a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.039741  3102 raft_consensus.cc:2272] T d8b6a9b4de5d4433813a7f8b6486187e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.044302  3102 tablet_replica.cc:333] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.045809  3102 raft_consensus.cc:2243] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.047392  3102 raft_consensus.cc:2272] T f84225ab11394f269d73a3abf64f751c P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:40.048491 13550 consensus_peers.cc:597] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 -> Peer fa1ef25482c44f83be85e85166ffe7a1 (127.3.7.130:35201): Couldn't send request to peer fa1ef25482c44f83be85e85166ffe7a1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:40.051599 13476 consensus_peers.cc:597] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 -> Peer 3430bc1b0ce94ed8a5eafb8d71c95fd5 (127.3.7.129:38909): Couldn't send request to peer 3430bc1b0ce94ed8a5eafb8d71c95fd5. Status: Network error: Client connection negotiation failed: client connection to 127.3.7.129:38909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:40.052546  3102 tablet_replica.cc:333] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.053299  3102 raft_consensus.cc:2243] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.053956  3102 raft_consensus.cc:2272] T bdf49c79077d4d54b7504995830ad23e P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.056908  3102 tablet_replica.cc:333] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.057636  3102 raft_consensus.cc:2243] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.058236  3102 raft_consensus.cc:2272] T eabd02aceca3424dbd7e5f479734fcb0 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.061884  3102 tablet_replica.cc:333] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.062563  3102 raft_consensus.cc:2243] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.063376  3102 raft_consensus.cc:2272] T f0e2465e8ed04355896d0754343cdd4e P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.066043  3102 tablet_replica.cc:333] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.066708  3102 raft_consensus.cc:2243] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.068234  3102 raft_consensus.cc:2272] T 98f42c0cf5ca45d484d873062771a3a8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.071188  3102 tablet_replica.cc:333] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.071975  3102 raft_consensus.cc:2243] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.072701  3102 raft_consensus.cc:2272] T 2663c712388549fc84888c6f55292559 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.075703  3102 tablet_replica.cc:333] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.076354  3102 raft_consensus.cc:2243] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.077766  3102 raft_consensus.cc:2272] T 87767538766e40ebab186c49e35971e0 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.080780  3102 tablet_replica.cc:333] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.081408  3102 raft_consensus.cc:2243] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.082687  3102 raft_consensus.cc:2272] T f9475349e61c4760b9b47bcaecc3f167 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.086279  3102 tablet_replica.cc:333] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.086961  3102 raft_consensus.cc:2243] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.087769  3102 raft_consensus.cc:2272] T f2ea9537e8354b86b59dbfc432cebaa8 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.090628  3102 tablet_replica.cc:333] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.091174  3102 raft_consensus.cc:2243] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.091854  3102 raft_consensus.cc:2272] T df4ce7abbf254a6fbc03dbeea9850383 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.094696  3102 tablet_replica.cc:333] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.095243  3102 raft_consensus.cc:2243] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.095952  3102 raft_consensus.cc:2272] T 60225dc5aee746a3829866701714f1c7 P fa1ef25482c44f83be85e85166ffe7a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.098556  3102 tablet_replica.cc:333] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1: stopping tablet replica
I20260709 12:24:40.099025  3102 raft_consensus.cc:2243] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.100394  3102 raft_consensus.cc:2272] T 5dcb5d0265e749b0b1ed8928e970cde2 P fa1ef25482c44f83be85e85166ffe7a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.154187  3102 tablet_server.cc:196] TabletServer@127.3.7.130:0 shutdown complete.
I20260709 12:24:40.210496  3102 tablet_server.cc:179] TabletServer@127.3.7.131:0 shutting down...
I20260709 12:24:40.244601  3102 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:40.245512  3102 tablet_replica.cc:333] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.246584  3102 raft_consensus.cc:2243] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.247344  3102 raft_consensus.cc:2272] T 66b5ce8bed884538a834a25ded17ca70 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.250223  3102 tablet_replica.cc:333] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.250918  3102 raft_consensus.cc:2243] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.252156  3102 raft_consensus.cc:2272] T c27d58c9237a4f68a5b763018bb200fd P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.254629  3102 tablet_replica.cc:333] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.255231  3102 raft_consensus.cc:2243] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.255919  3102 raft_consensus.cc:2272] T 8bb8f6fcadbc496daefe749bbeaf2638 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.258361  3102 tablet_replica.cc:333] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.259063  3102 raft_consensus.cc:2243] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.259552  3102 raft_consensus.cc:2272] T f9475349e61c4760b9b47bcaecc3f167 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.261888  3102 tablet_replica.cc:333] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.262449  3102 raft_consensus.cc:2243] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.263865  3102 raft_consensus.cc:2272] T f2ea9537e8354b86b59dbfc432cebaa8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.266228  3102 tablet_replica.cc:333] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.266844  3102 raft_consensus.cc:2243] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.267504  3102 raft_consensus.cc:2272] T 87767538766e40ebab186c49e35971e0 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.269738  3102 tablet_replica.cc:333] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.270349  3102 raft_consensus.cc:2243] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.270918  3102 raft_consensus.cc:2272] T d8b6a9b4de5d4433813a7f8b6486187e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.273480  3102 tablet_replica.cc:333] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.274091  3102 raft_consensus.cc:2243] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.274668  3102 raft_consensus.cc:2272] T 9344f3a002754802ac715f986f4ff26b P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.277376  3102 tablet_replica.cc:333] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.278067  3102 raft_consensus.cc:2243] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.279222  3102 raft_consensus.cc:2272] T ff1b76e8876c43ecb5d1812adad4172e P 488176bf4fdd4537a6953ae238bb7441 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.281587  3102 tablet_replica.cc:333] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.282219  3102 raft_consensus.cc:2243] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.282831  3102 raft_consensus.cc:2272] T 2663c712388549fc84888c6f55292559 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.285143  3102 tablet_replica.cc:333] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.285873  3102 raft_consensus.cc:2243] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.286595  3102 raft_consensus.cc:2272] T 98f42c0cf5ca45d484d873062771a3a8 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.289798  3102 tablet_replica.cc:333] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.290467  3102 raft_consensus.cc:2243] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.291154  3102 raft_consensus.cc:2272] T 60225dc5aee746a3829866701714f1c7 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.293416  3102 tablet_replica.cc:333] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.293906  3102 raft_consensus.cc:2243] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.294425  3102 raft_consensus.cc:2272] T 5dcb5d0265e749b0b1ed8928e970cde2 P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.296730  3102 tablet_replica.cc:333] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.297227  3102 raft_consensus.cc:2243] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.297772  3102 raft_consensus.cc:2272] T f84225ab11394f269d73a3abf64f751c P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.300153  3102 tablet_replica.cc:333] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.300603  3102 raft_consensus.cc:2243] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.301576  3102 raft_consensus.cc:2272] T bdf49c79077d4d54b7504995830ad23e P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.303960  3102 tablet_replica.cc:333] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.304457  3102 raft_consensus.cc:2243] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.304922  3102 raft_consensus.cc:2272] T df4ce7abbf254a6fbc03dbeea9850383 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.307353  3102 tablet_replica.cc:333] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.307812  3102 raft_consensus.cc:2243] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.308248  3102 raft_consensus.cc:2272] T eabd02aceca3424dbd7e5f479734fcb0 P 488176bf4fdd4537a6953ae238bb7441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.310526  3102 tablet_replica.cc:333] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441: stopping tablet replica
I20260709 12:24:40.311218  3102 raft_consensus.cc:2243] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:40.311833  3102 raft_consensus.cc:2272] T f0e2465e8ed04355896d0754343cdd4e P 488176bf4fdd4537a6953ae238bb7441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.361564  3102 tablet_server.cc:196] TabletServer@127.3.7.131:0 shutdown complete.
I20260709 12:24:40.403488  3102 master.cc:562] Master@127.3.7.190:36393 shutting down...
I20260709 12:24:40.426191  3102 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:40.426832  3102 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:40.427129  3102 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0b0fb9b7bf5a432f9af0a6e3092216f6: stopping tablet replica
I20260709 12:24:40.448776  3102 master.cc:584] Master@127.3.7.190:36393 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22118 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42792 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (359364 ms total)
[  PASSED  ] 8 tests.
I20260709 12:24:40.513679  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2240 messages since previous log ~33 seconds ago
I20260709 12:24:40.513926  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2240 messages since previous log ~33 seconds ago
I20260709 12:24:40.514153  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2239 messages since previous log ~33 seconds ago
I20260709 12:24:40.514374  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:24:40.514561  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:24:40.514791  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~146 seconds ago
I20260709 12:24:40.515080  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 12:24:40.515595  3102 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
